Skip to content

Commit

Permalink
Update tests report
Browse files Browse the repository at this point in the history
  • Loading branch information
nicoloboschi committed Jan 17, 2024
1 parent 2ce6c61 commit b71bde5
Showing 1 changed file with 49 additions and 0 deletions.
49 changes: 49 additions & 0 deletions reports/tests/langchain.html
Original file line number Diff line number Diff line change
@@ -1,5 +1,54 @@
<h3 class='title'>
<a href="https://github.com/langchain-ai/langchain/commits/e5cf1e2414a22c7465f0f47bd661ece183e88924">e5cf1e2414a22c7465f0f47bd661ece183e88924</a>
(<a href="https://github.com/datastax/ragstack-ai/actions/runs/7555359070">7555359070 (2024-01-17 15:42)</a>)
</h3>
<p class='info'>Reference: <a href=""></a></p>
<br>
langchain::chat::gemini-pro-llm -> ✅ (2 s)<br>
langchain::chat::vertex-gemini-pro-llm -> ✅ (4 s)<br>
langchain::conversational_rag::azure-openai-llm,azure-openai-embedding,astra-db -> ✅ (24 s)<br>
langchain::conversational_rag::azure-openai-llm,azure-openai-embedding,cassandra -> ✅ (32 s)<br>
langchain::conversational_rag::bedrock-anthropic-llm,bedrock-titan-embedding,astra-db -> ✅ (45 s)<br>
langchain::conversational_rag::bedrock-anthropic-llm,bedrock-titan-embedding,cassandra -> ✅ (49 s)<br>
langchain::conversational_rag::bedrock-meta-llm,bedrock-cohere-embedding,astra-db -> ✅ (33 s)<br>
langchain::conversational_rag::bedrock-meta-llm,bedrock-cohere-embedding,cassandra -> ✅ (53 s)<br>
langchain::conversational_rag::huggingface-hub-llm,huggingface-hub-embedding,astra-db -> ✅ (33 s)<br>
langchain::conversational_rag::huggingface-hub-llm,huggingface-hub-embedding,cassandra -> ✅ (54 s)<br>
langchain::conversational_rag::nvidia-mixtral-llm,nvidia-embedding,astra-db -> ❌ <ExceptionInfo Exception("[404] Not Found\nFunction invocation request id '8c3af996-2e70-4153-957a-a9a3a9e82415': Invalid invocation request id specified") tblen=42> (3634 s)<br>
langchain::conversational_rag::nvidia-mixtral-llm,nvidia-embedding,cassandra -> ❌ <ExceptionInfo Exception("[404] Not Found\nFunction invocation request id '5ff4be2f-9763-4664-ab1f-4ee88c2485fd': Invalid invocation request id specified") tblen=42> (3616 s)<br>
langchain::conversational_rag::openai-llm,openai-embedding,astra-db -> ✅ (29 s)<br>
langchain::conversational_rag::openai-llm,openai-embedding,cassandra -> ✅ (29 s)<br>
langchain::conversational_rag::vertex-llm,vertex-embedding,astra-db -> ✅ (31 s)<br>
langchain::conversational_rag::vertex-llm,vertex-embedding,cassandra -> ✅ (27 s)<br>
langchain::document_loader::azure -> ✅ (1 s)<br>
langchain::document_loader::csv -> ✅ (0 s)<br>
langchain::document_loader::s3 -> ✅ (3 s)<br>
langchain::document_loader::web -> ✅ (0 s)<br>
langchain::multimodal_rag::gemini-pro-vision-llm,vertex-gemini-multimodal-embedding,astra-db -> ✅ (21 s)<br>
langchain::multimodal_rag::gemini-pro-vision-llm,vertex-gemini-multimodal-embedding,cassandra -> ❌ <ExceptionInfo AssertionError('assert \'Coffee Machine Ultra Cool\' in " It\'s a coffee filter basket. It\'s part of the Another Tree...e 2 product." = AIMessage(content=" It\'s a coffee filter basket. It\'s part of the Another Tree 2 product.").content') tblen=16> (24 s)<br>
langchain::multimodal_rag::vertex-gemini-pro-vision-llm,vertex-gemini-multimodal-embedding,astra-db -> ✅ (28 s)<br>
langchain::multimodal_rag::vertex-gemini-pro-vision-llm,vertex-gemini-multimodal-embedding,cassandra -> ✅ (22 s)<br>
langchain::rag_custom_chain::azure-openai-llm,azure-openai-embedding,astra-db -> ✅ (20 s)<br>
langchain::rag_custom_chain::azure-openai-llm,azure-openai-embedding,cassandra -> ✅ (32 s)<br>
langchain::rag_custom_chain::bedrock-anthropic-llm,bedrock-titan-embedding,astra-db -> ✅ (44 s)<br>
langchain::rag_custom_chain::bedrock-anthropic-llm,bedrock-titan-embedding,cassandra -> ✅ (36 s)<br>
langchain::rag_custom_chain::bedrock-meta-llm,bedrock-cohere-embedding,astra-db -> ✅ (51 s)<br>
langchain::rag_custom_chain::bedrock-meta-llm,bedrock-cohere-embedding,cassandra -> ✅ (42 s)<br>
langchain::rag_custom_chain::huggingface-hub-llm,huggingface-hub-embedding,astra-db -> ✅ (57 s)<br>
langchain::rag_custom_chain::huggingface-hub-llm,huggingface-hub-embedding,cassandra -> ✅ (? s)<br>
langchain::rag_custom_chain::nvidia-mixtral-llm,nvidia-embedding,astra-db -> ✅ (37 s)<br>
langchain::rag_custom_chain::nvidia-mixtral-llm,nvidia-embedding,cassandra -> ❌ <ExceptionInfo Exception("[404] Not Found\nFunction invocation request id '5ec37c32-051c-4af0-a4b7-19973cc47e24': Invalid invocation request id specified") tblen=33> (3632 s)<br>
langchain::rag_custom_chain::openai-llm,openai-embedding,astra-db -> ✅ (180 s)<br>
langchain::rag_custom_chain::openai-llm,openai-embedding,cassandra -> ✅ (24 s)<br>
langchain::rag_custom_chain::vertex-llm,vertex-embedding,astra-db -> ✅ (44 s)<br>
langchain::rag_custom_chain::vertex-llm,vertex-embedding,cassandra -> ✅ (40 s)<br>
langchain::test_astra.py::test_basic_metadata_filtering_no_vector -> ✅ (4 s)<br>
langchain::test_astra.py::test_basic_vector_search -> ❌ <ExceptionInfo ValueError('[{"message": "INVALID_ARGUMENT: Unknown namespace \'default_keyspace\', you must create it first.", "errorCode": "NAMESPACE_DOES_NOT_EXIST"}]') tblen=29> (? s)<br>
langchain::test_astra.py::test_ingest_errors -> ❌ <ExceptionInfo ValueError('[{"message": "INVALID_ARGUMENT: Unknown namespace \'default_keyspace\', you must create it first.", "errorCode": "NAMESPACE_DOES_NOT_EXIST"}]') tblen=29> (? s)<br>
langchain::test_astra.py::test_vector_search_with_metadata -> ✅ (22 s)<br>
langchain::test_astra.py::test_wrong_connection_parameters -> ✅ (? s)<br>
langchain::test_compatibility_rag.py::test_rag[huggingface_hub_embedding-huggingface_hub_llm-astra_db-conversational_rag] -> ❌ <ExceptionInfo HTTPStatusError("Server error '504 Gateway Timeout' for url 'https://c000b2d7-89da-414b-901d-a90e6f66ef84-us-west-2.ap...i/json/v1/default_keyspace'\nFor more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/504") tblen=20> (30 s)<br><h3 class='title'>
<a href="https://github.com/langchain-ai/langchain/commits/e5cf1e2414a22c7465f0f47bd661ece183e88924">e5cf1e2414a22c7465f0f47bd661ece183e88924</a>
(<a href="https://github.com/datastax/ragstack-ai/actions/runs/7554000918">7554000918 (2024-01-17 10:54)</a>)
</h3>
<p class='info'>Reference: <a href=""></a></p>
Expand Down

0 comments on commit b71bde5

Please sign in to comment.