Skip to content

Commit

Permalink
Update benchmarks 7695704544 - reports/benchmarks/2024-01-29_12-07-12
Browse files Browse the repository at this point in the history
  • Loading branch information
@nicoloboschi
nicoloboschi committed Jan 29, 2024
1 parent 276011e commit 826fef0
Show file tree
Hide file tree
Showing 16 changed files with 1,990 additions and 0 deletions.
18 changes: 18 additions & 0 deletions reports/benchmarks/2024-01-29_12-07-12/README.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
# RAGStack - Benchmarks Report - 2024-01-29 12:07:09

| Test Case | p50 | p90 | p95 | p99 |
|---|---|---|---|---|
| embeddings_batch100_chunk256-openai_ada002 | 3.06 | 3.06 | 3.06 | 3.06 |
| embeddings_batch100_chunk512-openai_ada002 | 3.2 | 3.2 | 3.2 | 3.2 |
| embeddings_batch50_chunk256-openai_ada002 | 3.55 | 3.55 | 3.55 | 3.55 |
| embeddings_batch50_chunk512-openai_ada002 | 3.55 | 3.55 | 3.55 | 3.55 |
| embeddings_batch10_chunk256-openai_ada002 | 5.4 | 5.4 | 5.4 | 5.4 |
| embeddings_batch50_chunk512-nvidia_nvolveqa40k | 5.52 | 5.52 | 5.52 | 5.52 |
| embeddings_batch100_chunk256-nvidia_nvolveqa40k | 6.2 | 6.2 | 6.2 | 6.2 |
| embeddings_batch100_chunk512-nvidia_nvolveqa40k | 6.21 | 6.21 | 6.21 | 6.21 |
| embeddings_batch10_chunk512-openai_ada002 | 6.92 | 6.92 | 6.92 | 6.92 |
| embeddings_batch50_chunk256-nvidia_nvolveqa40k | 7.2 | 7.2 | 7.2 | 7.2 |
| embeddings_batch10_chunk512-nvidia_nvolveqa40k | 9.1 | 9.1 | 9.1 | 9.1 |
| embeddings_batch10_chunk256-nvidia_nvolveqa40k | 9.12 | 9.12 | 9.12 | 9.12 |

<img src='plot.svg' />
76 changes: 76 additions & 0 deletions reports/benchmarks/2024-01-29_12-07-12/benchmarks.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:root:Starting test case
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:root:Starting test case
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:root:Starting test case
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:root:Starting test case
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:root:Starting test case
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/embeddings "HTTP/1.1 200 OK"
INFO:root:Starting test case
INFO:root:Starting test case
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch100_chunk256-nvidia_nvolveqa40k.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[6.202193088000001],"warmups":[[1,8.033775862000027]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch100_chunk256 nvidia_nvolveqa40k","command_max_rss":83632128,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=2935 MHz; 1=2877 MHz; 2=3242 MHz; 3=3297 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:06:47.762126","duration":14.306412134000027,"hostname":"fv-az525-874","load_avg_1min":0.48,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":307.76432180404663},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch100_chunk256-openai_ada002.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[3.0632637260000024],"warmups":[[1,3.056866897999953]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch100_chunk256 openai_ada002","command_max_rss":151453696,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3243 MHz; 1=3199 MHz; 2=3332 MHz; 3=3019 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:06:33.327916","duration":6.1933870070000125,"hostname":"fv-az525-874","load_avg_1min":0.62,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":293.33025908470154},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch100_chunk512-nvidia_nvolveqa40k.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[6.214858456000002],"warmups":[[1,6.478936356999952]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch100_chunk512 nvidia_nvolveqa40k","command_max_rss":83763200,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3244 MHz; 1=3255 MHz; 2=2814 MHz; 3=2966 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:07:07.330620","duration":12.766234963999977,"hostname":"fv-az525-874","load_avg_1min":0.7,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":327.3327782154083},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch100_chunk512-openai_ada002.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[3.2019995630000153],"warmups":[[1,3.2139059389999716]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch100_chunk512 openai_ada002","command_max_rss":153448448,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3242 MHz; 1=3213 MHz; 2=2789 MHz; 3=2698 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:06:54.438789","duration":6.488751931999957,"hostname":"fv-az525-874","load_avg_1min":0.52,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":314.44088101387024},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch10_chunk256-nvidia_nvolveqa40k.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[9.117978915999998],"warmups":[[1,9.415244596999997]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch10_chunk256 nvidia_nvolveqa40k","command_max_rss":81498112,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=2880 MHz; 1=3058 MHz; 2=2889 MHz; 3=3059 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:05:18.664709","duration":18.610249519000007,"hostname":"fv-az525-874","load_avg_1min":0.56,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":218.66720867156982},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch10_chunk256-openai_ada002.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[5.398796991000012],"warmups":[[1,7.291147414999983]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch10_chunk256 openai_ada002","command_max_rss":152076288,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=2868 MHz; 1=2929 MHz; 2=3242 MHz; 3=3333 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:04:59.923632","duration":12.76397141199999,"hostname":"fv-az525-874","load_avg_1min":0.67,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":199.92592096328735},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch10_chunk512-nvidia_nvolveqa40k.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[9.098559965000021],"warmups":[[1,7.789102850000006]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch10_chunk512 nvidia_nvolveqa40k","command_max_rss":81600512,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3078 MHz; 1=3311 MHz; 2=3236 MHz; 3=2893 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:05:48.432511","duration":16.958478074999988,"hostname":"fv-az525-874","load_avg_1min":0.4,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":248.43471765518188},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch10_chunk512-openai_ada002.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[6.916698567999987],"warmups":[[1,5.499823508999981]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch10_chunk512 openai_ada002","command_max_rss":149278720,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3251 MHz; 1=3244 MHz; 2=2972 MHz; 3=2653 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:05:31.347007","duration":12.489086231000016,"hostname":"fv-az525-874","load_avg_1min":0.51,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":231.34922337532043},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch50_chunk256-nvidia_nvolveqa40k.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[7.2019749669999555],"warmups":[[1,5.734251422999989]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch50_chunk256 nvidia_nvolveqa40k","command_max_rss":83742720,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=2888 MHz; 1=3234 MHz; 2=3238 MHz; 3=2878 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:06:08.749461","duration":13.007608946000005,"hostname":"fv-az525-874","load_avg_1min":0.35,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":268.7517671585083},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch50_chunk256-openai_ada002.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[3.547764126000004],"warmups":[[1,3.3797298540000043]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch50_chunk256 openai_ada002","command_max_rss":149700608,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3239 MHz; 1=2971 MHz; 2=2606 MHz; 3=2960 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:05:55.617879","duration":6.999468656000005,"hostname":"fv-az525-874","load_avg_1min":0.37,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":255.6200726032257},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch50_chunk512-nvidia_nvolveqa40k.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[5.517936516999953],"warmups":[[1,5.370841561999953]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch50_chunk512 nvidia_nvolveqa40k","command_max_rss":83763200,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=3273 MHz; 1=3243 MHz; 2=2908 MHz; 3=3210 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:06:26.939454","duration":10.95967594199999,"hostname":"fv-az525-874","load_avg_1min":0.59,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":286.94176840782166},"version":"1.0"}
1 change: 1 addition & 0 deletions reports/benchmarks/2024-01-29_12-07-12/embeddings_batch50_chunk512-openai_ada002.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"benchmarks":[{"runs":[{"values":[3.5479530439999962],"warmups":[[1,3.2966138630000046]]}]}],"metadata":{"aslr":"Full randomization","boot_time":"2024-01-29 12:01:40","command":"/home/runner/.cache/pypoetry/virtualenvs/ragstack-e2e-tests-KLvcJhlJ-py3.11/bin/python /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/testcases.py /home/runner/work/ragstack-ai/ragstack-ai/ragstack-e2e-tests/benchmarks/reports/benchmarks.log embeddings_batch50_chunk512 openai_ada002","command_max_rss":149684224,"cpu_config":"idle:none","cpu_count":4,"cpu_freq":"0=2690 MHz; 1=3236 MHz; 2=2912 MHz; 3=3237 MHz","cpu_model_name":"AMD EPYC 7763 64-Core Processor","date":"2024-01-29 12:06:15.853579","duration":6.916700273000004,"hostname":"fv-az525-874","load_avg_1min":0.4,"loops":1,"name":"command","perf_version":"2.6.2","platform":"Linux-6.2.0-1018-azure-x86_64-with-glibc2.35","runnable_threads":1,"unit":"second","uptime":275.8559684753418},"version":"1.0"}
Loading

0 comments on commit 826fef0

Please sign in to comment.