Task 38577381

Name wu_0833c3a0-GIANNI_GPROTO7-0-1-RND5440_0
Workunit 31542910
Created 24 Sep 2025, 22:48:31 UTC
Sent 24 Sep 2025, 22:48:35 UTC
Report deadline 29 Sep 2025, 22:48:35 UTC
Received 24 Sep 2025, 23:05:05 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 644258
Run time 7 min 6 sec
CPU time 6 min 17 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 62,846.44 GFLOPS
Application version LLM: LLMs for chemistry v1.00 (cuda124L)
x86_64-pc-linux-gnu
Peak working set size 4.85 GB
Peak swap size 57.49 GB
Peak disk usage 8.21 GB

Stderr output

<core_client_version>8.3.0</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
2025-09-24 22:57:30 (6808): wrapper (8.1.26018): starting
2025-09-24 22:57:53 (6808): wrapper: running bin/python (bin/conda-unpack)
2025-09-24 22:57:53 (6808): wrapper: created child process 6861
2025-09-24 22:57:54 (6808): bin/python exited; CPU time 0.273975
2025-09-24 22:57:54 (6808): wrapper: running bin/tar (xjvf input.tar.bz2)
2025-09-24 22:57:54 (6808): wrapper: created child process 6862
2025-09-24 22:57:55 (6808): bin/tar exited; CPU time 0.014484
2025-09-24 22:57:55 (6808): wrapper: running bin/bash (run.sh)
2025-09-24 22:57:55 (6808): wrapper: created child process 6868
+ echo 'Setup environment'
+ source bin/activate
++ _conda_pack_activate
++ local _CONDA_SHELL_FLAVOR
++ '[' -n x ']'
++ _CONDA_SHELL_FLAVOR=bash
++ local script_dir
++ case "$_CONDA_SHELL_FLAVOR" in
+++ dirname bin/activate
++ script_dir=bin
+++ cd bin
+++ pwd
++ local full_path_script_dir=/workspace/BOINC/slots/3/bin
+++ dirname /workspace/BOINC/slots/3/bin
++ local full_path_env=/workspace/BOINC/slots/3
+++ basename /workspace/BOINC/slots/3
++ local env_name=3
++ '[' -n '' ']'
++ export CONDA_PREFIX=/workspace/BOINC/slots/3
++ CONDA_PREFIX=/workspace/BOINC/slots/3
++ export _CONDA_PACK_OLD_PS1=
++ _CONDA_PACK_OLD_PS1=
++ PATH=/workspace/BOINC/slots/3/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:.
++ PS1='(3) '
++ case "$_CONDA_SHELL_FLAVOR" in
++ hash -r
++ local _script_dir=/workspace/BOINC/slots/3/etc/conda/activate.d
++ '[' -d /workspace/BOINC/slots/3/etc/conda/activate.d ']'
+ export PATH=/workspace/BOINC/slots/3:/workspace/BOINC/slots/3/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:.
+ PATH=/workspace/BOINC/slots/3:/workspace/BOINC/slots/3/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:.
+ echo 'Create a temporary directory'
+ export TMP=/workspace/BOINC/slots/3/tmp
+ TMP=/workspace/BOINC/slots/3/tmp
+ mkdir -p /workspace/BOINC/slots/3/tmp
+ which python
+ pip install main_generation-0.1.0-py3-none-any.whl -v --no-deps
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ export CUDA_VISIBLE_DEVICES=0
+ CUDA_VISIBLE_DEVICES=0
+ export HF_HOME=../.cache
+ HF_HOME=../.cache
+ export VLLM_ASSETS_CACHE=../.cache
+ VLLM_ASSETS_CACHE=../.cache
+ export VLLM_CACHE_ROOT=../.cache
+ VLLM_CACHE_ROOT=../.cache
+ echo RUNNING
+ pythonbinary=/workspace/BOINC/slots/3/lib/python3.12/site-packages/aiengine/main_generation.pyc
+ python /workspace/BOINC/slots/3/lib/python3.12/site-packages/aiengine/main_generation.pyc --conf conf.yaml

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 2500 examples [00:00, 826431.27 examples/s]

Loading safetensors checkpoint shards:   0% Completed | 0/2 [00:00<?, ?it/s]

Loading safetensors checkpoint shards:  50% Completed | 1/2 [00:00<00:00,  2.12it/s]

Loading safetensors checkpoint shards: 100% Completed | 2/2 [00:00<00:00,  2.17it/s]

Loading safetensors checkpoint shards: 100% Completed | 2/2 [00:00<00:00,  2.16it/s]


Loading safetensors checkpoint shards:   0% Completed | 0/2 [00:00<?, ?it/s]

Loading safetensors checkpoint shards:  50% Completed | 1/2 [00:00<00:00,  1.89it/s]

Loading safetensors checkpoint shards: 100% Completed | 2/2 [00:01<00:00,  1.86it/s]

Loading safetensors checkpoint shards: 100% Completed | 2/2 [00:01<00:00,  1.86it/s]


Fetching 11 files:   0%|          | 0/11 [00:00<?, ?it/s]
Fetching 11 files:   9%|&#226;&#150;&#137;         | 1/11 [00:00<00:06,  1.46it/s]
Fetching 11 files:  36%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;      | 4/11 [00:12<00:22,  3.27s/it]
Fetching 11 files: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 11/11 [00:12<00:00,  1.12s/it]

Map:   0%|          | 0/2500 [00:00<?, ? examples/s]
Map: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 2500/2500 [00:00<00:00, 57240.74 examples/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Processed prompts:   1%|          | 1/100 [00:13<23:02, 13.97s/it, est. speed input: 9.45 toks/s, output: 6.73 toks/s]
Processed prompts:   2%|&#226;&#150;&#143;         | 2/100 [00:14<09:45,  5.97s/it, est. speed input: 18.54 toks/s, output: 13.32 toks/s]
Processed prompts:   3%|&#226;&#150;&#142;         | 3/100 [00:15<05:48,  3.60s/it, est. speed input: 26.87 toks/s, output: 19.45 toks/s]
Processed prompts:   6%|&#226;&#150;&#140;         | 6/100 [00:15<01:56,  1.24s/it, est. speed input: 54.74 toks/s, output: 39.64 toks/s]
Processed prompts:   8%|&#226;&#150;&#138;         | 8/100 [00:16<01:23,  1.10it/s, est. speed input: 69.47 toks/s, output: 51.29 toks/s]
Processed prompts:   9%|&#226;&#150;&#137;         | 9/100 [00:16<01:07,  1.35it/s, est. speed input: 78.35 toks/s, output: 57.77 toks/s]
Processed prompts:  10%|&#226;&#150;&#136;         | 10/100 [00:16<01:04,  1.40it/s, est. speed input: 84.40 toks/s, output: 62.51 toks/s]
Processed prompts:  11%|&#226;&#150;&#136;         | 11/100 [00:16<00:50,  1.76it/s, est. speed input: 92.58 toks/s, output: 68.96 toks/s]
Processed prompts:  13%|&#226;&#150;&#136;&#226;&#150;&#142;        | 13/100 [00:17<00:31,  2.80it/s, est. speed input: 109.33 toks/s, output: 82.25 toks/s]
Processed prompts:  14%|&#226;&#150;&#136;&#226;&#150;&#141;        | 14/100 [00:17<00:36,  2.38it/s, est. speed input: 113.87 toks/s, output: 86.28 toks/s]
Processed prompts:  16%|&#226;&#150;&#136;&#226;&#150;&#140;        | 16/100 [00:17<00:25,  3.30it/s, est. speed input: 128.52 toks/s, output: 98.91 toks/s]
Processed prompts:  17%|&#226;&#150;&#136;&#226;&#150;&#139;        | 17/100 [00:18<00:26,  3.13it/s, est. speed input: 133.81 toks/s, output: 103.89 toks/s]
Processed prompts:  18%|&#226;&#150;&#136;&#226;&#150;&#138;        | 18/100 [00:18<00:22,  3.67it/s, est. speed input: 141.16 toks/s, output: 110.19 toks/s]
Processed prompts:  21%|&#226;&#150;&#136;&#226;&#150;&#136;        | 21/100 [00:18<00:12,  6.44it/s, est. speed input: 164.40 toks/s, output: 130.39 toks/s]
Processed prompts:  26%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;       | 26/100 [00:18<00:06, 11.91it/s, est. speed input: 202.33 toks/s, output: 164.42 toks/s]
Processed prompts:  29%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;       | 29/100 [00:18<00:05, 11.96it/s, est. speed input: 223.00 toks/s, output: 183.27 toks/s]
Processed prompts:  31%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;       | 31/100 [00:19<00:05, 12.69it/s, est. speed input: 236.98 toks/s, output: 196.14 toks/s]
Processed prompts:  34%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;      | 34/100 [00:19<00:04, 15.10it/s, est. speed input: 258.95 toks/s, output: 215.92 toks/s]
Processed prompts:  36%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;      | 36/100 [00:19<00:05, 12.55it/s, est. speed input: 271.77 toks/s, output: 227.28 toks/s]
Processed prompts:  43%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;     | 43/100 [00:19<00:02, 22.43it/s, est. speed input: 323.29 toks/s, output: 275.24 toks/s]
Processed prompts:  48%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;     | 48/100 [00:19<00:01, 27.79it/s, est. speed input: 359.34 toks/s, output: 309.04 toks/s]
Processed prompts:  54%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;    | 54/100 [00:19<00:01, 34.91it/s, est. speed input: 402.07 toks/s, output: 349.85 toks/s]
Processed prompts:  59%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;    | 59/100 [00:19<00:01, 30.98it/s, est. speed input: 435.47 toks/s, output: 381.67 toks/s]
Processed prompts:  63%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;   | 63/100 [00:20<00:01, 32.85it/s, est. speed input: 463.26 toks/s, output: 408.28 toks/s]
Processed prompts:  67%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;   | 67/100 [00:20<00:01, 28.08it/s, est. speed input: 489.21 toks/s, output: 432.79 toks/s]
Processed prompts:  77%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;  | 77/100 [00:20<00:00, 36.46it/s, est. speed input: 560.50 toks/s, output: 500.00 toks/s]
Processed prompts:  81%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;  | 81/100 [00:20<00:00, 23.72it/s, est. speed input: 579.24 toks/s, output: 519.74 toks/s]
Processed prompts:  87%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139; | 87/100 [00:21<00:00, 20.71it/s, est. speed input: 614.38 toks/s, output: 553.93 toks/s]
Processed prompts:  90%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136; | 90/100 [00:21<00:00, 14.90it/s, est. speed input: 623.76 toks/s, output: 564.38 toks/s]
Processed prompts:  93%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;| 93/100 [00:22<00:00, 10.38it/s, est. speed input: 627.18 toks/s, output: 570.68 toks/s]
Processed prompts:  95%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;| 95/100 [00:22<00:00, 10.54it/s, est. speed input: 635.69 toks/s, output: 581.32 toks/s]
Processed prompts:  97%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;| 97/100 [00:23<00:00,  6.24it/s, est. speed input: 624.92 toks/s, output: 574.69 toks/s]
Processed prompts:  99%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;| 99/100 [00:23<00:00,  6.93it/s, est. speed input: 633.45 toks/s, output: 585.90 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:23<00:00,  4.26it/s, est. speed input: 638.90 toks/s, output: 592.98 toks/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Processed prompts:   1%|          | 1/100 [00:16<26:30, 16.07s/it, est. speed input: 8.53 toks/s, output: 6.47 toks/s]
Processed prompts:   2%|&#226;&#150;&#143;         | 2/100 [00:16<11:13,  6.87s/it, est. speed input: 16.85 toks/s, output: 12.79 toks/s]
Processed prompts:   3%|&#226;&#150;&#142;         | 3/100 [00:16<06:08,  3.80s/it, est. speed input: 25.04 toks/s, output: 19.15 toks/s]
Processed prompts:   4%|&#226;&#150;&#141;         | 4/100 [00:17<04:02,  2.53s/it, est. speed input: 32.98 toks/s, output: 25.02 toks/s]
Processed prompts:   5%|&#226;&#150;&#140;         | 5/100 [00:17<02:42,  1.71s/it, est. speed input: 41.27 toks/s, output: 31.15 toks/s]
Processed prompts:   6%|&#226;&#150;&#140;         | 6/100 [00:17<01:51,  1.18s/it, est. speed input: 49.71 toks/s, output: 37.41 toks/s]
Processed prompts:   7%|&#226;&#150;&#139;         | 7/100 [00:17<01:22,  1.13it/s, est. speed input: 56.89 toks/s, output: 43.38 toks/s]
Processed prompts:   8%|&#226;&#150;&#138;         | 8/100 [00:18<00:59,  1.55it/s, est. speed input: 64.48 toks/s, output: 49.58 toks/s]
Processed prompts:   9%|&#226;&#150;&#137;         | 9/100 [00:18<00:55,  1.63it/s, est. speed input: 70.64 toks/s, output: 54.72 toks/s]
Processed prompts:  10%|&#226;&#150;&#136;         | 10/100 [00:18<00:45,  1.97it/s, est. speed input: 77.08 toks/s, output: 60.49 toks/s]
Processed prompts:  12%|&#226;&#150;&#136;&#226;&#150;&#143;        | 12/100 [00:19<00:29,  3.01it/s, est. speed input: 91.55 toks/s, output: 72.73 toks/s]
Processed prompts:  13%|&#226;&#150;&#136;&#226;&#150;&#142;        | 13/100 [00:19<00:24,  3.52it/s, est. speed input: 98.87 toks/s, output: 78.79 toks/s]
Processed prompts:  14%|&#226;&#150;&#136;&#226;&#150;&#141;        | 14/100 [00:19<00:20,  4.10it/s, est. speed input: 105.82 toks/s, output: 84.84 toks/s]
Processed prompts:  17%|&#226;&#150;&#136;&#226;&#150;&#139;        | 17/100 [00:19<00:15,  5.38it/s, est. speed input: 126.24 toks/s, output: 102.65 toks/s]
Processed prompts:  18%|&#226;&#150;&#136;&#226;&#150;&#138;        | 18/100 [00:19<00:14,  5.71it/s, est. speed input: 132.62 toks/s, output: 108.65 toks/s]
Processed prompts:  19%|&#226;&#150;&#136;&#226;&#150;&#137;        | 19/100 [00:20<00:13,  5.94it/s, est. speed input: 139.14 toks/s, output: 114.49 toks/s]
Processed prompts:  20%|&#226;&#150;&#136;&#226;&#150;&#136;        | 20/100 [00:20<00:12,  6.24it/s, est. speed input: 145.48 toks/s, output: 120.35 toks/s]
Processed prompts:  22%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;       | 22/100 [00:20<00:09,  8.28it/s, est. speed input: 159.56 toks/s, output: 132.82 toks/s]
Processed prompts:  27%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;       | 27/100 [00:20<00:04, 15.25it/s, est. speed input: 194.60 toks/s, output: 164.92 toks/s]
Processed prompts:  29%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;       | 29/100 [00:20<00:04, 15.26it/s, est. speed input: 208.41 toks/s, output: 177.16 toks/s]
Processed prompts:  31%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;       | 31/100 [00:20<00:04, 15.43it/s, est. speed input: 221.61 toks/s, output: 189.35 toks/s]
Processed prompts:  37%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;      | 37/100 [00:20<00:03, 19.62it/s, est. speed input: 262.06 toks/s, output: 226.82 toks/s]
Processed prompts:  39%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;      | 39/100 [00:21<00:04, 13.39it/s, est. speed input: 272.71 toks/s, output: 236.57 toks/s]
Processed prompts:  44%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;     | 44/100 [00:21<00:02, 18.88it/s, est. speed input: 306.59 toks/s, output: 268.73 toks/s]
Processed prompts:  47%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;     | 47/100 [00:21<00:02, 20.24it/s, est. speed input: 326.53 toks/s, output: 287.40 toks/s]
Processed prompts:  52%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;    | 52/100 [00:21<00:01, 25.81it/s, est. speed input: 360.17 toks/s, output: 319.48 toks/s]
Processed prompts:  56%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;    | 56/100 [00:21<00:01, 28.83it/s, est. speed input: 386.21 toks/s, output: 344.88 toks/s]
Processed prompts:  60%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;    | 60/100 [00:21<00:01, 24.43it/s, est. speed input: 410.86 toks/s, output: 368.35 toks/s]
Processed prompts:  63%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;   | 63/100 [00:22<00:01, 25.36it/s, est. speed input: 430.11 toks/s, output: 386.95 toks/s]
Processed prompts:  66%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;   | 66/100 [00:22<00:01, 20.79it/s, est. speed input: 447.29 toks/s, output: 403.52 toks/s]
Processed prompts:  69%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;   | 69/100 [00:22<00:02, 13.80it/s, est. speed input: 459.43 toks/s, output: 416.50 toks/s]
Processed prompts:  71%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;   | 71/100 [00:22<00:01, 14.65it/s, est. speed input: 470.27 toks/s, output: 428.37 toks/s]
Processed prompts:  73%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;  | 73/100 [00:23<00:02, 11.44it/s, est. speed input: 477.34 toks/s, output: 436.55 toks/s]
Processed prompts:  75%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;  | 75/100 [00:23<00:02, 10.99it/s, est. speed input: 486.02 toks/s, output: 446.57 toks/s]
Processed prompts:  80%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;  | 80/100 [00:23<00:01, 14.86it/s, est. speed input: 514.90 toks/s, output: 477.36 toks/s]
Processed prompts:  82%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143; | 82/100 [00:23<00:01, 15.65it/s, est. speed input: 525.41 toks/s, output: 489.22 toks/s]
Processed prompts:  84%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141; | 84/100 [00:23<00:01, 14.01it/s, est. speed input: 533.88 toks/s, output: 499.25 toks/s]
Processed prompts:  86%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140; | 86/100 [00:24<00:01, 12.70it/s, est. speed input: 542.50 toks/s, output: 509.08 toks/s]
Processed prompts:  88%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138; | 88/100 [00:24<00:01,  9.18it/s, est. speed input: 546.57 toks/s, output: 515.07 toks/s]
Processed prompts:  90%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136; | 90/100 [00:24<00:01,  9.56it/s, est. speed input: 554.27 toks/s, output: 525.36 toks/s]
Processed prompts:  92%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;| 92/100 [00:24<00:00,  9.81it/s, est. speed input: 562.01 toks/s, output: 535.58 toks/s]
Processed prompts:  94%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;| 94/100 [00:24<00:00, 10.06it/s, est. speed input: 570.18 toks/s, output: 545.87 toks/s]
Processed prompts:  97%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;| 97/100 [00:25<00:00, 11.74it/s, est. speed input: 584.58 toks/s, output: 563.35 toks/s]
Processed prompts:  99%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;| 99/100 [00:25<00:00,  6.81it/s, est. speed input: 582.17 toks/s, output: 563.87 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:25<00:00,  3.87it/s, est. speed input: 587.48 toks/s, output: 570.56 toks/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Processed prompts:   1%|          | 1/100 [00:15<25:23, 15.39s/it, est. speed input: 9.23 toks/s, output: 6.37 toks/s]
Processed prompts:   2%|&#226;&#150;&#143;         | 2/100 [00:16<11:00,  6.74s/it, est. speed input: 17.73 toks/s, output: 12.51 toks/s]
Processed prompts:   3%|&#226;&#150;&#142;         | 3/100 [00:16<06:00,  3.72s/it, est. speed input: 26.17 toks/s, output: 18.82 toks/s]
Processed prompts:   4%|&#226;&#150;&#141;         | 4/100 [00:16<03:57,  2.47s/it, est. speed input: 34.08 toks/s, output: 24.65 toks/s]
Processed prompts:   5%|&#226;&#150;&#140;         | 5/100 [00:17<02:48,  1.77s/it, est. speed input: 41.63 toks/s, output: 30.36 toks/s]
Processed prompts:   6%|&#226;&#150;&#140;         | 6/100 [00:17<02:07,  1.35s/it, est. speed input: 48.80 toks/s, output: 35.95 toks/s]
Processed prompts:   7%|&#226;&#150;&#139;         | 7/100 [00:17<01:28,  1.05it/s, est. speed input: 56.98 toks/s, output: 42.18 toks/s]
Processed prompts:   8%|&#226;&#150;&#138;         | 8/100 [00:18<01:04,  1.44it/s, est. speed input: 65.22 toks/s, output: 48.38 toks/s]
Processed prompts:  11%|&#226;&#150;&#136;         | 11/100 [00:18<00:30,  2.89it/s, est. speed input: 89.30 toks/s, output: 67.05 toks/s]
Processed prompts:  13%|&#226;&#150;&#136;&#226;&#150;&#142;        | 13/100 [00:18<00:21,  4.05it/s, est. speed input: 104.86 toks/s, output: 79.57 toks/s]
Processed prompts:  15%|&#226;&#150;&#136;&#226;&#150;&#140;        | 15/100 [00:18<00:15,  5.39it/s, est. speed input: 119.91 toks/s, output: 92.07 toks/s]
Processed prompts:  17%|&#226;&#150;&#136;&#226;&#150;&#139;        | 17/100 [00:19<00:15,  5.25it/s, est. speed input: 132.87 toks/s, output: 103.25 toks/s]
Processed prompts:  19%|&#226;&#150;&#136;&#226;&#150;&#137;        | 19/100 [00:19<00:13,  5.88it/s, est. speed input: 145.86 toks/s, output: 114.97 toks/s]
Processed prompts:  20%|&#226;&#150;&#136;&#226;&#150;&#136;        | 20/100 [00:19<00:15,  5.32it/s, est. speed input: 151.53 toks/s, output: 119.99 toks/s]
Processed prompts:  21%|&#226;&#150;&#136;&#226;&#150;&#136;        | 21/100 [00:19<00:13,  5.71it/s, est. speed input: 158.28 toks/s, output: 125.82 toks/s]
Processed prompts:  24%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;       | 24/100 [00:19<00:10,  7.44it/s, est. speed input: 178.67 toks/s, output: 143.79 toks/s]
Processed prompts:  26%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;       | 26/100 [00:20<00:08,  8.92it/s, est. speed input: 191.80 toks/s, output: 156.09 toks/s]
Processed prompts:  28%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;       | 28/100 [00:20<00:07, 10.17it/s, est. speed input: 205.07 toks/s, output: 168.26 toks/s]
Processed prompts:  32%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;      | 32/100 [00:20<00:04, 14.72it/s, est. speed input: 233.62 toks/s, output: 193.56 toks/s]
Processed prompts:  36%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;      | 36/100 [00:20<00:03, 18.82it/s, est. speed input: 261.47 toks/s, output: 218.82 toks/s]
Processed prompts:  39%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;      | 39/100 [00:20<00:03, 17.06it/s, est. speed input: 280.32 toks/s, output: 236.47 toks/s]
Processed prompts:  41%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;      | 41/100 [00:20<00:03, 17.48it/s, est. speed input: 293.53 toks/s, output: 248.65 toks/s]
Processed prompts:  44%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;     | 44/100 [00:20<00:02, 20.06it/s, est. speed input: 313.58 toks/s, output: 267.43 toks/s]
Processed prompts:  48%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;     | 48/100 [00:20<00:02, 24.43it/s, est. speed input: 340.48 toks/s, output: 292.80 toks/s]
Processed prompts:  55%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;    | 55/100 [00:21<00:01, 35.38it/s, est. speed input: 388.88 toks/s, output: 338.17 toks/s]
Processed prompts:  59%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;    | 59/100 [00:21<00:01, 28.30it/s, est. speed input: 413.44 toks/s, output: 361.64 toks/s]
Processed prompts:  63%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;   | 63/100 [00:21<00:01, 30.73it/s, est. speed input: 439.75 toks/s, output: 386.90 toks/s]
Processed prompts:  67%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;   | 67/100 [00:21<00:01, 26.42it/s, est. speed input: 463.89 toks/s, output: 410.28 toks/s]
Processed prompts:  71%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;   | 71/100 [00:21<00:00, 29.28it/s, est. speed input: 489.99 toks/s, output: 435.62 toks/s]
Processed prompts:  75%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;  | 75/100 [00:22<00:01, 18.84it/s, est. speed input: 509.43 toks/s, output: 454.98 toks/s]
Processed prompts:  80%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;  | 80/100 [00:22<00:01, 16.22it/s, est. speed input: 534.75 toks/s, output: 481.15 toks/s]
Processed prompts:  85%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140; | 85/100 [00:22<00:00, 18.51it/s, est. speed input: 564.39 toks/s, output: 511.65 toks/s]
Processed prompts:  88%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138; | 88/100 [00:23<00:00, 13.11it/s, est. speed input: 572.07 toks/s, output: 522.33 toks/s]
Processed prompts:  90%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136; | 90/100 [00:23<00:00, 12.65it/s, est. speed input: 581.61 toks/s, output: 532.26 toks/s]
Processed prompts:  92%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;| 92/100 [00:23<00:00, 12.31it/s, est. speed input: 589.74 toks/s, output: 542.34 toks/s]
Processed prompts:  94%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;| 94/100 [00:23<00:00, 10.70it/s, est. speed input: 595.46 toks/s, output: 550.28 toks/s]
Processed prompts:  96%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;| 96/100 [00:24<00:00,  7.99it/s, est. speed input: 596.30 toks/s, output: 554.32 toks/s]
Processed prompts:  97%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;| 97/100 [00:24<00:00,  7.55it/s, est. speed input: 597.86 toks/s, output: 557.61 toks/s]
Processed prompts:  98%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;| 98/100 [00:24<00:00,  7.10it/s, est. speed input: 599.90 toks/s, output: 560.76 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:25<00:00,  6.25it/s, est. speed input: 603.39 toks/s, output: 566.72 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:25<00:00,  4.00it/s, est. speed input: 603.39 toks/s, output: 566.72 toks/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Processed prompts:   1%|          | 1/100 [00:16<26:41, 16.18s/it, est. speed input: 8.96 toks/s, output: 6.49 toks/s]
Processed prompts:   2%|&#226;&#150;&#143;         | 2/100 [00:16<11:01,  6.75s/it, est. speed input: 17.77 toks/s, output: 12.93 toks/s]
Processed prompts:   3%|&#226;&#150;&#142;         | 3/100 [00:16<06:07,  3.79s/it, est. speed input: 25.74 toks/s, output: 19.23 toks/s]
Processed prompts:   4%|&#226;&#150;&#141;         | 4/100 [00:16<03:45,  2.35s/it, est. speed input: 33.78 toks/s, output: 25.59 toks/s]
Processed prompts:   6%|&#226;&#150;&#140;         | 6/100 [00:16<01:46,  1.14s/it, est. speed input: 51.08 toks/s, output: 38.38 toks/s]
Processed prompts:   7%|&#226;&#150;&#139;         | 7/100 [00:17<01:40,  1.08s/it, est. speed input: 56.39 toks/s, output: 42.95 toks/s]
Processed prompts:   8%|&#226;&#150;&#138;         | 8/100 [00:18<01:21,  1.13it/s, est. speed input: 63.35 toks/s, output: 48.61 toks/s]
Processed prompts:   9%|&#226;&#150;&#137;         | 9/100 [00:18<01:01,  1.49it/s, est. speed input: 70.53 toks/s, output: 54.86 toks/s]
Processed prompts:  10%|&#226;&#150;&#136;         | 10/100 [00:18<00:46,  1.95it/s, est. speed input: 77.89 toks/s, output: 61.09 toks/s]
Processed prompts:  11%|&#226;&#150;&#136;         | 11/100 [00:18<00:39,  2.27it/s, est. speed input: 84.33 toks/s, output: 66.86 toks/s]
Processed prompts:  12%|&#226;&#150;&#136;&#226;&#150;&#143;        | 12/100 [00:18<00:30,  2.86it/s, est. speed input: 91.54 toks/s, output: 73.02 toks/s]
Processed prompts:  14%|&#226;&#150;&#136;&#226;&#150;&#141;        | 14/100 [00:19<00:23,  3.59it/s, est. speed input: 105.60 toks/s, output: 84.70 toks/s]
Processed prompts:  15%|&#226;&#150;&#136;&#226;&#150;&#140;        | 15/100 [00:19<00:23,  3.65it/s, est. speed input: 111.59 toks/s, output: 90.24 toks/s]
Processed prompts:  16%|&#226;&#150;&#136;&#226;&#150;&#140;        | 16/100 [00:19<00:19,  4.23it/s, est. speed input: 118.64 toks/s, output: 96.32 toks/s]
Processed prompts:  19%|&#226;&#150;&#136;&#226;&#150;&#137;        | 19/100 [00:19<00:10,  7.43it/s, est. speed input: 139.58 toks/s, output: 115.63 toks/s]
Processed prompts:  21%|&#226;&#150;&#136;&#226;&#150;&#136;        | 21/100 [00:19<00:08,  9.00it/s, est. speed input: 153.37 toks/s, output: 128.22 toks/s]
Processed prompts:  25%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;       | 25/100 [00:20<00:05, 13.81it/s, est. speed input: 181.97 toks/s, output: 154.04 toks/s]
Processed prompts:  27%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;       | 27/100 [00:20<00:05, 14.24it/s, est. speed input: 195.72 toks/s, output: 166.42 toks/s]
Processed prompts:  30%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;       | 30/100 [00:20<00:04, 16.57it/s, est. speed input: 217.23 toks/s, output: 185.40 toks/s]
Processed prompts:  33%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;      | 33/100 [00:20<00:03, 18.37it/s, est. speed input: 237.88 toks/s, output: 204.29 toks/s]
Processed prompts:  36%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;      | 36/100 [00:20<00:03, 19.75it/s, est. speed input: 258.42 toks/s, output: 223.14 toks/s]
Processed prompts:  39%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;      | 39/100 [00:20<00:02, 21.54it/s, est. speed input: 278.83 toks/s, output: 242.09 toks/s]
Processed prompts:  42%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;     | 42/100 [00:20<00:02, 23.19it/s, est. speed input: 299.47 toks/s, output: 261.04 toks/s]
Processed prompts:  47%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;     | 47/100 [00:20<00:01, 29.64it/s, est. speed input: 333.83 toks/s, output: 293.39 toks/s]
Processed prompts:  51%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;     | 51/100 [00:20<00:01, 31.86it/s, est. speed input: 360.97 toks/s, output: 318.97 toks/s]
Processed prompts:  55%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;    | 55/100 [00:21<00:01, 33.65it/s, est. speed input: 387.58 toks/s, output: 344.45 toks/s]
Processed prompts:  59%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;    | 59/100 [00:21<00:01, 35.09it/s, est. speed input: 415.13 toks/s, output: 369.85 toks/s]
Processed prompts:  63%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;   | 63/100 [00:21<00:01, 36.19it/s, est. speed input: 442.56 toks/s, output: 395.30 toks/s]
Processed prompts:  67%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;   | 67/100 [00:21<00:01, 23.33it/s, est. speed input: 464.30 toks/s, output: 416.88 toks/s]
Processed prompts:  70%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;   | 70/100 [00:21<00:01, 24.52it/s, est. speed input: 484.10 toks/s, output: 435.51 toks/s]
Processed prompts:  73%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;  | 73/100 [00:21<00:01, 21.09it/s, est. speed input: 501.33 toks/s, output: 452.18 toks/s]
Processed prompts:  76%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;  | 76/100 [00:22<00:01, 12.60it/s, est. speed input: 510.52 toks/s, output: 462.73 toks/s]
Processed prompts:  80%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;  | 80/100 [00:22<00:01, 14.45it/s, est. speed input: 533.51 toks/s, output: 486.54 toks/s]
Processed prompts:  84%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141; | 84/100 [00:22<00:01, 16.00it/s, est. speed input: 555.34 toks/s, output: 510.31 toks/s]
Processed prompts:  87%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139; | 87/100 [00:23<00:01, 10.60it/s, est. speed input: 560.73 toks/s, output: 519.09 toks/s]
Processed prompts:  89%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137; | 89/100 [00:23<00:01,  9.71it/s, est. speed input: 566.93 toks/s, output: 527.26 toks/s]
Processed prompts:  92%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;| 92/100 [00:23<00:00, 11.06it/s, est. speed input: 581.59 toks/s, output: 544.71 toks/s]
Processed prompts:  94%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;| 94/100 [00:23<00:00, 11.05it/s, est. speed input: 589.75 toks/s, output: 554.98 toks/s]
Processed prompts:  96%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;| 96/100 [00:24<00:00,  8.16it/s, est. speed input: 591.90 toks/s, output: 559.29 toks/s]
Processed prompts:  98%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;| 98/100 [00:24<00:00,  8.80it/s, est. speed input: 600.02 toks/s, output: 569.88 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:24<00:00, 10.22it/s, est. speed input: 609.81 toks/s, output: 582.10 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:24<00:00,  4.05it/s, est. speed input: 609.81 toks/s, output: 582.10 toks/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Processed prompts:   1%|          | 1/100 [00:15<25:19, 15.35s/it, est. speed input: 8.93 toks/s, output: 6.52 toks/s]
Processed prompts:   2%|&#226;&#150;&#143;         | 2/100 [00:16<11:21,  6.95s/it, est. speed input: 17.05 toks/s, output: 12.66 toks/s]
Processed prompts:   4%|&#226;&#150;&#141;         | 4/100 [00:16<04:17,  2.68s/it, est. speed input: 34.00 toks/s, output: 25.50 toks/s]
Processed prompts:   7%|&#226;&#150;&#139;         | 7/100 [00:16<01:48,  1.17s/it, est. speed input: 59.94 toks/s, output: 44.97 toks/s]
Processed prompts:   9%|&#226;&#150;&#137;         | 9/100 [00:17<01:12,  1.25it/s, est. speed input: 76.06 toks/s, output: 57.45 toks/s]
Processed prompts:  11%|&#226;&#150;&#136;         | 11/100 [00:17<00:49,  1.80it/s, est. speed input: 91.90 toks/s, output: 70.19 toks/s]
Processed prompts:  13%|&#226;&#150;&#136;&#226;&#150;&#142;        | 13/100 [00:17<00:38,  2.27it/s, est. speed input: 106.13 toks/s, output: 81.74 toks/s]
Processed prompts:  14%|&#226;&#150;&#136;&#226;&#150;&#141;        | 14/100 [00:17<00:32,  2.62it/s, est. speed input: 113.46 toks/s, output: 87.79 toks/s]
Processed prompts:  15%|&#226;&#150;&#136;&#226;&#150;&#140;        | 15/100 [00:18<00:39,  2.15it/s, est. speed input: 116.87 toks/s, output: 90.81 toks/s]
Processed prompts:  17%|&#226;&#150;&#136;&#226;&#150;&#139;        | 17/100 [00:18<00:26,  3.17it/s, est. speed input: 131.57 toks/s, output: 103.50 toks/s]
Processed prompts:  20%|&#226;&#150;&#136;&#226;&#150;&#136;        | 20/100 [00:18<00:15,  5.17it/s, est. speed input: 155.19 toks/s, output: 122.79 toks/s]
Processed prompts:  22%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;       | 22/100 [00:19<00:16,  4.72it/s, est. speed input: 166.12 toks/s, output: 132.97 toks/s]
Processed prompts:  24%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;       | 24/100 [00:19<00:12,  5.96it/s, est. speed input: 180.15 toks/s, output: 145.52 toks/s]
Processed prompts:  26%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;       | 26/100 [00:19<00:10,  7.28it/s, est. speed input: 193.80 toks/s, output: 158.03 toks/s]
Processed prompts:  28%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;       | 28/100 [00:19<00:08,  8.65it/s, est. speed input: 207.81 toks/s, output: 170.49 toks/s]
Processed prompts:  31%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;       | 31/100 [00:19<00:07,  9.68it/s, est. speed input: 226.93 toks/s, output: 188.44 toks/s]
Processed prompts:  33%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;      | 33/100 [00:20<00:06, 10.83it/s, est. speed input: 240.56 toks/s, output: 200.76 toks/s]
Processed prompts:  36%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;      | 36/100 [00:20<00:04, 13.56it/s, est. speed input: 261.60 toks/s, output: 219.76 toks/s]
Processed prompts:  40%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;      | 40/100 [00:20<00:03, 18.28it/s, est. speed input: 289.62 toks/s, output: 245.60 toks/s]
Processed prompts:  43%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;     | 43/100 [00:20<00:02, 20.51it/s, est. speed input: 310.75 toks/s, output: 264.76 toks/s]
Processed prompts:  46%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;     | 46/100 [00:20<00:02, 22.35it/s, est. speed input: 331.21 toks/s, output: 283.85 toks/s]
Processed prompts:  49%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;     | 49/100 [00:20<00:02, 23.78it/s, est. speed input: 351.10 toks/s, output: 302.87 toks/s]
Processed prompts:  52%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;    | 52/100 [00:20<00:01, 24.97it/s, est. speed input: 370.86 toks/s, output: 321.76 toks/s]
Processed prompts:  57%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;    | 57/100 [00:20<00:01, 31.28it/s, est. speed input: 406.16 toks/s, output: 354.28 toks/s]
Processed prompts:  61%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;    | 61/100 [00:20<00:01, 33.51it/s, est. speed input: 434.22 toks/s, output: 379.93 toks/s]
Processed prompts:  67%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;   | 67/100 [00:21<00:00, 40.89it/s, est. speed input: 474.93 toks/s, output: 419.23 toks/s]
Processed prompts:  72%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;  | 72/100 [00:21<00:01, 23.33it/s, est. speed input: 502.00 toks/s, output: 445.76 toks/s]
Processed prompts:  76%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;  | 76/100 [00:21<00:00, 26.29it/s, est. speed input: 528.57 toks/s, output: 471.44 toks/s]
Processed prompts:  80%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;  | 80/100 [00:21<00:01, 18.20it/s, est. speed input: 546.44 toks/s, output: 490.69 toks/s]
Processed prompts:  83%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142; | 83/100 [00:22<00:00, 17.48it/s, est. speed input: 562.24 toks/s, output: 507.48 toks/s]
Processed prompts:  86%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140; | 86/100 [00:22<00:00, 16.98it/s, est. speed input: 576.94 toks/s, output: 524.31 toks/s]
Processed prompts:  89%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137; | 89/100 [00:22<00:00, 11.93it/s, est. speed input: 585.42 toks/s, output: 534.86 toks/s]
Processed prompts:  91%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136; | 91/100 [00:23<00:01,  8.85it/s, est. speed input: 586.82 toks/s, output: 538.60 toks/s]
Processed prompts:  94%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;| 94/100 [00:23<00:00,  8.69it/s, est. speed input: 597.19 toks/s, output: 551.99 toks/s]
Processed prompts:  96%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;| 96/100 [00:24<00:00,  5.91it/s, est. speed input: 591.55 toks/s, output: 550.44 toks/s]
Processed prompts:  99%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;| 99/100 [00:24<00:00,  5.55it/s, est. speed input: 595.20 toks/s, output: 558.95 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:25<00:00,  5.43it/s, est. speed input: 596.26 toks/s, output: 562.06 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:25<00:00,  3.98it/s, est. speed input: 596.26 toks/s, output: 562.06 toks/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
Processed prompts:   1%|          | 1/100 [00:15<24:50, 15.06s/it, est. speed input: 8.83 toks/s, output: 6.51 toks/s]
Processed prompts:   2%|&#226;&#150;&#143;         | 2/100 [00:15<10:23,  6.36s/it, est. speed input: 17.68 toks/s, output: 12.92 toks/s]
Processed prompts:   3%|&#226;&#150;&#142;         | 3/100 [00:15<05:40,  3.51s/it, est. speed input: 26.85 toks/s, output: 19.34 toks/s]
Processed prompts:   4%|&#226;&#150;&#141;         | 4/100 [00:16<03:49,  2.39s/it, est. speed input: 34.99 toks/s, output: 25.12 toks/s]
Processed prompts:   5%|&#226;&#150;&#140;         | 5/100 [00:16<02:29,  1.58s/it, est. speed input: 43.38 toks/s, output: 31.50 toks/s]
Processed prompts:   6%|&#226;&#150;&#140;         | 6/100 [00:16<01:46,  1.13s/it, est. speed input: 51.65 toks/s, output: 37.60 toks/s]
Processed prompts:   8%|&#226;&#150;&#138;         | 8/100 [00:16<01:01,  1.49it/s, est. speed input: 67.49 toks/s, output: 49.80 toks/s]
Processed prompts:   9%|&#226;&#150;&#137;         | 9/100 [00:17<00:48,  1.89it/s, est. speed input: 75.17 toks/s, output: 56.04 toks/s]
Processed prompts:  11%|&#226;&#150;&#136;         | 11/100 [00:17<00:32,  2.77it/s, est. speed input: 91.23 toks/s, output: 68.35 toks/s]
Processed prompts:  14%|&#226;&#150;&#136;&#226;&#150;&#141;        | 14/100 [00:18<00:32,  2.67it/s, est. speed input: 109.97 toks/s, output: 83.18 toks/s]
Processed prompts:  16%|&#226;&#150;&#136;&#226;&#150;&#140;        | 16/100 [00:18<00:23,  3.60it/s, est. speed input: 124.47 toks/s, output: 95.99 toks/s]
Processed prompts:  17%|&#226;&#150;&#136;&#226;&#150;&#139;        | 17/100 [00:18<00:20,  3.99it/s, est. speed input: 131.25 toks/s, output: 102.05 toks/s]
Processed prompts:  19%|&#226;&#150;&#136;&#226;&#150;&#137;        | 19/100 [00:19<00:18,  4.31it/s, est. speed input: 144.07 toks/s, output: 113.28 toks/s]
Processed prompts:  20%|&#226;&#150;&#136;&#226;&#150;&#136;        | 20/100 [00:19<00:16,  4.71it/s, est. speed input: 150.57 toks/s, output: 119.26 toks/s]
Processed prompts:  22%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;       | 22/100 [00:19<00:14,  5.49it/s, est. speed input: 164.01 toks/s, output: 131.11 toks/s]
Processed prompts:  23%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;       | 23/100 [00:19<00:13,  5.85it/s, est. speed input: 170.63 toks/s, output: 137.04 toks/s]
Processed prompts:  26%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;       | 26/100 [00:19<00:08,  9.02it/s, est. speed input: 191.84 toks/s, output: 156.39 toks/s]
Processed prompts:  28%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;       | 28/100 [00:19<00:06, 10.38it/s, est. speed input: 205.74 toks/s, output: 168.90 toks/s]
Processed prompts:  31%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;       | 31/100 [00:20<00:06, 10.82it/s, est. speed input: 225.56 toks/s, output: 186.92 toks/s]
Processed prompts:  33%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;      | 33/100 [00:20<00:05, 11.78it/s, est. speed input: 239.15 toks/s, output: 199.28 toks/s]
Processed prompts:  37%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;      | 37/100 [00:20<00:03, 16.67it/s, est. speed input: 267.29 toks/s, output: 225.28 toks/s]
Processed prompts:  42%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;     | 42/100 [00:20<00:02, 23.31it/s, est. speed input: 302.82 toks/s, output: 258.06 toks/s]
Processed prompts:  45%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;     | 45/100 [00:20<00:02, 24.57it/s, est. speed input: 323.12 toks/s, output: 277.22 toks/s]
Processed prompts:  49%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;     | 49/100 [00:20<00:01, 27.93it/s, est. speed input: 351.01 toks/s, output: 303.08 toks/s]
Processed prompts:  53%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#142;    | 53/100 [00:20<00:01, 30.55it/s, est. speed input: 378.57 toks/s, output: 328.91 toks/s]
Processed prompts:  57%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;    | 57/100 [00:20<00:01, 32.61it/s, est. speed input: 406.15 toks/s, output: 354.69 toks/s]
Processed prompts:  61%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;    | 61/100 [00:21<00:01, 26.57it/s, est. speed input: 431.41 toks/s, output: 378.72 toks/s]
Processed prompts:  64%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;   | 64/100 [00:21<00:01, 18.44it/s, est. speed input: 446.56 toks/s, output: 393.88 toks/s]
Processed prompts:  67%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;   | 67/100 [00:21<00:01, 17.43it/s, est. speed input: 463.72 toks/s, output: 411.10 toks/s]
Processed prompts:  70%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;   | 70/100 [00:21<00:01, 16.80it/s, est. speed input: 481.12 toks/s, output: 428.34 toks/s]
Processed prompts:  77%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139;  | 77/100 [00:22<00:01, 22.47it/s, est. speed input: 527.87 toks/s, output: 473.29 toks/s]
Processed prompts:  81%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;  | 81/100 [00:22<00:00, 21.81it/s, est. speed input: 550.18 toks/s, output: 497.20 toks/s]
Processed prompts:  84%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141; | 84/100 [00:22<00:00, 19.89it/s, est. speed input: 565.85 toks/s, output: 514.10 toks/s]
Processed prompts:  87%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#139; | 87/100 [00:22<00:00, 18.79it/s, est. speed input: 581.08 toks/s, output: 531.17 toks/s]
Processed prompts:  89%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137; | 89/100 [00:22<00:00, 16.59it/s, est. speed input: 590.30 toks/s, output: 541.18 toks/s]
Processed prompts:  92%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#143;| 92/100 [00:22<00:00, 16.59it/s, est. speed input: 606.24 toks/s, output: 558.38 toks/s]
Processed prompts:  94%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#141;| 94/100 [00:23<00:00, 14.99it/s, est. speed input: 615.17 toks/s, output: 568.46 toks/s]
Processed prompts:  96%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#140;| 96/100 [00:23<00:00, 12.04it/s, est. speed input: 621.75 toks/s, output: 576.38 toks/s]
Processed prompts:  98%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#138;| 98/100 [00:24<00:00,  7.18it/s, est. speed input: 618.62 toks/s, output: 576.20 toks/s]
Processed prompts:  99%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#137;| 99/100 [00:24<00:00,  4.73it/s, est. speed input: 609.17 toks/s, output: 569.38 toks/s]
Processed prompts: 100%|&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;&#226;&#150;&#136;| 100/100 [00:24<00:00,  4.05it/s, est. speed input: 614.28 toks/s, output: 575.63 toks/s]

Processed prompts:   0%|          | 0/100 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s]
</stderr_txt>
]]>


©2025 Universitat Pompeu Fabra