Name | wu_25b9685a-GIANNI_GPROTO7-0-1-RND9625_0 |
Workunit | 31543671 |
Created | 26 Sep 2025, 14:23:36 UTC |
Sent | 26 Sep 2025, 14:23:42 UTC |
Report deadline | 1 Oct 2025, 14:23:42 UTC |
Received | 26 Sep 2025, 14:39:42 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 195 (0x000000C3) EXIT_CHILD_FAILED |
Computer ID | 559888 |
Run time | 5 min 15 sec |
CPU time | 39 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 56,150.96 GFLOPS |
Application version | LLM: LLMs for chemistry v1.01 (cuda124L) windows_x86_64 |
Peak working set size | 867.60 MB |
Peak swap size | 2.63 GB |
Peak disk usage | 6.51 GB |
<core_client_version>8.2.4</core_client_version> <![CDATA[ <message> The operating system cannot run (null). (0xc3) - exit code 195 (0xc3)</message> <stderr_txt> 15:36:05 (17616): wrapper (7.9.26016): starting 15:36:05 (17616): wrapper: running Library/usr/bin/tar.exe (xjvf input.tar.bz2) tasks.json run.bat conf.yaml main_generation-0.1.0-py3-none-any.whl run.sh 15:36:07 (17616): Library/usr/bin/tar.exe exited; CPU time 0.000000 15:36:07 (17616): wrapper: running C:/Windows/system32/cmd.exe (/c call Scripts\activate.bat && Scripts\conda-unpack.exe && run.bat) Generating train split: 0 examples [00:00, ? examples/s] Generating train split: 2500 examples [00:00, 249994.28 examples/s] E:\Boinc\data\slots\32\Lib\site-packages\huggingface_hub\file_download.py:144: UserWarning: `huggingface_hub` cache-system uses symlinks by default to efficiently store duplicated files but your machine does not support them in E:\Boinc\data\slots\.cache\hub\models--Acellera--proto. Caching files will still work but in a degraded version that might require more space on your disk. This warning can be disabled by setting the `HF_HUB_DISABLE_SYMLINKS_WARNING` environment variable. For more details, see https://huggingface.co/docs/huggingface_hub/how-to-cache#limitations. To support symlinks on Windows, you either need to activate Developer Mode or to run Python as an administrator. In order to activate developer mode, see this article: https://docs.microsoft.com/en-us/windows/apps/get-started/enable-your-device-for-development warnings.warn(message) E:\Boinc\data\slots\32\Lib\site-packages\huggingface_hub\file_download.py:144: UserWarning: `huggingface_hub` cache-system uses symlinks by default to efficiently store duplicated files but your machine does not support them in E:\Boinc\data\slots\.cache\hub\models--unsloth--Qwen2.5-14B-Instruct-bnb-4bit. Caching files will still work but in a degraded version that might require more space on your disk. This warning can be disabled by setting the `HF_HUB_DISABLE_SYMLINKS_WARNING` environment variable. For more details, see https://huggingface.co/docs/huggingface_hub/how-to-cache#limitations. To support symlinks on Windows, you either need to activate Developer Mode or to run Python as an administrator. In order to activate developer mode, see this article: https://docs.microsoft.com/en-us/windows/apps/get-started/enable-your-device-for-development warnings.warn(message) E:\Boinc\data\slots\32\Lib\site-packages\torch\cuda\__init__.py:235: UserWarning: NVIDIA GeForce RTX 5090 with CUDA capability sm_120 is not compatible with the current PyTorch installation. The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_61 sm_70 sm_75 sm_80 sm_86 sm_90. If you want to use the NVIDIA GeForce RTX 5090 GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/ warnings.warn( [W926 15:38:02.000000000 socket.cpp:759] [c10d] The client socket has failed to connect to [PlatGaming.localdomain]:58730 (system error: 10049 - The requested address is not valid in its context.). [rank0]: Traceback (most recent call last): [rank0]: File "wheel_contents/aiengine/main_generation.py", line 87, in <module> [rank0]: File "wheel_contents/aiengine/model.py", line 36, in __init__ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\utils.py", line 1096, in inner [rank0]: return fn(*args, **kwargs) [rank0]: ^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\entrypoints\llm.py", line 243, in __init__ [rank0]: self.llm_engine = LLMEngine.from_engine_args( [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\engine\llm_engine.py", line 521, in from_engine_args [rank0]: return engine_cls.from_vllm_config( [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\engine\llm_engine.py", line 497, in from_vllm_config [rank0]: return cls( [rank0]: ^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\engine\llm_engine.py", line 281, in __init__ [rank0]: self.model_executor = executor_class(vllm_config=vllm_config, ) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\executor\executor_base.py", line 52, in __init__ [rank0]: self._init_executor() [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\executor\uniproc_executor.py", line 47, in _init_executor [rank0]: self.collective_rpc("load_model") [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\executor\uniproc_executor.py", line 56, in collective_rpc [rank0]: answer = run_method(self.driver_worker, method, args, kwargs) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\utils.py", line 2359, in run_method [rank0]: return func(*args, **kwargs) [rank0]: ^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\worker\worker.py", line 184, in load_model [rank0]: self.model_runner.load_model() [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\worker\model_runner.py", line 1113, in load_model [rank0]: self.model = get_model(vllm_config=self.vllm_config) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\model_loader\__init__.py", line 14, in get_model [rank0]: return loader.load_model(vllm_config=vllm_config) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\model_loader\loader.py", line 1278, in load_model [rank0]: model = _initialize_model(vllm_config=vllm_config) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\model_loader\loader.py", line 127, in _initialize_model [rank0]: return model_class(vllm_config=vllm_config, prefix=prefix) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\models\qwen2.py", line 431, in __init__ [rank0]: self.model = Qwen2Model(vllm_config=vllm_config, [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\compilation\decorators.py", line 151, in __init__ [rank0]: old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs) [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\models\qwen2.py", line 300, in __init__ [rank0]: self.start_layer, self.end_layer, self.layers = make_layers( [rank0]: ^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\models\utils.py", line 610, in make_layers [rank0]: maybe_offload_to_cpu(layer_fn(prefix=f"{prefix}.{idx}")) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\models\qwen2.py", line 302, in <lambda> [rank0]: lambda prefix: Qwen2DecoderLayer(config=config, [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\models\qwen2.py", line 206, in __init__ [rank0]: self.self_attn = Qwen2Attention( [rank0]: ^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\models\qwen2.py", line 153, in __init__ [rank0]: self.rotary_emb = get_rope( [rank0]: ^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\layers\rotary_embedding.py", line 1180, in get_rope [rank0]: rotary_emb = RotaryEmbedding(head_size, rotary_dim, max_position, base, [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\layers\rotary_embedding.py", line 99, in __init__ [rank0]: cache = self._compute_cos_sin_cache() [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\layers\rotary_embedding.py", line 116, in _compute_cos_sin_cache [rank0]: inv_freq = self._compute_inv_freq(self.base) [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\vllm\model_executor\layers\rotary_embedding.py", line 110, in _compute_inv_freq [rank0]: inv_freq = 1.0 / (base**(torch.arange( [rank0]: ^^^^^^^^^^^^^ [rank0]: File "E:\Boinc\data\slots\32\Lib\site-packages\torch\utils\_device.py", line 104, in __torch_function__ [rank0]: return func(*args, **kwargs) [rank0]: ^^^^^^^^^^^^^^^^^^^^^ [rank0]: RuntimeError: CUDA error: no kernel image is available for execution on the device [rank0]: CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. [rank0]: For debugging consider passing CUDA_LAUNCH_BLOCKING=1 [rank0]: Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. 15:38:04 (17616): C:/Windows/system32/cmd.exe exited; CPU time 39.703125 15:38:04 (17616): app exit status: 0x16 15:38:04 (17616): called boinc_finish(195) 0 bytes in 0 Free Blocks. 346 bytes in 8 Normal Blocks. 1144 bytes in 1 CRT Blocks. 0 bytes in 0 Ignore Blocks. 0 bytes in 0 Client Blocks. Largest number used: 0 bytes. Total allocations: 2095674 bytes. Dumping objects -> {1601186} normal block at 0x0000029F6C085360, 48 bytes long. Data: <PATH=E:\Boinc\da> 50 41 54 48 3D 45 3A 5C 42 6F 69 6E 63 5C 64 61 {1601175} normal block at 0x0000029F6DDC71C0, 32 bytes long. Data: <HOME=E:\Boinc\da> 48 4F 4D 45 3D 45 3A 5C 42 6F 69 6E 63 5C 64 61 {1601164} normal block at 0x0000029F6DDC6E60, 32 bytes long. Data: <TMP=E:\Boinc\dat> 54 4D 50 3D 45 3A 5C 42 6F 69 6E 63 5C 64 61 74 {1601153} normal block at 0x0000029F6DDC6DA0, 32 bytes long. Data: <TEMP=E:\Boinc\da> 54 45 4D 50 3D 45 3A 5C 42 6F 69 6E 63 5C 64 61 {1601142} normal block at 0x0000029F6DDC66E0, 32 bytes long. Data: <TMPDIR=E:\Boinc\> 54 4D 50 44 49 52 3D 45 3A 5C 42 6F 69 6E 63 5C {1601111} normal block at 0x0000029F6C0852F0, 48 bytes long. Data: <PATH=E:\Boinc\da> 50 41 54 48 3D 45 3A 5C 42 6F 69 6E 63 5C 64 61 {1601100} normal block at 0x0000029F6C141300, 85 bytes long. Data: <<project_prefere> 3C 70 72 6F 6A 65 63 74 5F 70 72 65 66 65 72 65 ..\api\boinc_api.cpp(309) : {1601097} normal block at 0x0000029F6C07DD30, 8 bytes long. Data: < ]lŸ > 00 00 5D 6C 9F 02 00 00 {1600495} normal block at 0x0000029F6C1402C0, 85 bytes long. Data: <<project_prefere> 3C 70 72 6F 6A 65 63 74 5F 70 72 65 66 65 72 65 {1599916} normal block at 0x0000029F6C07E050, 8 bytes long. Data: < XßmŸ > 20 58 DF 6D 9F 02 00 00 ..\zip\boinc_zip.cpp(122) : {305} normal block at 0x0000029F6C072520, 260 bytes long. Data: < > 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 {290} normal block at 0x0000029F6C070E90, 80 bytes long. Data: </c call Scripts\> 2F 63 20 63 61 6C 6C 20 53 63 72 69 70 74 73 5C {289} normal block at 0x0000029F6C0862B0, 16 bytes long. Data: <Hk lŸ > 48 6B 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {288} normal block at 0x0000029F6C085C70, 16 bytes long. Data: < k lŸ > 20 6B 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {287} normal block at 0x0000029F6C086210, 16 bytes long. Data: <øj lŸ > F8 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {286} normal block at 0x0000029F6C0866C0, 16 bytes long. Data: <Ðj lŸ > D0 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {285} normal block at 0x0000029F6C085C20, 16 bytes long. Data: <¨j lŸ > A8 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {284} normal block at 0x0000029F6C0861C0, 16 bytes long. Data: < j lŸ > 80 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {283} normal block at 0x0000029F6C085210, 48 bytes long. Data: <ComSpec=C:\Windo> 43 6F 6D 53 70 65 63 3D 43 3A 5C 57 69 6E 64 6F {282} normal block at 0x0000029F6C086580, 16 bytes long. Data: <H¶ lŸ > 48 B6 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {281} normal block at 0x0000029F6C0812F0, 32 bytes long. Data: <SystemRoot=C:\Wi> 53 79 73 74 65 6D 52 6F 6F 74 3D 43 3A 5C 57 69 {280} normal block at 0x0000029F6C0863A0, 16 bytes long. Data: < ¶ lŸ > 20 B6 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {278} normal block at 0x0000029F6C085AE0, 16 bytes long. Data: <øµ lŸ > F8 B5 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {277} normal block at 0x0000029F6C085860, 16 bytes long. Data: <е lŸ > D0 B5 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {276} normal block at 0x0000029F6C086170, 16 bytes long. Data: <¨µ lŸ > A8 B5 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {275} normal block at 0x0000029F6C086120, 16 bytes long. Data: < µ lŸ > 80 B5 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {274} normal block at 0x0000029F6C0864E0, 16 bytes long. Data: <Xµ lŸ > 58 B5 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {273} normal block at 0x0000029F6C081770, 32 bytes long. Data: <CUDA_DEVICE=0 PU> 43 55 44 41 5F 44 45 56 49 43 45 3D 30 00 50 55 {272} normal block at 0x0000029F6C085A90, 16 bytes long. Data: <0µ lŸ > 30 B5 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {271} normal block at 0x0000029F6C06B530, 320 bytes long. Data: < Z lŸ p lŸ > 90 5A 08 6C 9F 02 00 00 70 17 08 6C 9F 02 00 00 {270} normal block at 0x0000029F6C0860D0, 16 bytes long. Data: <`j lŸ > 60 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {269} normal block at 0x0000029F6C086080, 16 bytes long. Data: <8j lŸ > 38 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {268} normal block at 0x0000029F6C081230, 32 bytes long. Data: <C:/Windows/syste> 43 3A 2F 57 69 6E 64 6F 77 73 2F 73 79 73 74 65 {267} normal block at 0x0000029F6C0859A0, 16 bytes long. Data: < j lŸ > 10 6A 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {266} normal block at 0x0000029F6C080C30, 32 bytes long. Data: <xjvf input.tar.b> 78 6A 76 66 20 69 6E 70 75 74 2E 74 61 72 2E 62 {265} normal block at 0x0000029F6C086030, 16 bytes long. Data: <Xi lŸ > 58 69 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {264} normal block at 0x0000029F6C085FE0, 16 bytes long. Data: <0i lŸ > 30 69 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {263} normal block at 0x0000029F6C085EA0, 16 bytes long. Data: < i lŸ > 08 69 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {262} normal block at 0x0000029F6C0858B0, 16 bytes long. Data: <àh lŸ > E0 68 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {261} normal block at 0x0000029F6C086760, 16 bytes long. Data: <¸h lŸ > B8 68 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {260} normal block at 0x0000029F6C0867B0, 16 bytes long. Data: < h lŸ > 90 68 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {258} normal block at 0x0000029F6C086260, 16 bytes long. Data: <ÐS lŸ > D0 53 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {257} normal block at 0x0000029F6C0853D0, 40 bytes long. Data: <`b lŸ ðR lŸ > 60 62 08 6C 9F 02 00 00 F0 52 08 6C 9F 02 00 00 {256} normal block at 0x0000029F6C086530, 16 bytes long. Data: <ph lŸ > 70 68 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {255} normal block at 0x0000029F6C085BD0, 16 bytes long. Data: <Hh lŸ > 48 68 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {254} normal block at 0x0000029F6C081A70, 32 bytes long. Data: <Library/usr/bin/> 4C 69 62 72 61 72 79 2F 75 73 72 2F 62 69 6E 2F {253} normal block at 0x0000029F6C085EF0, 16 bytes long. Data: < h lŸ > 20 68 08 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {252} normal block at 0x0000029F6C086820, 992 bytes long. Data: <ð^ lŸ p lŸ > F0 5E 08 6C 9F 02 00 00 70 1A 08 6C 9F 02 00 00 {96} normal block at 0x0000029F6C080ED0, 32 bytes long. Data: <windows_x86_64__> 77 69 6E 64 6F 77 73 5F 78 38 36 5F 36 34 5F 5F {95} normal block at 0x0000029F6C07DBF0, 16 bytes long. Data: <àï lŸ > E0 EF 06 6C 9F 02 00 00 00 00 00 00 00 00 00 00 {94} normal block at 0x0000029F6C06EFE0, 40 bytes long. Data: <ðÛ lŸ Ð lŸ > F0 DB 07 6C 9F 02 00 00 D0 0E 08 6C 9F 02 00 00 {73} normal block at 0x0000029F6C07D600, 16 bytes long. Data: < ê,‡÷ > 80 EA 2C 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {72} normal block at 0x0000029F6C07D7E0, 16 bytes long. Data: <@é,‡÷ > 40 E9 2C 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {71} normal block at 0x0000029F6C07D790, 16 bytes long. Data: <øW)‡÷ > F8 57 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {70} normal block at 0x0000029F6C07D920, 16 bytes long. Data: <ØW)‡÷ > D8 57 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {69} normal block at 0x0000029F6C07DC90, 16 bytes long. Data: <P )‡÷ > 50 04 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {68} normal block at 0x0000029F6C07D5B0, 16 bytes long. Data: <0 )‡÷ > 30 04 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {67} normal block at 0x0000029F6C07D510, 16 bytes long. Data: <à )‡÷ > E0 02 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {66} normal block at 0x0000029F6C07DF10, 16 bytes long. Data: < )‡÷ > 10 04 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {65} normal block at 0x0000029F6C07D740, 16 bytes long. Data: <p )‡÷ > 70 04 29 87 F7 7F 00 00 00 00 00 00 00 00 00 00 {64} normal block at 0x0000029F6C07E000, 16 bytes long. Data: < À'‡÷ > 18 C0 27 87 F7 7F 00 00 00 00 00 00 00 00 00 00 Object dump complete. </stderr_txt> ]]>
©2025 Universitat Pompeu Fabra