ATM

Message boards : News : ATM
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 20 · 21 · 22 · 23 · 24 · 25 · 26 . . . 35 · Next

AuthorMessage
Nuadormrac

Send message
Joined: 21 Jul 12
Posts: 9
Credit: 433,306,729
RAC: 0
Level
Gln
Scientific publications
watwatwatwatwatwatwat
Message 60767 - Posted: 27 Sep 2023, 18:58:19 UTC - in response to Message 60051.  

Climate has routine trickle credits which come in, which is also verification that it's making it to the next checkpoint. Some climate models were weaks though, not hours...

If the "excess" data is necessary; which is resulting in these failed uploads, it might be possible to provide a compression algorithm in the app depending on what the data is. If it's text, it should be very compressible, otherwise less so. This could then be decompressed server side to allow the data to go into whatever processing you have; so long as compression doesn't result in a loss of critical data due to compression errors.
ID: 60767 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ServicEnginIC
Avatar

Send message
Joined: 24 Sep 10
Posts: 592
Credit: 11,972,186,510
RAC: 1,075
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 60783 - Posted: 30 Oct 2023, 18:04:13 UTC

It seems that today a new batch of ATMbeta tasks is on the field.
A subtle difference comparing to previous ones:
Name for my last task from previous batch was:
TYK2_m15_m16_3-QUICO_ATM_Sch_GAFF2_AIMNet2_RE-4-5-RND5965_0
Name for my first task from today's batch is:
CDK2_m10_m04_4-QUICO_ATM_Sch_AIMnet2_10-0-10-RND2956_0
If it is as usual, each task for a current investigation line will generate a chain of ten links (from 0 to 9), instead of previous 5 (from 0 to 4).
Verification pending...
ID: 60783 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 1
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 60784 - Posted: 31 Oct 2023, 8:23:14 UTC

what I notice is:
on both ATM tasks which I downloaded and started about 1 hour ago, the percentage progress bar in the BOINC manager works fine, i.e. it shows real values.
Either this was fixed, or it is coincidence.
ID: 60784 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 318
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 60785 - Posted: 31 Oct 2023, 9:11:30 UTC - in response to Message 60784.  

We're still working on the first task in each sequence - 0-5, or now 0-10. This looks to be a big batch, so that may last some time.

The interesting point (the sudden jump to 100%) will come with the 1-10 tasks. But we're still working on the 1.09 application version from late March, so I'm not expecting a miracle.
ID: 60785 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60788 - Posted: 31 Oct 2023, 12:06:14 UTC - in response to Message 60784.  

what I notice is:
on both ATM tasks which I downloaded and started about 1 hour ago, the percentage progress bar in the BOINC manager works fine, i.e. it shows real values.
Either this was fixed, or it is coincidence.

Does that mean that ATM tasks are available now? I haven't received anything since.. May or June, if i remember correctly. Even now, i explicitly clicked the Update button - nothing. nVidia RTX3070 on Win 11, if that matters.
ID: 60788 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1116
Credit: 40,839,470,595
RAC: 4,772
Level
Trp
Scientific publications
wat
Message 60789 - Posted: 31 Oct 2023, 12:07:03 UTC - in response to Message 60788.  

what I notice is:
on both ATM tasks which I downloaded and started about 1 hour ago, the percentage progress bar in the BOINC manager works fine, i.e. it shows real values.
Either this was fixed, or it is coincidence.

Does that mean that ATM tasks are available now? I haven't received anything since.. May or June, if i remember correctly. Even now, i explicitly clicked the Update button - nothing. nVidia RTX3070 on Win 11, if that matters.


the tasks now are "ATMbeta".

you need to go into your preferences and allow beta work.
ID: 60789 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60790 - Posted: 31 Oct 2023, 12:10:22 UTC - in response to Message 60789.  


the tasks now are "ATMbeta".

you need to go into your preferences and allow beta work.

That's been done long time ago. My current settings are:
ACEMD 3: yes
ACEMD 4: yes
ATM (beta): yes
Quantum Chemistry (CPU): yes
Quantum Chemistry (CPU, beta): no
Python Runtime (CPU, beta): no
Python Runtime (GPU, beta): yes

ID: 60790 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60791 - Posted: 31 Oct 2023, 12:15:52 UTC - in response to Message 60789.  

That's strange. 'Server Status' page reports 1,296 unsent units, but my BOINC client doesn't receive any. This is what i have in the logs:
31/10/2023 11:11:12 PM | GPUGRID | Sending scheduler request: To fetch work.
31/10/2023 11:11:12 PM | GPUGRID | Requesting new tasks for NVIDIA GPU and Intel GPU
31/10/2023 11:11:15 PM | GPUGRID | Scheduler request completed: got 0 new tasks
31/10/2023 11:11:15 PM | GPUGRID | No tasks sent
31/10/2023 11:11:15 PM | GPUGRID | No tasks are available for ACEMD 3: molecular dynamics simulations for GPUs
31/10/2023 11:11:15 PM | GPUGRID | No tasks are available for ACEMD 4: molecular dynamics simulations for GPUs
31/10/2023 11:11:15 PM | GPUGRID | No tasks are available for ATM: Free energy calculations of protein-ligand binding
31/10/2023 11:11:15 PM | GPUGRID | Project requested delay of 31 seconds
ID: 60791 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 11 Jul 09
Posts: 1639
Credit: 10,159,968,649
RAC: 318
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 60792 - Posted: 31 Oct 2023, 12:52:53 UTC - in response to Message 60785.  

Got my first 1-10 task of this run - specifically,

JNK1_m06_m05_5-QUICO_ATM_Sch_GAFF2_xTB_MM_False_v3-1-10-RND0728_0

It jumped immediately to 100%, as before.
ID: 60792 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[BAT] Svennemans

Send message
Joined: 27 May 21
Posts: 54
Credit: 1,004,151,720
RAC: 0
Level
Met
Scientific publications
wat
Message 60793 - Posted: 31 Oct 2023, 13:12:44 UTC - in response to Message 60792.  
Last modified: 31 Oct 2023, 13:51:22 UTC

Same here for JNK1_m06_m05_2-QUICO_ATM_Sch_AIMNet2_10-1-10-RND3720 - direct to 100%, whereas TYK2_m03_m15_1-QUICO_ATM_Sch_GAFF2_xTB_MM_False_v3-0-10-RND2341_3 progress worked just fine.

Interesting thing I happened to notice though - which might or might not help the devs fixing this:
- On the 0-10 task, I noticed that progress jumped up in 1.446% increments every 5 minutes.
- On the 1-10 task, there's a 'progress' file in the slot directory with a number that jumps up in 0.01449 increments every 5 minutes. this number starts with a 1, like this: 1.391304348 => 1.405797101 => ...

Hypothesis is that this number should start with a 0 instead of a 1 and then progress would be reported OK?

<edit> would be interesting to see if I get a chunck 2-10 if this progress number starts with a 2.xxx then. Might be an 'easy' fix to subtract the chunk number from the progress number before writing?
ID: 60793 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1116
Credit: 40,839,470,595
RAC: 4,772
Level
Trp
Scientific publications
wat
Message 60794 - Posted: 31 Oct 2023, 15:13:26 UTC - in response to Message 60790.  


the tasks now are "ATMbeta".

you need to go into your preferences and allow beta work.

That's been done long time ago. My current settings are:
ACEMD 3: yes
ACEMD 4: yes
ATM (beta): yes
Quantum Chemistry (CPU): yes
Quantum Chemistry (CPU, beta): no
Python Runtime (CPU, beta): no
Python Runtime (GPU, beta): yes



there's more to it. there are two options you need to select.

make sure this one is checked:
"Run test applications?"
ID: 60794 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1116
Credit: 40,839,470,595
RAC: 4,772
Level
Trp
Scientific publications
wat
Message 60795 - Posted: 31 Oct 2023, 15:25:37 UTC - in response to Message 60793.  
Last modified: 31 Oct 2023, 15:32:41 UTC

Same here for JNK1_m06_m05_2-QUICO_ATM_Sch_AIMNet2_10-1-10-RND3720 - direct to 100%, whereas TYK2_m03_m15_1-QUICO_ATM_Sch_GAFF2_xTB_MM_False_v3-0-10-RND2341_3 progress worked just fine.

Interesting thing I happened to notice though - which might or might not help the devs fixing this:
- On the 0-10 task, I noticed that progress jumped up in 1.446% increments every 5 minutes.
- On the 1-10 task, there's a 'progress' file in the slot directory with a number that jumps up in 0.01449 increments every 5 minutes. this number starts with a 1, like this: 1.391304348 => 1.405797101 => ...

Hypothesis is that this number should start with a 0 instead of a 1 and then progress would be reported OK?

<edit> would be interesting to see if I get a chunck 2-10 if this progress number starts with a 2.xxx then. Might be an 'easy' fix to subtract the chunk number from the progress number before writing?


there's no need to reanalyze all this. it's been done ad nauseam many months ago and discussed over and over again. all of the behavior is known at this point.

tasks in the "0" group will all process and count the progress naturally.
tasks in "1+" groups will all jump to 100% after the extraction phase. but will complete successfully in the normal time if you leave it alone.

the root cause very likely has to do with how they have decided to configure their asyncre.cntl file. using a relative value rather than absolute based on what group it's in.

for all run types, the last line of this file is listed as just "MAX_SAMPLES = +70". it's very possible that the app is communicating to boinc the run percentage based on the ratio of current sample to max sample.

so for all "0" runs, the current sample will be less than the max sample. 1 through 70.

however, for all "1+" runs, the current sample will always be greater than max sample (71+). boinc can't report greater than 100% completion, so it jumps to 100% and stays there until the task is actually finished.
ID: 60795 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[BAT] Svennemans

Send message
Joined: 27 May 21
Posts: 54
Credit: 1,004,151,720
RAC: 0
Level
Met
Scientific publications
wat
Message 60796 - Posted: 31 Oct 2023, 16:01:36 UTC - in response to Message 60795.  


the root cause very likely has to do with how they have decided to configure their asyncre.cntl file. using a relative value rather than absolute based on what group it's in.

for all run types, the last line of this file is listed as just "MAX_SAMPLES = +70". it's very possible that the app is communicating to boinc the run percentage based on the ratio of current sample to max sample.

so for all "0" runs, the current sample will be less than the max sample. 1 through 70.

however, for all "1+" runs, the current sample will always be greater than max sample (71+). boinc can't report greater than 100% completion, so it jumps to 100% and stays there until the task is actually finished.


Well that would match with what I'm seeing, if chunk 0 = 1-70 and chunck 1 = 71-140, then progress would run 0-1 in the first case, and 1-2 in the second (and probably 2-3 for chunck #2 and so on).
If the app reports progress in that way, and they can just change it to subtract the chunck number, then that would bring all progress back to 0-1 range where it should be.
Sounds like a reasonably easy fix - if there isn't more to it obviously, and if they have the time to do that...
ID: 60796 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60799 - Posted: 31 Oct 2023, 22:37:13 UTC - in response to Message 60794.  


there's more to it. there are two options you need to select.

make sure this one is checked:
"Run test applications?"

Sure, i have it checked:
Run test applications?
This helps us develop applications, but may cause jobs to fail on your computer yes
If no work for selected applications is available, accept work from other applications? yes
Use Graphics Processing Unit (GPU) if available yes
Use Central Processing Unit (CPU) yes

I have both test and other applications, that's why i'm surprised to not have been receiving anything when WUs are available now.[/i]
ID: 60799 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1116
Credit: 40,839,470,595
RAC: 4,772
Level
Trp
Scientific publications
wat
Message 60800 - Posted: 31 Oct 2023, 22:43:27 UTC - in response to Message 60799.  

what is your cache setting in BOINC? how much work are you asking for? I think with GPUGRID if you ask for "too much" you end up getting this response and getting nothing. if you're asking for something like 10 days of work, that might explain it. set your work cache to like 1 day or less.
ID: 60800 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60801 - Posted: 31 Oct 2023, 22:48:55 UTC - in response to Message 60799.  

I even removed the project from BOINC and re-added it, to no avail:
1/11/2023 9:46:37 AM | GPUGRID | New computer location: work
1/11/2023 9:46:39 AM | GPUGRID | Started download of logogpugrid.png
1/11/2023 9:46:39 AM | GPUGRID | Started download of project_1.png
1/11/2023 9:46:39 AM | GPUGRID | Started download of project_2.png
1/11/2023 9:46:39 AM | GPUGRID | Started download of project_3.png
1/11/2023 9:46:41 AM | GPUGRID | Finished download of logogpugrid.png (0 bytes)
1/11/2023 9:46:42 AM | GPUGRID | Finished download of project_1.png (0 bytes)
1/11/2023 9:46:42 AM | GPUGRID | Finished download of project_2.png (0 bytes)
1/11/2023 9:46:42 AM | GPUGRID | Finished download of project_3.png (0 bytes)
1/11/2023 9:47:11 AM | GPUGRID | Sending scheduler request: To fetch work.
1/11/2023 9:47:11 AM | GPUGRID | Requesting new tasks for NVIDIA GPU and Intel GPU
1/11/2023 9:47:15 AM | GPUGRID | Scheduler request completed: got 0 new tasks
1/11/2023 9:47:15 AM | GPUGRID | No tasks sent
1/11/2023 9:47:15 AM | GPUGRID | No tasks are available for ACEMD 3: molecular dynamics simulations for GPUs
1/11/2023 9:47:15 AM | GPUGRID | No tasks are available for ACEMD 4: molecular dynamics simulations for GPUs
1/11/2023 9:47:15 AM | GPUGRID | No tasks are available for ATM: Free energy calculations of protein-ligand binding
1/11/2023 9:47:15 AM | GPUGRID | Project requested delay of 31 seconds
ID: 60801 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60802 - Posted: 31 Oct 2023, 22:50:38 UTC - in response to Message 60800.  

My settings are:

Store at least 0.1 days
and up to an additional 0.75 days of work.

Are these settings too low?
ID: 60802 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 21 Feb 20
Posts: 1116
Credit: 40,839,470,595
RAC: 4,772
Level
Trp
Scientific publications
wat
Message 60803 - Posted: 31 Oct 2023, 22:52:57 UTC - in response to Message 60802.  

those should be OK to get at least one task I think. as long as BOINC doesnt think they will take so long to miss the deadline.
ID: 60803 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60804 - Posted: 31 Oct 2023, 22:53:28 UTC - in response to Message 60802.  

My computing prefs:
1/11/2023 9:52:09 AM | | General prefs: using separate prefs for work
1/11/2023 9:52:09 AM | | Reading preferences override file
1/11/2023 9:52:09 AM | | Preferences:
1/11/2023 9:52:09 AM | | - When computer is in use
1/11/2023 9:52:09 AM | | - 'In use' means mouse/keyboard input in last 3.00 minutes
1/11/2023 9:52:09 AM | | - max CPUs used: 5
1/11/2023 9:52:09 AM | | - Use at most 85% of the CPU time
1/11/2023 9:52:09 AM | | - suspend if non-BOINC CPU load exceeds 80%
1/11/2023 9:52:09 AM | | - max memory usage: 7.84 GB
1/11/2023 9:52:09 AM | | - When computer is not in use
1/11/2023 9:52:09 AM | | - max CPUs used: 8
1/11/2023 9:52:09 AM | | - Use at most 85% of the CPU time
1/11/2023 9:52:09 AM | | - suspend if non-BOINC CPU load exceeds 80%
1/11/2023 9:52:09 AM | | - max memory usage: 14.12 GB
1/11/2023 9:52:09 AM | | - Leave apps in memory if not running
1/11/2023 9:52:09 AM | | - Store at least 1.00 days of work
1/11/2023 9:52:09 AM | | - Store up to an additional 1.00 days of work
1/11/2023 9:52:09 AM | | - max disk usage: 80.00 GB
1/11/2023 9:52:09 AM | | - (to change preferences, visit a project web site or select Preferences in the Manager)
ID: 60804 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
goldfinch

Send message
Joined: 5 May 19
Posts: 36
Credit: 711,308,218
RAC: 45
Level
Lys
Scientific publications
wat
Message 60805 - Posted: 31 Oct 2023, 22:55:43 UTC - in response to Message 60803.  

those should be OK to get at least one task I think. as long as BOINC doesnt think they will take so long to miss the deadline.

My laptop used to crunch ATM tasks successfully in the past, before the summer break. Is there anything different now? I mean, system requirements - have they changed dramatically in terms of available memory and graphics cards?
ID: 60805 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 20 · 21 · 22 · 23 · 24 · 25 · 26 . . . 35 · Next

Message boards : News : ATM

©2025 Universitat Pompeu Fabra