do you have any experience with running a VM based application in BOINC?

Message boards : News : do you have any experience with running a VM based application in BOINC?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3

AuthorMessage
paradoxon

Send message
Joined: 20 Feb 14
Posts: 1
Credit: 7,891,310
RAC: 0
Level
Ser
Scientific publications
watwatwatwatwatwatwat
Message 42552 - Posted: 3 Jan 2016, 17:07:59 UTC

Two major concerns A: getting GPU support in VM is very tricky busyness, if it is to be free, easy to use, easy to maintain and cross platform. I'd say it is impossible at the time. B: Especially on Linux (maybe other unix platforms too) its sometimes tricky go get boinc and VirtualBox to play along nicely. Both my gentoo box and my arch linux make trouble. Ubuntu worked fine, but Ubuntu is not the whole community. Maybe handing out docker containers? But that would put Win-Users in trouble, wouldn't it?
ID: 42552 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 42555 - Posted: 3 Jan 2016, 20:18:48 UTC

GPUGrid admins:

Was GPUGrid intending to use VMs for: GPU work, or CPU work, or both? It might be helpful to know what your intentions are...
ID: 42555 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
jamie

Send message
Joined: 9 Jan 16
Posts: 1
Credit: 884,675
RAC: 0
Level
Gly
Scientific publications
wat
Message 42581 - Posted: 9 Jan 2016, 4:04:01 UTC

For CPU based work, VMs would be just fine. 99.9% of the time however, a VM cannot access certain hardware, like the GPU(s). If you want to do GPU computing, it has to be on the host system OS.
ID: 42581 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
John

Send message
Joined: 10 Jan 16
Posts: 3
Credit: 246,061,370
RAC: 1
Level
Leu
Scientific publications
watwatwatwatwatwat
Message 42586 - Posted: 10 Jan 2016, 14:58:07 UTC

I use two VM projects with BOINC - Atlas and VirtualLHC. Up until recently, they were problematic especially with Windows 10. They had abnormally high disk usage and kept getting postponed saying they didn't start in a timely fashion or some such. But, now that they've finally approved Virtual Box 5 (I'm currently running 5.0.12) for BOINC 7.6.22, both projects are running very smoothly and I can't tell any difference between them and non VM projects.
ID: 42586 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
sven.leuschner@gmx.net

Send message
Joined: 10 Jan 16
Posts: 1
Credit: 40,500
RAC: 0
Level

Scientific publications
wat
Message 42590 - Posted: 11 Jan 2016, 0:40:54 UTC - in response to Message 42416.  

yes, like the answers before I sugget you turn towards the CERN guys. I participate in the vLHC project - and after the latest upgrade (which included finally a 5.x Virtualbox) it runs well on my machine. On the other hand, people who like to contribute will need to have more RAM. Which isnt too big an issue looking at modern pcs - my laptop has a good 16GB .... just saying.


ID: 42590 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 42820 - Posted: 15 Feb 2016, 2:00:06 UTC

This is an example of how Docker is used to create a BOINC project.
http://cosmicmar.com/2016/02/14/boinc-server-docker-1/
ID: 42820 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile robertmiles

Send message
Joined: 16 Apr 09
Posts: 503
Credit: 769,991,668
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 46942 - Posted: 16 Apr 2017, 2:14:01 UTC
Last modified: 16 Apr 2017, 2:15:31 UTC

Some, as a user only.

I found that you first need to enable VM, usually early in the boot process where you are still talking to to the BIOS or UEFI, and have not yet told it which operating system to boot (even if you only have one operating system installed). Details of how are often specific to the model of computer you have.

If you have ever tried to download a VM workunit before, you must then edit a BOINC file which records that no usable VM was found for the previous VM workunit. Retrying this check is NOT automatic for BOINC 7.6.33 and earlier; this may change for future versions. This change needs to be done while BOINC is not running.

At least one of the BOINC projects I get VM workunits from is not compatible with the 5.0.* versions of VirtualBox, so you must now upgrade to one of the recent 5.1.* versions if you're interested in that project. Restart or reboot after this upgrade.

Now start BOINC, and tell at least one BOINC project that it is allowed to send you VM workunits.
ID: 46942 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
opr

Send message
Joined: 24 May 11
Posts: 7
Credit: 93,272,937
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwatwatwatwat
Message 46967 - Posted: 16 Apr 2017, 14:37:27 UTC

I ran test for theory about year ago with my old pc , virtual box installed . Somehow they tend to need more attention , especially with older pc. Little more tricky than usual "participate and forget"-style crunching.
ID: 46967 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Lluis

Send message
Joined: 22 Feb 14
Posts: 26
Credit: 672,639,304
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 46970 - Posted: 16 Apr 2017, 19:30:09 UTC

Two years ago I did some crunching on VM without problems until I decided upgrade to a newer version of VM. Probably I did a mistake in the process and since then it has been impossible to install VM as always a missing archive is reported. I found others users of VM with the same problem and tips of how to fix it, but in my case it didn't work.
ID: 46970 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 46971 - Posted: 16 Apr 2017, 22:48:12 UTC - in response to Message 46967.  

I ran test for theory about year ago with my old pc , virtual box installed . Somehow they tend to need more attention , especially with older pc. Little more tricky than usual "participate and forget"-style crunching.

That is quite true for the CERN projects in general, but I think that is mainly because they are at the cutting edge of science and are constantly changing both the data and the applications they run. Also, they seem to have a lot of servers that need to be working together, and they don't always do so.

It could be different on GPUGrid, if they stick with a stable application and don't change it without adequate testing. But the LHC people say that it is hard to troubleshoot the VM projects, apparently because the virtual machine itself gets in the way. But it could work OK under the right conditions.
ID: 46971 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Erich56

Send message
Joined: 1 Jan 15
Posts: 1166
Credit: 12,260,898,501
RAC: 1
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwat
Message 46974 - Posted: 17 Apr 2017, 5:01:19 UTC

what should be considered though is that VMs require virtualization capability of the CPU; older CPUs don't have this.

ID: 46974 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Jul 12
Posts: 819
Credit: 1,591,285,971
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 46977 - Posted: 17 Apr 2017, 14:35:40 UTC - in response to Message 46974.  

It is not a problem that I can see, except that people should be made aware that it will not work on older CPUs so that they don't waste time trying. But their GPU work units don't work on all cards either. You just don't run it in that case.
ID: 46977 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile robertmiles

Send message
Joined: 16 Apr 09
Posts: 503
Credit: 769,991,668
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 46992 - Posted: 18 Apr 2017, 2:14:15 UTC - in response to Message 46970.  
Last modified: 18 Apr 2017, 2:15:24 UTC

Two years ago I did some crunching on VM without problems until I decided upgrade to a newer version of VM. Probably I did a mistake in the process and since then it has been impossible to install VM as always a missing archive is reported. I found others users of VM with the same problem and tips of how to fix it, but in my case it didn't work.

Did you try uninstalling VirtualBox, restarting, then installing it again? That often helps with missing file problems.
ID: 46992 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Lluis

Send message
Joined: 22 Feb 14
Posts: 26
Credit: 672,639,304
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 47020 - Posted: 18 Apr 2017, 18:21:27 UTC - in response to Message 46992.  

Did you try uninstalling VirtualBox, restarting, then installing it again? That often helps with missing file problems.


The problem is that when I try to uninstall VirtualBox appears this message or a similar one: "VirtualBox-4.3.12-r93733-MultiArch_amd64.msi" is NOT FOUND (In a TEMP directory) and I can't continue the process of uninstalling.
A tip in internet explains how to overrule this problem and some guys said that it works. But not for me.
ID: 47020 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 47021 - Posted: 18 Apr 2017, 18:45:17 UTC - in response to Message 47020.  
Last modified: 18 Apr 2017, 18:45:52 UTC

Did you try uninstalling VirtualBox, restarting, then installing it again? That often helps with missing file problems.


The problem is that when I try to uninstall VirtualBox appears this message or a similar one: "VirtualBox-4.3.12-r93733-MultiArch_amd64.msi" is NOT FOUND (In a TEMP directory) and I can't continue the process of uninstalling.
A tip in internet explains how to overrule this problem and some guys said that it works. But not for me.


Have you tried re-running the original installer for that exact version, and then choosing to uninstall during the installer, or maybe repair, or maybe re-install ? Try all the options, using the original installer.
ID: 47021 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Lluis

Send message
Joined: 22 Feb 14
Posts: 26
Credit: 672,639,304
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 47024 - Posted: 19 Apr 2017, 0:24:07 UTC - in response to Message 47021.  

Thanks for your help.

Have you tried re-running the original installer for that exact version, and then choosing to uninstall during the installer, or maybe repair, or maybe re-install ? Try all the options, using the original installer.


That's the suggestion I've been talking about. Usually it makes sense and sometimes works fine, but in my case, when I try to install always I get the same message whether I use the original version or a new one.
ID: 47024 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 47025 - Posted: 19 Apr 2017, 1:00:24 UTC - in response to Message 47024.  
Last modified: 19 Apr 2017, 1:11:59 UTC

When using the original installer ... Do you get any options for "Repair" or "Uninstall" or "Install"? Please try to be a bit more descriptive, with exact details, on what you've tried. :)

ALSO

If you can't get the original installer "options in the UI" to work, try this:
- Run the original installer (but don't click anything in it) (I found it here: https://www.virtualbox.org/wiki/Download_Old_Builds_4_3_pre24 )
- Open File Explorer, browse to: C:\Users\{User_Name}\AppData\Local\Temp
- See if you have a "VirtualBox" folder there. If so, copy it to your desktop. It should have the .msi file you needed
- Exit the installer
- Reattempt to uninstall, and if you get prompted for the .msi file, try to have it browse to find it in the folder on your desktop

Any help?
ID: 47025 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Lluis

Send message
Joined: 22 Feb 14
Posts: 26
Credit: 672,639,304
RAC: 0
Level
Lys
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 47035 - Posted: 19 Apr 2017, 18:19:14 UTC - in response to Message 47025.  

... try this:
- Run the original installer (but don't click anything in it)
- Open File Explorer, browse to: C:\Users\{User_Name}\AppData\Local\Temp
- See if you have a "VirtualBox" folder there. If so, copy it to your desktop. It should have the .msi file you needed
- Exit the installer
- Reattempt to uninstall, and if you get prompted for the .msi file, try to have it browse to find it in the folder on your desktop


It has worked. Now I am going to wait for the finish of the ongoing tasks to install VM .
I thought I had tried this trick before but surely I did not do well. Following your instructions has been very easy.
Many thanks.
ID: 47035 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 11 Oct 08
Posts: 1127
Credit: 1,901,927,545
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 47036 - Posted: 19 Apr 2017, 19:39:28 UTC

You're welcome. I have quite a bit of VirtualBox experience in Windows.
ID: 47036 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile robertmiles

Send message
Joined: 16 Apr 09
Posts: 503
Credit: 769,991,668
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 47651 - Posted: 23 Jul 2017, 0:55:58 UTC
Last modified: 23 Jul 2017, 1:01:47 UTC

I'm currently running a rather long RNA World VM task on one of my computers. 38 days elapsed so far, currently expected to run for another 60 days according to BOINC Manager. Its behavior suggests that the total run time will be closer to 120 days, though.

The 5.0.* versions that can be downloaded with BOINC do not work well; expect to have to install a 5.1.* version to make it work well. I'm currently using 5.1.22 on the computer where it is in use and 5.1.18 on my other computer.

These task cannot run simultaneously with an MT (multi-threaded) task from Cosmology@Home. BOINC Manager must suspend one to run the other, so usually both run mostly in priority mode.

One of the input files must be a light-weight operating system, usually Linux, set up to run in the VM environment. However, this file rarely needs to change for other RNA World tasks, so downloading it once per client computer should be enough.

Checkpoints are rather large, close to 700 MB each. Normally, only one is kept, so a failure while writing a checkpoint often does not leave any usable checkpoint.

Applications that run inside the VM appear to be 32 bit only.

I've never programmed for a VM environment, or for any flavor of Linux other then Linux emulators that run under Windows.
ID: 47651 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3

Message boards : News : do you have any experience with running a VM based application in BOINC?

©2025 Universitat Pompeu Fabra