View previous topic :: View next topic |
Author |
Message |
LanDroid Prince


Joined: 11 Jun 2002 Posts: 4476 Location: Cincinnati, OH U.S.
|
Posted: Sat Nov 30, 2013 4:14 pm Post subject: GPU PotM December 2013 => Collatz Conjecture |
|
|
Quote: | Collatz Conjecture is a research project that uses Internet-connected computers to do research in mathematics, specifically testing the Collatz Conjecture also known as 3x+1 or HOTPO (half or triple plus one). You can participate by downloading and running a free program on your computer.
Collatz Conjecture is based in Wood Dale, Illinois, USA and continues the work of the previous 3x+1@home BOINC project which ended in 2008. It can run on an nVidia GPU, ATI GPU, Intel GPU, or Intel or AMD CPU.
http://boinc.thesonntags.com/collatz/ |
Badges:
Bronze - 100K
Silver - 1M
Gold - 5M
Amethyst - 20M
Ruby - 100M
Sapphire - 500M
Emerald - 2B
Starting stats:
22nd Place
1,856,871,032 Total points
7,306,382. daily average over past week
7,699,704 RAC 9th Place
14th Place Formula Boinc |
|
Back to top |
|
 |
branjo Prince


Joined: 05 Jan 2006 Posts: 746 Location: Slovakia
|
Posted: Sun Dec 01, 2013 3:39 pm Post subject: |
|
|
Solo Collatz Pending? I would like to get the stuff they are smoking
OK, solo collatz validator is down  _________________
  

Last edited by branjo on Sun Dec 01, 2013 3:40 pm; edited 1 time in total |
|
Back to top |
|
 |
Plomos Prince

Joined: 26 Apr 2011 Posts: 859
|
Posted: Sun Dec 01, 2013 3:40 pm Post subject: |
|
|
Headed towards my gold badge in this. Already have quite a few pending, so points should start jumping pretty good. BADGES _________________
 |
|
Back to top |
|
 |
lvanst Baron


Joined: 31 Jan 2013 Posts: 152 Location: Phoenix, AZ (yes, it's hot here)
|
Posted: Mon Dec 02, 2013 12:43 am Post subject: |
|
|
Knights,
Can someone post a sample Collatz app_config.xml ?
I can only get a basic config running, no sub apps for ATI(opencl) and Nvidia(Cuda) as they both have the exact same app name
So I'm stuck with this:
<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>1</gpu_usage>
<cpu_usage>.60</cpu_usage>
</gpu_versions>
</app>
</app_config>
...and that's only valid for the ATI WUs
 _________________
 |
|
Back to top |
|
 |
branjo Prince


Joined: 05 Jan 2006 Posts: 746 Location: Slovakia
|
Posted: Mon Dec 02, 2013 4:20 am Post subject: |
|
|
What do you want app_config to do for you?
 _________________
  
 |
|
Back to top |
|
 |
branjo Prince


Joined: 05 Jan 2006 Posts: 746 Location: Slovakia
|
Posted: Mon Dec 02, 2013 3:55 pm Post subject: |
|
|
Quote: | Collatz Conjecture
Collatz Conjecture is temporarily shut down for maintenance. Please try again |
 |
|
Back to top |
|
 |
PhastPhred Prince


Joined: 22 Mar 2006 Posts: 6017 Location: Northwest AR (USA)
|
Posted: Mon Dec 02, 2013 4:10 pm Post subject: |
|
|
branjo wrote: | Quote: | Collatz Conjecture
Collatz Conjecture is temporarily shut down for maintenance. Please try again |
 |
Collatz gives ya a Flsh-Slap Dance...
https://www.youtube.com/watch?v=kWmbXMXns28
 _________________
 |
|
Back to top |
|
 |
lvanst Baron


Joined: 31 Jan 2013 Posts: 152 Location: Phoenix, AZ (yes, it's hot here)
|
Posted: Mon Dec 02, 2013 11:13 pm Post subject: |
|
|
branjo wrote: | What do you want app_config to do for you?
 |
Recognize the difference between the solo_collatz ATI/OpenCL and Nvidia/Cuda apps...
On my node the ATI App uses .6 CPU, and the Cuda App uses .05 CPU
Is it possible to create an app_config that can job-cost both accurately? _________________
 |
|
Back to top |
|
 |
branjo Prince


Joined: 05 Jan 2006 Posts: 746 Location: Slovakia
|
Posted: Tue Dec 03, 2013 12:37 am Post subject: |
|
|
AFAIK, in app_config you can specify the number of concurrent tasks per application. Thatīs why I asked what do you want from it. Would you like to run more concurrent GPU WU īs than default one per GPGPU?
Cheers  _________________
  
 |
|
Back to top |
|
 |
Yankton Prince


Joined: 27 Sep 2008 Posts: 1702 Location: California
|
Posted: Tue Dec 03, 2013 1:21 am Post subject: |
|
|
Couple of notes, which you may already know. Setting the CPU usage in an app_info file won't limit or change how much of a cpu the gpu task uses. If you run multiple tasks and you set this to a fraction of a cpu core it uses that to stop shrubbing on cores. For example, if you run 4 simultaneous tasks using .6 cpus (for the ati app you mentioned - are you sure it isn't .06?). That would be 2.4 CPU cores needed so it will set 2 cores aside for the the 4 gpu tasks (In theory). Now if you wind up using only say .5 cpu cores for the 4 tasks combined then you have needlessly disabled part of your cpu shrubbing. I have a low end and a high end card and I have found the cpu usage listed by the app to be useless on both. I have found it better to simply tell boinc in the manager to use 75% of the CPU cores (for a quad) or 87.5% (for a hyperthreaded quad), which leaves 1 core for gpu tasks and me aimlessly wandering the internets (Set as needed if your gpus need more cores). Unless the gpu apps need some serious cpu usage leave the cpu_usage setting out and only use the gpu_usage (.5 for 2 tasks, .33 for 3 tasks and so on). Use gpu-z to figure out how much of your gpu is used for 1 task, then try it with 2. You won't get it above 99% so just get it close and make sure your card has good cooling. If you use the optimized seti apps they should tell you how to get the app with the same name to work on both cards using the coproc tag and setups for each. I'll try and look an example but I'm at work so I can't see my own stuff atm. With 2 gpus on one system you should be able to get 2 shrubs next to each other with different heights for a two-level effect.
 _________________ Some days are worse than others. |
|
Back to top |
|
 |
LanDroid Prince


Joined: 11 Jun 2002 Posts: 4476 Location: Cincinnati, OH U.S.
|
Posted: Tue Dec 03, 2013 8:54 am Post subject: |
|
|
I don't use .xml config files at all. Am I wasting many processor cycles? Hope not, 'twould earn me a stint in the comfy chair!
Not sure when I can get started on Collatz - still finishing up one of those large genefer PG WU's. It's in the mode where the more time spent on it increases the estimated time to completion.
Early on I had 23+ hours in, 183+ to go. Now 250 hours in and 61 to go? And the deadline is tomorrow.  _________________ [img]http://stats.free-dc.org/cpidtagb.php?cpid=6533a276b3a1dde393be350eb3cfda70&theme=16&cols=5/.png[/img]
[img]http://stats.free-dc.org/badgesbanner.php?cpid=6533a276b3a1dde393be350eb3cfda70/.png[/img] |
|
Back to top |
|
 |
lvanst Baron


Joined: 31 Jan 2013 Posts: 152 Location: Phoenix, AZ (yes, it's hot here)
|
Posted: Tue Dec 03, 2013 7:57 pm Post subject: |
|
|
Sorry, I must be doing a poor job of explaining...
solo_collatz is a single wrapper/app with several underlying applications.
Those applications have different CPU requirements for execution.
For GPU apps (ATI/OpenCL or Nvidia/Cuda), the majority of the work is done by the GPU, with only a small portion of the work being done by a CPU.
If you don't create an app_config.xml file, BOINC assumes (incorrectly) that you need an entire CPU fully dedicated to each instance of the GPU application.
This is inefficient, as it leaves CPU unused...
On my node the Collatz ATI App uses .6 CPU, and the Collatz Cuda App uses .05 CPU
So, I actually need less than 1 CPU to drive both of my GPUs at 100% capacity. This leaves me an additional CPU for our current Skynet/POGS POTM.
However, the point is moot if I cannot get BOINC to understand that solo_collatz has two underlying apps with very different CPU requirements.
So, I'm looking for the app_config grand master that can tell us how to extend the current XML construct to properly allocate available CPU to those two Collatz apps (ATI/OpenCL or Nvidia/Cuda)...
Some people call it OCD, I call it the quest for optimal execution...  _________________
 |
|
Back to top |
|
 |
Yankton Prince


Joined: 27 Sep 2008 Posts: 1702 Location: California
|
Posted: Tue Dec 03, 2013 8:54 pm Post subject: |
|
|
Landroid, most of the gpu apps use between 70 and 95% of the gpu. Some people have them run 2 or 3 or more (depending on memory, requirements of the app, blah...) to push that up to 99% It pushes your card a bit harder but if you're good with that...
Ivanst,
Are you sure it's blocking a core on you? I haven't had that happen yet. If it's not you could use the locations on the collatz page (set home to run just the one app on one card and set work to run a different app on both cards or however you want it set up.
Also check this thread.
http://boinc.thesonntags.com/collatz/forum_thread.php?id=1058#17504 _________________ Some days are worse than others. |
|
Back to top |
|
 |
lvanst Baron


Joined: 31 Jan 2013 Posts: 152 Location: Phoenix, AZ (yes, it's hot here)
|
Posted: Tue Dec 03, 2013 10:18 pm Post subject: |
|
|
 _________________
 |
|
Back to top |
|
 |
Yankton Prince


Joined: 27 Sep 2008 Posts: 1702 Location: California
|
Posted: Tue Dec 03, 2013 10:37 pm Post subject: |
|
|
This is for running cuda and ati on distrgen. Couldn't find an example from collatz. I don't have an ati card so it's hard for me to experiment with it. This might have what you need though.
Code: | - <app_info>
- <app>
<name>distrrtgen</name>
<user_friendly_name>distrrtgen</user_friendly_name>
</app>
- <file_info>
<name>distrrtgen_cuda.exe</name>
<executable />
</file_info>
- <file_info>
<name>charset.txt</name>
</file_info>
- <file_info>
<name>cudart32_50_35.dll</name>
</file_info>
- <file_info>
<name>distrrtgen_3.52_windows_intelx86__opencl_ati_101.exe</name>
<executable />
</file_info>
- <file_info>
<name>kernel_md5_3.52_x86_windows_intelx86__opencl_ati_101.cl</name>
</file_info>
- <file_info>
<name>kernel_mysqlsha1_3.52_x86_windows_intelx86__opencl_ati_101.cl</name>
</file_info>
- <file_info>
<name>kernel_ntlm_3.52_x86_windows_intelx86__opencl_ati_101.cl</name>
</file_info>
- <app_version>
<app_name>distrrtgen</app_name>
<version_num>348</version_num>
<platform>windows_intelx86</platform>
<avg_ncpus>0.05</avg_ncpus>
<max_ncpus>1.0</max_ncpus>
<flops>1e+11</flops>
<plan_class>cuda50</plan_class>
<api_version>6.13.4</api_version>
- <file_ref>
<file_name>distrrtgen_cuda.exe</file_name>
<open_name>distrrtgen.exe</open_name>
<copy_file />
<main_program />
</file_ref>
- <file_ref>
<file_name>charset.txt</file_name>
<open_name>charset.txt</open_name>
<copy_file />
</file_ref>
- <file_ref>
<file_name>cudart32_50_35.dll</file_name>
<open_name>cudart32_50_35.dll</open_name>
<copy_file />
</file_ref>
- <coproc>
<type>CUDA</type>
<count>1.000000</count>
</coproc>
<gpu_ram>134217728.000000</gpu_ram>
</app_version>
- <app_version>
<app_name>distrrtgen</app_name>
<version_num>352</version_num>
<platform>windows_intelx86</platform>
<avg_ncpus>1.000000</avg_ncpus>
<max_ncpus>1.000000</max_ncpus>
<flops>1e+11</flops>
<plan_class>opencl_ati_101</plan_class>
<api_version>7.1.0</api_version>
- <file_ref>
<file_name>distrrtgen_3.52_windows_intelx86__opencl_ati_101.exe</file_name>
<open_name>distrrtgen.exe</open_name>
<copy_file />
<main_program />
</file_ref>
- <file_ref>
<file_name>charset.txt</file_name>
<open_name>charset.txt</open_name>
<copy_file />
</file_ref>
- <file_ref>
<file_name>kernel_md5_3.52_x86_windows_intelx86__opencl_ati_101.cl</file_name>
<open_name>kernel_md5.cl</open_name>
<copy_file />
</file_ref>
- <file_ref>
<file_name>kernel_mysqlsha1_3.52_x86_windows_intelx86__opencl_ati_101.cl</file_name>
<open_name>kernel_mysqlsha1.cl</open_name>
<copy_file />
</file_ref>
- <file_ref>
<file_name>kernel_ntlm_3.52_x86_windows_intelx86__opencl_ati_101.cl</file_name>
<open_name>kernel_ntlm.cl</open_name>
<copy_file />
</file_ref>
- <coproc>
<type>ATI</type>
<count>1.000000</count>
</coproc>
<gpu_ram>268435456.000000</gpu_ram>
</app_version>
</app_info> |
_________________ Some days are worse than others. |
|
Back to top |
|
 |
lvanst Baron


Joined: 31 Jan 2013 Posts: 152 Location: Phoenix, AZ (yes, it's hot here)
|
Posted: Tue Dec 03, 2013 10:49 pm Post subject: |
|
|
Yes! That's where I'm headed...
I can't live with this inaccuracy! I've grown to expect more from me
 _________________
 |
|
Back to top |
|
 |
LanDroid Prince


Joined: 11 Jun 2002 Posts: 4476 Location: Cincinnati, OH U.S.
|
Posted: Wed Dec 04, 2013 10:04 am Post subject: |
|
|
KWSN passed Team USA. We crunched nearly 11 million yesterday and already 12 million today.
'Stones:
DoW 90,000,000
jAs 25,000,000
lvanst 8,000,000
Yankton 3,500,000
Sir Mifun Fat in a Right Place 3,500,000
Plomos 1,600,000
JumpinJohnny 400,000
Medijate 350,000
PhastPhred 350,000
CGKIII 200,000 |
|
Back to top |
|
 |
branjo Prince


Joined: 05 Jan 2006 Posts: 746 Location: Slovakia
|
Posted: Wed Dec 04, 2013 1:56 pm Post subject: |
|
|
LanDroid wrote: | KWSN passed Team USA. We crunched nearly 11 million yesterday and already 12 million today.
'Stones:
DoW 90,000,000
jAs 25,000,000
lvanst 8,000,000
Yankton 3,500,000
Sir Mifun Fat in a Right Place 3,500,000
Plomos 1,600,000
JumpinJohnny 400,000
Medijate 350,000
PhastPhred 350,000
CGKIII 200,000 |
It is because they turned Solo_Collatz Validator on yesterday Nice results anyway  _________________
  
 |
|
Back to top |
|
 |
branjo Prince


Joined: 05 Jan 2006 Posts: 746 Location: Slovakia
|
Posted: Wed Dec 04, 2013 3:52 pm Post subject: |
|
|
lvanst wrote: | Sorry, I must be doing a poor job of explaining...
solo_collatz is a single wrapper/app with several underlying applications.
Those applications have different CPU requirements for execution.
For GPU apps (ATI/OpenCL or Nvidia/Cuda), the majority of the work is done by the GPU, with only a small portion of the work being done by a CPU.
If you don't create an app_config.xml file, BOINC assumes (incorrectly) that you need an entire CPU fully dedicated to each instance of the GPU application.
This is inefficient, as it leaves CPU unused...
On my node the Collatz ATI App uses .6 CPU, and the Collatz Cuda App uses .05 CPU
So, I actually need less than 1 CPU to drive both of my GPUs at 100% capacity. This leaves me an additional CPU for our current Skynet/POGS POTM.
However, the point is moot if I cannot get BOINC to understand that solo_collatz has two underlying apps with very different CPU requirements.
So, I'm looking for the app_config grand master that can tell us how to extend the current XML construct to properly allocate available CPU to those two Collatz apps (ATI/OpenCL or Nvidia/Cuda)...
Some people call it OCD, I call it the quest for optimal execution...  |
The default CPU share for my AMD 7750 is 2% (0.02 CPU / 1 ATI GPU), so I am happily running 8 x theSkynet POGS + 1x solo_collatz ATI with GPU utilization of circa 28% (BURN THE WITCH!).
Going to try some app_config (DO NOT CONFUSE WITH APP_INFO GIVEN BY YANKTON - THEY ARE 2 DIFFERENT WAYS TO INCREASE THE NUMBER OF GPU TASKS PER GPGPU - APP_CONFIG IS MUCH EASIER AND MUCH MORE ACCEPTABLE BY PROJECTS).
ETA1: This is my app_config to run 2 concurrent tasks on 1 AMD/ATI GPGPU:
<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>.5</gpu_usage>
<cpu_usage>.02/cpu_usage>
</gpu_versions>
</app>
</app_config>
Where:
<gpu_usage>.5</gpu_usage> means 1 (available GPGPU) / 2 (desired concurrent GPU tasks) = 0.5
<cpu_usage>.02/cpu_usage> means usage of 0.02 CPU per 1 GPU task (total 0.04 of 1 CPU thread)
Plus still running 8 POGS tasks on my i7-3770 (4 cores / 8 threads CPU). GPU utilization is approximately 78%.
ETA2: For 3 concurrent GPU tasks using app_config:
<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>.333333</gpu_usage>
<cpu_usage>.02/cpu_usage>
</gpu_versions>
</app>
</app_config>
I still run 8 POGS tasks (less 0.06 CPU dedicated to 3 GPU tasks)...
GPU utilization is 99%.
Important: never round up <gpu_usage>.333333</gpu_usage> and <cpu_usage>.02/cpu_usage>. E.g., if you want to run 3 GPU tasks on 2 GPGPU's, put <gpu_usage>.666666</gpu_usage>, not .666667
Since you have 2 GPU's, try this app_config (NOT APP_INFO!):
<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>.5</gpu_usage>
<cpu_usage>.02/cpu_usage>
</gpu_versions>
</app>
</app_config>
I guess it should run 4 GPU tasks using 0.08 CPU, so you will utilize all your CPU cores/threads for POGS
Give me a feedback, please
Cheers
ETA3: update you AMD and nVIDIA drivers
ETA4: running this on BOINC 7.0.64 _________________
  
 |
|
Back to top |
|
 |
Yankton Prince


Joined: 27 Sep 2008 Posts: 1702 Location: California
|
Posted: Wed Dec 04, 2013 5:21 pm Post subject: |
|
|
I run a mixture of app_infos and app_configs. You tend to need the app_infos if you don't run the default apps (app_config doesn't always seem to work and there is a lack of info on this - maybe something set by a project). This is the app_config I use for collatz (runs 2 collatz tasks at a time):
Code: | <app_config>
<app>
<name>solo_collatz</name>
<max_concurrent>2</max_concurrent>
<gpu_versions>
<gpu_usage>0.5</gpu_usage>
<cpu_usage>0.02</cpu_usage>
</gpu_versions>
</app>
<app>
<name>collatz</name>
<max_concurrent>2</max_concurrent>
<gpu_versions>
<gpu_usage>0.5</gpu_usage>
<cpu_usage>0.02</cpu_usage>
</gpu_versions>
</app>
<app>
<name>mini_collatz</name>
<max_concurrent>2</max_concurrent>
<gpu_versions>
<gpu_usage>0.5</gpu_usage>
<cpu_usage>0.02</cpu_usage>
</gpu_versions>
</app>
</app_config> |
I also tweaked the three config config files for collatz as well with:
Code: | verbose=1
items_per_kernel=22
kernels_per_reduction=9
threads=10
sleep=1
solo=0 |
This combo does make the desktop lag a bit. You could try it with threads set to 9 or 8 and see how it goes. _________________ Some days are worse than others. |
|
Back to top |
|
 |
|