KWSN Orbiting Fortress Forum Index KWSN Orbiting Fortress
KWSN Distributed Computing Teams forum
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

GPU PotM December 2013 => Collatz Conjecture
Goto page 1, 2, 3, 4  Next
 
Post new topic   Reply to topic    KWSN Orbiting Fortress Forum Index -> KWSN BOINC'ers
View previous topic :: View next topic  
Author Message
LanDroid
Prince
Prince


Joined: 11 Jun 2002
Posts: 4476
Location: Cincinnati, OH U.S.

PostPosted: Sat Nov 30, 2013 4:14 pm    Post subject: GPU PotM December 2013 => Collatz Conjecture Reply with quote

Quote:
Collatz Conjecture is a research project that uses Internet-connected computers to do research in mathematics, specifically testing the Collatz Conjecture also known as 3x+1 or HOTPO (half or triple plus one). You can participate by downloading and running a free program on your computer.

Collatz Conjecture is based in Wood Dale, Illinois, USA and continues the work of the previous 3x+1@home BOINC project which ended in 2008. It can run on an nVidia GPU, ATI GPU, Intel GPU, or Intel or AMD CPU.

http://boinc.thesonntags.com/collatz/


Badges:
Bronze - 100K
Silver - 1M
Gold - 5M
Amethyst - 20M
Ruby - 100M
Sapphire - 500M
Emerald - 2B

Starting stats:
22nd Place
1,856,871,032 Total points
7,306,382. daily average over past week
7,699,704 RAC 9th Place
14th Place Formula Boinc
Back to top
View user's profile Send private message Visit poster's website AIM Address
branjo
Prince
Prince


Joined: 05 Jan 2006
Posts: 746
Location: Slovakia

PostPosted: Sun Dec 01, 2013 3:39 pm    Post subject: Reply with quote

Solo Collatz Pending? I would like to get the stuff they are smoking #ni-1

OK, solo collatz validator is down Embarassed
_________________





Last edited by branjo on Sun Dec 01, 2013 3:40 pm; edited 1 time in total
Back to top
View user's profile Send private message Visit poster's website
Plomos
Prince
Prince


Joined: 26 Apr 2011
Posts: 859

PostPosted: Sun Dec 01, 2013 3:40 pm    Post subject: Reply with quote

Headed towards my gold badge in this. Already have quite a few pending, so points should start jumping pretty good. BADGES
_________________

Back to top
View user's profile Send private message
lvanst
Baron
Baron


Joined: 31 Jan 2013
Posts: 152
Location: Phoenix, AZ (yes, it's hot here)

PostPosted: Mon Dec 02, 2013 12:43 am    Post subject: Reply with quote

Knights,

Can someone post a sample Collatz app_config.xml ?

I can only get a basic config running, no sub apps for ATI(opencl) and Nvidia(Cuda) as they both have the exact same app name Sad

So I'm stuck with this:
<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>1</gpu_usage>
<cpu_usage>.60</cpu_usage>
</gpu_versions>
</app>
</app_config>

...and that's only valid for the ATI WUs #Mad


_________________
Back to top
View user's profile Send private message
branjo
Prince
Prince


Joined: 05 Jan 2006
Posts: 746
Location: Slovakia

PostPosted: Mon Dec 02, 2013 4:20 am    Post subject: Reply with quote

What do you want app_config to do for you?

#ni-2
_________________



Back to top
View user's profile Send private message Visit poster's website
branjo
Prince
Prince


Joined: 05 Jan 2006
Posts: 746
Location: Slovakia

PostPosted: Mon Dec 02, 2013 3:55 pm    Post subject: Reply with quote

Quote:
Collatz Conjecture
Collatz Conjecture is temporarily shut down for maintenance. Please try again


Rolling Eyes
Back to top
View user's profile Send private message Visit poster's website
PhastPhred
Prince
Prince


Joined: 22 Mar 2006
Posts: 6017
Location: Northwest AR (USA)

PostPosted: Mon Dec 02, 2013 4:10 pm    Post subject: Reply with quote

branjo wrote:
Quote:
Collatz Conjecture
Collatz Conjecture is temporarily shut down for maintenance. Please try again


Rolling Eyes

Collatz gives ya a Flsh-Slap Dance...
https://www.youtube.com/watch?v=kWmbXMXns28

_________________
Back to top
View user's profile Send private message Send e-mail Visit poster's website AIM Address Yahoo Messenger MSN Messenger
lvanst
Baron
Baron


Joined: 31 Jan 2013
Posts: 152
Location: Phoenix, AZ (yes, it's hot here)

PostPosted: Mon Dec 02, 2013 11:13 pm    Post subject: Reply with quote

branjo wrote:
What do you want app_config to do for you?

#ni-2


Recognize the difference between the solo_collatz ATI/OpenCL and Nvidia/Cuda apps...

On my node the ATI App uses .6 CPU, and the Cuda App uses .05 CPU

Is it possible to create an app_config that can job-cost both accurately?
_________________
Back to top
View user's profile Send private message
branjo
Prince
Prince


Joined: 05 Jan 2006
Posts: 746
Location: Slovakia

PostPosted: Tue Dec 03, 2013 12:37 am    Post subject: Reply with quote

AFAIK, in app_config you can specify the number of concurrent tasks per application. Thatīs why I asked what do you want from it. Would you like to run more concurrent GPU WU īs than default one per GPGPU?

Cheers Smile
_________________



Back to top
View user's profile Send private message Visit poster's website
Yankton
Prince
Prince


Joined: 27 Sep 2008
Posts: 1702
Location: California

PostPosted: Tue Dec 03, 2013 1:21 am    Post subject: Reply with quote

Couple of notes, which you may already know. Setting the CPU usage in an app_info file won't limit or change how much of a cpu the gpu task uses. If you run multiple tasks and you set this to a fraction of a cpu core it uses that to stop shrubbing on cores. For example, if you run 4 simultaneous tasks using .6 cpus (for the ati app you mentioned - are you sure it isn't .06?). That would be 2.4 CPU cores needed so it will set 2 cores aside for the the 4 gpu tasks (In theory). Now if you wind up using only say .5 cpu cores for the 4 tasks combined then you have needlessly disabled part of your cpu shrubbing. I have a low end and a high end card and I have found the cpu usage listed by the app to be useless on both. I have found it better to simply tell boinc in the manager to use 75% of the CPU cores (for a quad) or 87.5% (for a hyperthreaded quad), which leaves 1 core for gpu tasks and me aimlessly wandering the internets (Set as needed if your gpus need more cores). Unless the gpu apps need some serious cpu usage leave the cpu_usage setting out and only use the gpu_usage (.5 for 2 tasks, .33 for 3 tasks and so on). Use gpu-z to figure out how much of your gpu is used for 1 task, then try it with 2. You won't get it above 99% so just get it close and make sure your card has good cooling. If you use the optimized seti apps they should tell you how to get the app with the same name to work on both cards using the coproc tag and setups for each. I'll try and look an example but I'm at work so I can't see my own stuff atm. With 2 gpus on one system you should be able to get 2 shrubs next to each other with different heights for a two-level effect.

#ni-1
_________________
Some days are worse than others.
Back to top
View user's profile Send private message
LanDroid
Prince
Prince


Joined: 11 Jun 2002
Posts: 4476
Location: Cincinnati, OH U.S.

PostPosted: Tue Dec 03, 2013 8:54 am    Post subject: Reply with quote

I don't use .xml config files at all. Am I wasting many processor cycles? Hope not, 'twould earn me a stint in the comfy chair!

Not sure when I can get started on Collatz - still finishing up one of those large genefer PG WU's. It's in the mode where the more time spent on it increases the estimated time to completion. Confused
Early on I had 23+ hours in, 183+ to go. Now 250 hours in and 61 to go? And the deadline is tomorrow. Mad
_________________
[img]http://stats.free-dc.org/cpidtagb.php?cpid=6533a276b3a1dde393be350eb3cfda70&theme=16&cols=5/.png[/img]
[img]http://stats.free-dc.org/badgesbanner.php?cpid=6533a276b3a1dde393be350eb3cfda70/.png[/img]
Back to top
View user's profile Send private message Visit poster's website AIM Address
lvanst
Baron
Baron


Joined: 31 Jan 2013
Posts: 152
Location: Phoenix, AZ (yes, it's hot here)

PostPosted: Tue Dec 03, 2013 7:57 pm    Post subject: Reply with quote

Sorry, I must be doing a poor job of explaining...

solo_collatz is a single wrapper/app with several underlying applications.

Those applications have different CPU requirements for execution.

For GPU apps (ATI/OpenCL or Nvidia/Cuda), the majority of the work is done by the GPU, with only a small portion of the work being done by a CPU.

If you don't create an app_config.xml file, BOINC assumes (incorrectly) that you need an entire CPU fully dedicated to each instance of the GPU application.

This is inefficient, as it leaves CPU unused...

On my node the Collatz ATI App uses .6 CPU, and the Collatz Cuda App uses .05 CPU

So, I actually need less than 1 CPU to drive both of my GPUs at 100% capacity. This leaves me an additional CPU for our current Skynet/POGS POTM.

However, the point is moot if I cannot get BOINC to understand that solo_collatz has two underlying apps with very different CPU requirements.

So, I'm looking for the app_config grand master that can tell us how to extend the current XML construct to properly allocate available CPU to those two Collatz apps (ATI/OpenCL or Nvidia/Cuda)...

Some people call it OCD, I call it the quest for optimal execution...
_________________
Back to top
View user's profile Send private message
Yankton
Prince
Prince


Joined: 27 Sep 2008
Posts: 1702
Location: California

PostPosted: Tue Dec 03, 2013 8:54 pm    Post subject: Reply with quote

Landroid, most of the gpu apps use between 70 and 95% of the gpu. Some people have them run 2 or 3 or more (depending on memory, requirements of the app, blah...) to push that up to 99% It pushes your card a bit harder but if you're good with that...

Ivanst,

Are you sure it's blocking a core on you? I haven't had that happen yet. If it's not you could use the locations on the collatz page (set home to run just the one app on one card and set work to run a different app on both cards or however you want it set up.


Also check this thread.

http://boinc.thesonntags.com/collatz/forum_thread.php?id=1058#17504
_________________
Some days are worse than others.
Back to top
View user's profile Send private message
lvanst
Baron
Baron


Joined: 31 Jan 2013
Posts: 152
Location: Phoenix, AZ (yes, it's hot here)

PostPosted: Tue Dec 03, 2013 10:18 pm    Post subject: Reply with quote


_________________
Back to top
View user's profile Send private message
Yankton
Prince
Prince


Joined: 27 Sep 2008
Posts: 1702
Location: California

PostPosted: Tue Dec 03, 2013 10:37 pm    Post subject: Reply with quote

This is for running cuda and ati on distrgen. Couldn't find an example from collatz. I don't have an ati card so it's hard for me to experiment with it. This might have what you need though.


Code:
- <app_info>
- <app>
  <name>distrrtgen</name>
  <user_friendly_name>distrrtgen</user_friendly_name>
  </app>
- <file_info>
  <name>distrrtgen_cuda.exe</name>
  <executable />
  </file_info>
- <file_info>
  <name>charset.txt</name>
  </file_info>
- <file_info>
  <name>cudart32_50_35.dll</name>
  </file_info>
- <file_info>
  <name>distrrtgen_3.52_windows_intelx86__opencl_ati_101.exe</name>
  <executable />
  </file_info>
- <file_info>
  <name>kernel_md5_3.52_x86_windows_intelx86__opencl_ati_101.cl</name>
  </file_info>
- <file_info>
  <name>kernel_mysqlsha1_3.52_x86_windows_intelx86__opencl_ati_101.cl</name>
  </file_info>
- <file_info>
  <name>kernel_ntlm_3.52_x86_windows_intelx86__opencl_ati_101.cl</name>
  </file_info>
- <app_version>
  <app_name>distrrtgen</app_name>
  <version_num>348</version_num>
  <platform>windows_intelx86</platform>
  <avg_ncpus>0.05</avg_ncpus>
  <max_ncpus>1.0</max_ncpus>
  <flops>1e+11</flops>
  <plan_class>cuda50</plan_class>
  <api_version>6.13.4</api_version>
- <file_ref>
  <file_name>distrrtgen_cuda.exe</file_name>
  <open_name>distrrtgen.exe</open_name>
  <copy_file />
  <main_program />
  </file_ref>
- <file_ref>
  <file_name>charset.txt</file_name>
  <open_name>charset.txt</open_name>
  <copy_file />
  </file_ref>
- <file_ref>
  <file_name>cudart32_50_35.dll</file_name>
  <open_name>cudart32_50_35.dll</open_name>
  <copy_file />
  </file_ref>
- <coproc>
  <type>CUDA</type>
  <count>1.000000</count>
  </coproc>
  <gpu_ram>134217728.000000</gpu_ram>
  </app_version>
- <app_version>
  <app_name>distrrtgen</app_name>
  <version_num>352</version_num>
  <platform>windows_intelx86</platform>
  <avg_ncpus>1.000000</avg_ncpus>
  <max_ncpus>1.000000</max_ncpus>
  <flops>1e+11</flops>
  <plan_class>opencl_ati_101</plan_class>
  <api_version>7.1.0</api_version>
- <file_ref>
  <file_name>distrrtgen_3.52_windows_intelx86__opencl_ati_101.exe</file_name>
  <open_name>distrrtgen.exe</open_name>
  <copy_file />
  <main_program />
  </file_ref>
- <file_ref>
  <file_name>charset.txt</file_name>
  <open_name>charset.txt</open_name>
  <copy_file />
  </file_ref>
- <file_ref>
  <file_name>kernel_md5_3.52_x86_windows_intelx86__opencl_ati_101.cl</file_name>
  <open_name>kernel_md5.cl</open_name>
  <copy_file />
  </file_ref>
- <file_ref>
  <file_name>kernel_mysqlsha1_3.52_x86_windows_intelx86__opencl_ati_101.cl</file_name>
  <open_name>kernel_mysqlsha1.cl</open_name>
  <copy_file />
  </file_ref>
- <file_ref>
  <file_name>kernel_ntlm_3.52_x86_windows_intelx86__opencl_ati_101.cl</file_name>
  <open_name>kernel_ntlm.cl</open_name>
  <copy_file />
  </file_ref>
- <coproc>
  <type>ATI</type>
  <count>1.000000</count>
  </coproc>
  <gpu_ram>268435456.000000</gpu_ram>
  </app_version>
  </app_info>

_________________
Some days are worse than others.
Back to top
View user's profile Send private message
lvanst
Baron
Baron


Joined: 31 Jan 2013
Posts: 152
Location: Phoenix, AZ (yes, it's hot here)

PostPosted: Tue Dec 03, 2013 10:49 pm    Post subject: Reply with quote

Yes! That's where I'm headed...

I can't live with this inaccuracy! I've grown to expect more from me Rolling Eyes


_________________
Back to top
View user's profile Send private message
LanDroid
Prince
Prince


Joined: 11 Jun 2002
Posts: 4476
Location: Cincinnati, OH U.S.

PostPosted: Wed Dec 04, 2013 10:04 am    Post subject: Reply with quote

KWSN passed Team USA. We crunched nearly 11 million yesterday and already 12 million today. Shocked

'Stones:
DoW 90,000,000
jAs 25,000,000
lvanst 8,000,000
Yankton 3,500,000
Sir Mifun Fat in a Right Place 3,500,000
Plomos 1,600,000
JumpinJohnny 400,000
Medijate 350,000
PhastPhred 350,000
CGKIII 200,000
Back to top
View user's profile Send private message Visit poster's website AIM Address
branjo
Prince
Prince


Joined: 05 Jan 2006
Posts: 746
Location: Slovakia

PostPosted: Wed Dec 04, 2013 1:56 pm    Post subject: Reply with quote

LanDroid wrote:
KWSN passed Team USA. We crunched nearly 11 million yesterday and already 12 million today. Shocked

'Stones:
DoW 90,000,000
jAs 25,000,000
lvanst 8,000,000
Yankton 3,500,000
Sir Mifun Fat in a Right Place 3,500,000
Plomos 1,600,000
JumpinJohnny 400,000
Medijate 350,000
PhastPhred 350,000
CGKIII 200,000


It is because they turned Solo_Collatz Validator on yesterday #evil Nice results anyway #ni-1
_________________



Back to top
View user's profile Send private message Visit poster's website
branjo
Prince
Prince


Joined: 05 Jan 2006
Posts: 746
Location: Slovakia

PostPosted: Wed Dec 04, 2013 3:52 pm    Post subject: Reply with quote

lvanst wrote:
Sorry, I must be doing a poor job of explaining...

solo_collatz is a single wrapper/app with several underlying applications.

Those applications have different CPU requirements for execution.

For GPU apps (ATI/OpenCL or Nvidia/Cuda), the majority of the work is done by the GPU, with only a small portion of the work being done by a CPU.

If you don't create an app_config.xml file, BOINC assumes (incorrectly) that you need an entire CPU fully dedicated to each instance of the GPU application.

This is inefficient, as it leaves CPU unused...

On my node the Collatz ATI App uses .6 CPU, and the Collatz Cuda App uses .05 CPU

So, I actually need less than 1 CPU to drive both of my GPUs at 100% capacity. This leaves me an additional CPU for our current Skynet/POGS POTM.

However, the point is moot if I cannot get BOINC to understand that solo_collatz has two underlying apps with very different CPU requirements.

So, I'm looking for the app_config grand master that can tell us how to extend the current XML construct to properly allocate available CPU to those two Collatz apps (ATI/OpenCL or Nvidia/Cuda)...

Some people call it OCD, I call it the quest for optimal execution...


The default CPU share for my AMD 7750 is 2% (0.02 CPU / 1 ATI GPU), so I am happily running 8 x theSkynet POGS + 1x solo_collatz ATI with GPU utilization of circa 28% (BURN THE WITCH!).

Going to try some app_config (DO NOT CONFUSE WITH APP_INFO GIVEN BY YANKTON - THEY ARE 2 DIFFERENT WAYS TO INCREASE THE NUMBER OF GPU TASKS PER GPGPU - APP_CONFIG IS MUCH EASIER AND MUCH MORE ACCEPTABLE BY PROJECTS).

ETA1: This is my app_config to run 2 concurrent tasks on 1 AMD/ATI GPGPU:

<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>.5</gpu_usage>
<cpu_usage>.02/cpu_usage>
</gpu_versions>
</app>
</app_config>

Where:
<gpu_usage>.5</gpu_usage> means 1 (available GPGPU) / 2 (desired concurrent GPU tasks) = 0.5
<cpu_usage>.02/cpu_usage> means usage of 0.02 CPU per 1 GPU task (total 0.04 of 1 CPU thread)

Plus still running 8 POGS tasks on my i7-3770 (4 cores / 8 threads CPU). GPU utilization is approximately 78%.

ETA2: For 3 concurrent GPU tasks using app_config:

<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>.333333</gpu_usage>
<cpu_usage>.02/cpu_usage>
</gpu_versions>
</app>
</app_config>

I still run 8 POGS tasks (less 0.06 CPU dedicated to 3 GPU tasks)...

GPU utilization is 99%.

Important: never round up <gpu_usage>.333333</gpu_usage> and <cpu_usage>.02/cpu_usage>. E.g., if you want to run 3 GPU tasks on 2 GPGPU's, put <gpu_usage>.666666</gpu_usage>, not .666667

Since you have 2 GPU's, try this app_config (NOT APP_INFO!):

<app_config>
<app>
<name>solo_collatz</name>
<gpu_versions>
<gpu_usage>.5</gpu_usage>
<cpu_usage>.02/cpu_usage>
</gpu_versions>
</app>
</app_config>

I guess it should run 4 GPU tasks using 0.08 CPU, so you will utilize all your CPU cores/threads for POGS Wink

Give me a feedback, please #ni-2

Cheers #ni-1

ETA3: update you AMD and nVIDIA drivers Smile

ETA4: running this on BOINC 7.0.64
_________________



Back to top
View user's profile Send private message Visit poster's website
Yankton
Prince
Prince


Joined: 27 Sep 2008
Posts: 1702
Location: California

PostPosted: Wed Dec 04, 2013 5:21 pm    Post subject: Reply with quote

I run a mixture of app_infos and app_configs. You tend to need the app_infos if you don't run the default apps (app_config doesn't always seem to work and there is a lack of info on this - maybe something set by a project). This is the app_config I use for collatz (runs 2 collatz tasks at a time):

Code:
<app_config>
<app>
<name>solo_collatz</name>
<max_concurrent>2</max_concurrent>
<gpu_versions>
<gpu_usage>0.5</gpu_usage>
<cpu_usage>0.02</cpu_usage>
</gpu_versions>
</app>
<app>
<name>collatz</name>
<max_concurrent>2</max_concurrent>
<gpu_versions>
<gpu_usage>0.5</gpu_usage>
<cpu_usage>0.02</cpu_usage>
</gpu_versions>
</app>
<app>
<name>mini_collatz</name>
<max_concurrent>2</max_concurrent>
<gpu_versions>
<gpu_usage>0.5</gpu_usage>
<cpu_usage>0.02</cpu_usage>
</gpu_versions>
</app>
</app_config>


I also tweaked the three config config files for collatz as well with:

Code:
verbose=1
items_per_kernel=22
kernels_per_reduction=9
threads=10
sleep=1
solo=0


This combo does make the desktop lag a bit. You could try it with threads set to 9 or 8 and see how it goes.
_________________
Some days are worse than others.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    KWSN Orbiting Fortress Forum Index -> KWSN BOINC'ers All times are GMT - 5 Hours
Goto page 1, 2, 3, 4  Next
Page 1 of 4

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group
Optimized Seti@Home App | BOINC Stats