Message boards : Number crunching : RAC cheats, is this a problem
Previous · 1 · 2
Author | Message |
---|---|
Snake Doctor Send message Joined: 17 Sep 05 Posts: 182 Credit: 6,401,938 RAC: 0 |
James wrote I guess one good twist deserves a solid fast spin. We Must look for intelligent life on other planets as, it is becoming increasingly apparent we will not find any on our own. |
Jimi@0wned.org.uk Send message Joined: 10 Mar 06 Posts: 29 Credit: 335,252 RAC: 0 |
Look at: https://boinc.bakerlab.org/rosetta/show_user.php?userid=58151 I know that chew* was running that x2 3800+ at 3.2GHz at least, and that he's using the AMD optimised client. Is there anything wrong in that? I don't think so. It's a very useful reference. By what criteria does einstein@home trim out unlikely benchmarks? Would this disqualify beautifully overclocked machines like this? One has to be careful and realistic in seperating the wheat from the chaff. |
Dimitris Hatzopoulos Send message Joined: 5 Jan 06 Posts: 336 Credit: 80,939 RAC: 0 |
I wrote about this in another thread, but let me copy the relevant part here as well. James wrote: Regardless of an 'opimized' client a project can calibrate the claimed credits - look no further than einstein@home. They most definately adjust the credits to get rid of the use of inflated benchmarks. Since you keep mentioning Einstein as a "model" to follow, where did you read that they do this kind of calibration? (web address please). My BOINC massively underclaim credits (as using akosf's app my PCs complete a WU in 1/4th of the time it used to take) for Einstein. From looking at my results, Einstein just uses a quorum of 3 and grants the credit of the middle claim e.g. wu6428418. My BOINC's claim was for 13.99 credits, someone else's 56 and we all 3 received the middle one of 41 credits. A project which is using quorum of 3,4 etc is effectively slashing effective CPU speed available to 1/3rd or 1/4th of donated "raw" CPU speed. I see this as an ultimate waste of donated resources and personally have stopped crunching for projects which did this just to appease credit-obsessed people, unless there is a valid science reason to operate with a 3-4x redundancy. Anyway, afaik the "credit calibration" feature you mentioned is used in SETI-Beta and I hope Rosetta and other projects will use it as soon as it goes mainstream. Best UFO Resources Wikipedia R@h How-To: Join Distributed Computing projects that benefit humanity |
Nuadormrac Send message Joined: 27 Sep 05 Posts: 37 Credit: 202,469 RAC: 0 |
My Einstein credits get very much under-estimated using akosf's algorithm. And what's more D40 which I'm using now, has a major improvement over C37 on my Athlon 64. C37 gave a major improvement, bring the then albert WUs down to about a half hour or so of crunch time (don't exactly remember now). Then longer albert units came out on E@H that took about 1.5 hours. Anyhow, D40, which includes 3d now optimizations in addition to the sse optimizations that akosf included previously is down to about 1 hour (or 1/3 of what optimized science app c37 included). My claimed credits are low there, and remain low... However, unless someone else is using the optimized app, the quorum of 3 gives me more standard credit. I simply will not use an optimized CC, because most of my crunching is not on SETI (where I use crunch3r's science app) or even SETI and Einstein. True, projects like CPDN will be unaffected, but projects like Rosetta right here, definitely will... However, BOINC was made open source for a reason, and trying to force only "official clients" is not the answer. It was in part to allow for running on currently unsupported CPU platforms... What's more, some projects (like some of the Japanese cell computing projects), state where they're listed that they require a non-standard client. The answer is what SETI is doing with enhanced which is now in beta. In all the SETI beta WUs I've received thus far, the claimed credits are virtually identical of each other, regardless of computer or speed. Looking at some of my results on SETI beta, the actual variance from 1 credit claim to another is < 1 credit point (and in many cases is within a 10th of a point). I think the SETI staff has a fine handle on that, and one that will dispense of questions wrt optimized core clients once and for all. |
Neal Chantrill Send message Joined: 6 Nov 05 Posts: 52 Credit: 1,199,615 RAC: 0 |
|
Dimitris Hatzopoulos Send message Joined: 5 Jan 06 Posts: 336 Credit: 80,939 RAC: 0 |
The answer is what SETI is doing with enhanced which is now in beta. In all the SETI beta WUs I've received thus far, the claimed credits are virtually identical of each other, regardless of computer or speed. Looking at some of my results on SETI beta, the actual variance from 1 credit claim to another is < 1 credit point (and in many cases is within a 10th of a point). I think the SETI staff has a fine handle on that, and one that will dispense of questions wrt optimized core clients once and for all. I fully agree with you that the new SETI-beta system is best and accurate and FAIR, as one can see completely different computers/OS/compilers e.g. a P4/Win and a Mac claiming the very same amount of credit for the same work done. I hope the other projects implement it as soon as it goes mainstream. But note: a lot of people with massively overclocked CPUs now getting high benchmarks (which fit entirely in L2 cache) in BOINC, will get a little disappointed, because the new SETI-beta system will award credits based on TRUE work done, which often depends on memory-CPU bandwidth rather than raw CPU clock speed. Then you'll see a 2GHz P4 getting almost the same credits with a 3GHz one. Best UFO Resources Wikipedia R@h How-To: Join Distributed Computing projects that benefit humanity |
Mo Send message Joined: 12 Apr 06 Posts: 1 Credit: 6,163 RAC: 0 |
The second reply in this thread points out that this is science, not a game; it's human nature to be competitive, but wondering whether RAC cheating is a problem seems a bit over-the-top. This is all about the work units - as long as the integrity of the work being done is maintained, does it matter if someone will actually go out of their way to fudge their numbers? I only recently installed BOINC and look at my accruing credit for what it is: http://en.wikipedia.org/wiki/BOINC_Credit_System - not where it places me on the world charts. That said, the veracity of any claims made about the computing power of the network are compromised by said cheating... any change that will lead to a truer picture of how much computing power that BOINC really harnesses is desireable. |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,902,602 RAC: 2,038 |
The second reply in this thread points out that this is science, not a game; it's human nature to be competitive, but wondering whether RAC cheating is a problem seems a bit over-the-top. This is all about the work units - as long as the integrity of the work being done is maintained, does it matter if someone will actually go out of their way to fudge their numbers? The reason it's so important is that the competition is a lot more intense if the credit is known to be fair. I saw a thread that said TSCRussia (one of the biggest DC teams) were avoiding BOINC projects until the credit is made fair. I think the project will get a lot more work throughput when a fair credit system is introduced. |
Dimitris Hatzopoulos Send message Joined: 5 Jan 06 Posts: 336 Credit: 80,939 RAC: 0 |
The reason it's so important is that the competition is a lot more intense if the credit is known to be fair. I saw a thread that said TSCRussia (one of the biggest DC teams) were avoiding BOINC projects until the credit is made fair. I think the project will get a lot more work throughput when a fair credit system is introduced. This is very true, Rosetta TeraFLOPS will greatly improve by implementing a SETI-Enhanced-like credit mechanism, even if most of current crunchers are willing to look another way, because Rosetta's goals are so important. Best UFO Resources Wikipedia R@h How-To: Join Distributed Computing projects that benefit humanity |
BennyRop Send message Joined: 17 Dec 05 Posts: 555 Credit: 140,800 RAC: 0 |
An important thing to keep in mind that none of us represents 100% of the Rosetta crunching volunteer force. In my first DC project, I joined a project because I wanted to do something useful with a system that was on 24/7 - and needed to have network traffic to keep the system from getting kicked off. I joined a team from the forum where I ran across mention of the DC project; and after a bit of time, noticed that I was climbing through the ranks of the team. Noticing the rate of climb between myself and others in the team, I figured that by adding another system, I could catch up to.. (fill in blank).. and if I added yet another system, I could catch up to.. (fill in another blank). I got bit by the competitive spirit. :) I started off innocently.. and got bit by the competitive spirit. So those that start off innocently can find themselves thinking, "I could do more." We've got non competitive people, very competitive people, non-competitive people about to become competitive people, very competitive people that are forced to give up being competitive, and all kinds of other competitive settings represented here. Fair and equal stats will bring an increase of competition and TeraFlops to the project from those that have a competitive spirit. Be it for person standings or team standings. Having a reliable client that doesn't require babysitting will really help keep these competitive folks here after their guantlets are over or whatever other goal they're reaching for. |
Aglarond Send message Joined: 29 Jan 06 Posts: 26 Credit: 446,212 RAC: 0 |
Here is my point of view. I believe that Rosetta and Simap are most intersting projects. I didn't care about Einstein until optimized clients came. Now I'm stuck between caring about science and hunting for credits. I can get more than 2000 credits per day crunching for Einstein or less than 700 per day crunching for Rosetta. And it is hard to decide what makes me feel better. If there is possibility how to get enough points (close to what I can get on Einstein) while crunching for Rosetta, it would satisfy me the most. Rosetta would get the results and I would get the points. However, someone would call it cheating. I don't want to cheat. So I will stay with Einstein and come back later to see if something changed. Happy crunching. P.S. one idea: what about kindly asking Akos Fekete, who made optimizations on Einstein, if he could look at Rosetta and try to make optimizations here? Although, it may be necessary to pay him for his effort, as he is rather busy. |
Aglarond Send message Joined: 29 Jan 06 Posts: 26 Credit: 446,212 RAC: 0 |
P.S. one idea: what about kindly asking Akos Fekete, who made optimizations on Einstein, if he could look at Rosetta and try to make optimizations here? Although, it may be necessary to pay him for his effort, as he is rather busy. Update: David has contacted Akos, but he will stay with Einstein for now. |
FluffyChicken Send message Joined: 1 Nov 05 Posts: 1260 Credit: 369,635 RAC: 0 |
Aglarond, So why do credit accumulation make you happier than the actual science enhancement of a project ? Team mauisun.org |
dag Send message Joined: 16 Dec 05 Posts: 106 Credit: 1,000,020 RAC: 0 |
One thing to consider, with a well tuned client one could produce a lot of science for the project. I have 2 and a half cores running on Windoz and 5 cores running on Linux, and all are dag --Finding aliens is cool, but understanding the structure of proteins is useful. |
Message boards :
Number crunching :
RAC cheats, is this a problem
©2025 University of Washington
https://www.bakerlab.org