Napster and Gnutella Measurements
belswick writes "UW has posted a paper titled "Measuring and Analyzing the Characteristics of Napster and Gnutella Hosts" at Washington in PDF form. Interesting reading for those who implement P2P software, with actual measurements, tools, and topologies. You 3l33t H4x0rz are ACM members, R1gh4?" You can get a cache of the PDF and view it online as well.
rulz dewdz
support the GNAA
For when Bruce Willis blows them up in his next movie.
teh cawk it.. napster rulez.
...here's the HTML Version courtesy of Google.
Javascript + Nintendo DSi = DSiCade
gathers GAY NIGGERS from all over America and abroad for one common goal - being GAY NIGGERS.
Are you GAY ?
Are you a NIGGER ?
Are you a GAY NIGGER ?
If you answered "Yes" to any of the above questions, then GNAA (GAY NIGGER ASSOCIATION OF AMERICA) might be exactly what you've been looking for!
Join GNAA (GAY NIGGER ASSOCIATION OF AMERICA) today, and enjoy all the benefits of being a full-time GNAA member.
GNAA (GAY NIGGER ASSOCIATION OF AMERICA) is the fastest-growing GAY NIGGER community with THOUSANDS of members all over United States of America. You, too, can be a part of GNAA if you join today!
Why not? It's quick and easy - only 3 simple steps!
First, you have to obtain a copy of GAY NIGGERS FROM OUTER SPACE THE MOVIE and watch it.
Second, you need to succeed in posting a GNAA "first post" on slashdot.org, a popular "news for trolls" website
Third, you need to join the official GNAA irc channel #GNAA on EFNet, and apply for membership.
_ ________G_ ________A_ ________Y_ ________*I CA______N_ ________I_ ________G_ ________G_ ________E_ ________R_ ________S_ ________*_ ________A_ ________S_ ________S_ ________O_ ________C
Talk to one of the ops or any of the other members in the channel to sign up today!
If you are having trouble locating #GNAA, the official GAY NIGGER ASSOCIATION OF AMERICA irc channel, you might be on a wrong irc network. The correct network is EFNet, and you can connect to irc.secsup.org or irc.easynews.com as one of the EFNet servers.
If you do not have an IRC client handy, you are free to use the GNAA Java IRC client by clicking here.
If you have mod points and would like to support GNAA, please moderate this post up.
This post brought to you by freetibet, a proud member of the GNAA
G_____________________________________naann______
N_____________________________nnnaa__nanaaa______
A____________________aanana__nannaa_nna_an_______
A_____________annna_nnnnnan_aan_aa__na__aa_______
G____________nnaana_nnn__nn_aa__nn__na_anaann_MER
N___________ana__nn_an___an_aa_anaaannnanaa______
A___________aa__ana_nn___nn_nnnnaa___ana_________
A__________nna__an__na___nn__nnn___SSOCIATION_of_
G__________ana_naa__an___nnn_____________________
N__________ananan___nn___aan_IGGER_______________
A__________nnna____naa___________________________
A________nnaa_____anan___________________________
G________anaannana_______________________________
N________ananaannn_AY____________________________
A________ana____nn_________IRC-EFNET-#GNAA_______
A_______nn_____na________________________________
*_______aaaan____________________________________
um, dolor. Nunc nec nisl. Phasellus blandit tempor augue. Donec arcu orci, adipiscing ac, interdum a, tempus nec, enim. Phasellus placerat iaculis orci. Crasa sit amet quam. Sed enim quam, porta quis, aliquet quis, hendrerit ut, sem. Etiam felis tellus, suscipit et, consequat quis, pharetra sit amet, nisl. Aenean arcu massa, lacinia in, dictum eu, pulvinar ac, orci. Mauris at diam tempor ante ullamcorper molestie. Ut dapibus eleifend ipsum. Nam dignissim.
google mirror as html http://216.239.39.104/search?q=cache:oKwBXYau_aEJ: www.cs.washington.edu/homes/gribble/papers/msj.pdf +&hl=en&ie=UTF-8
can someone please post this article in non pdf form?
Selling software wont make you money, selling a service will.
You know, not all of us who like P2P applications are "3l33t H4x0rz." Some of us, particularly me, prefer to be known as "cybersecurity experts."
It's crap like this, even from a so-called "editor" like "Hemos," that makes me boycott Slashdot more and more every day.
If I wanted intelligent commentary, I'd read Infothought blog. If I wanted crap, I'd read Slashdot.
I'm not Seth Finkelstein. I still speak the truth.
My company's intranet has all of our insurance claim forms on the web. They had recently redone the site, and I needed a claim form. I tried to do it from work, but seeing how I have an Ultra 5 and a client with a very restrictive software policy, I couldn't view the Word document posted. I figured it was the form itself, so I waited until I got home. When I did, I opened up the document, and was astonished to find that the document contained one line: a link to the insurer's website.
I would like to get my hands on those developers... luckily they're 300 miles away.
"I dunno," Cmdr Taco said to me. "I'm into some pretty kinky shit."
"That's okay, I can handle it," I told him. How bad could it be? I had done it all - S&M, fecal, you name it.
But nothing could have prepared me for the horrors I experienced that night. I mean, there's kink and then there's kink. He actually removed the uterus from a freshly-killed cow and shoved it up his ass. Then he made me suck off a young black man and snowball the spooge into his anus.
The cow uterus became impregnated. Nine months ater Cmdr Taco gave anal birth to a black half-man, half-cow. He named it Michael Sims and gave it a job at slashdot.
The numbers are all from early 2001. Napster has since been killed and reborn with an entirely different model, and gnutella (KaZaA et al) have exploded. What's the point of this report given the ancient data?
Given those changes wouldn't it be more valuable to see if their hypotheses and conclusions hold up with the new data?
Thanks,
--
Matt
Do you alter the phrase from 'peer to peer' to 'idiots to me' in the privacy of your own head :)
Kingdom of Loathing (www.kingdomofloathing.com) Addicted is me
Anyone else a big mutella fan? I always run it in a screen session, with the web interface enabled. I love that I can use the same session, from a terminal at home, ssh'ed in, over the web interface on my LAN, or through an https tunnel. Great piece of software, highly recommended.
"I dunno," Cmdr Taco said to me. "I'm into some pretty kinky shit."
"That's okay, I can handle it," I told him. "As long as it involved me coming in, on, or around you - you sexy, flabby, pale hunk of bloated man, you." How bad could it be? I had done it all - S&M, fecal, you name it.
But nothing could have prepared me for the horrors I experienced that night. I mean, there's kink and then there's kink. He actually removed the uterus from a freshly-killed cow and shoved it up his ass. Then he made me suck off a young black man and snowball the spooge into his anus.
The cow uterus became impregnated. Nine months ater Cmdr Taco gave anal birth to a black half-man, half-cow. He named it Michael Sims and gave it a job at slashdot.
'No President has lied so baldly and so often and so demonstrably'
... If this had been another country, one would have written a convincing analysis that this guy is lying through his teeth, that there are no weapons in Iraq. But people thought, the President can't say he knows something if he doesn't. That was persuasive, in a way.
... The presumption now has to be that he's lying any time that he's saying anything."
By Andrew Gumbel
09 November 2003
"The intelligence process is a bit like virginity," says Ray McGovern, who worked as a CIA analyst for 27 years. "Once you prostitute it, it's never the same. Your credibility never recovers.
"Watching what has happened with Iraq over the past several months has been like watching your daughter being raped."
Such is an indication of the extraordinary depth of feeling within the US intelligence community as the Bush administration's basis for the war in Iraq - the weapons of mass destruction, the dark hint of links between Saddam Hussein and al-Qa'ida - has been shown to have been built on air.
Mr McGovern worked near the very top of his profession, giving direct advice to Henry Kissinger during the Nixon era and preparing the President's daily security brief for Ronald Reagan. Now he is co-founder of a group of former CIA employees called Veteran Intelligence Professionals for Sanity, or Vips for short.
What the Bush White House has done, he believes, is far worse than the false premise that dragged the United States into the Vietnam War - a reported second attack on a US destroyer in the Gulf of Tonkin which later turned out not to have taken place. "The Gulf of Tonkin was a spur-of-the-moment thing, and Lyndon Johnson seized on that. That's very different from the very calculated, 18-month, orchestrated, incredibly cynical campaign of lies that we've seen to justify a war. This is an order of magnitude different. It's so blatant."
Mr McGovern accuses Mr Bush of an extraordinary act of chutzpah - taking advantage of his authority as President of the United States to make people believe there must be something to his insistent allegations that Iraq possessed potentially devastating weaponry.
"Many of us felt there had to be something there
"Now we know that no other President of the United States has ever lied so baldly and so often and so demonstrably
It will, Mr McGovern believes, take a change of president and a change of CIA director to even begin to repair the damage done by what he sees as an overt politicisation of the intelligence business. But even that may not be enough.
"Unless what has happened in the past year and a half is recognised as a scandal, in which the CIA has been badly abused, then there's no hope," he said. "I pin my hopes mostly on the press these days. Turns out, surprise surprise, that even the US press doesn't like to be lied to."
Freenet's next-gen routing algorithm does detailed analysis of node performance and incorporates this into its routing decisions. In effect, Freenet already implements their proposal, neatly integrating it into the Freenet routing algorithm.
http://theory.cs.iitm.ernet.in/msj.pdf
http://theory.cs.iitm.ernet.in/msj.txt
But only on reasonable terms.
I have about 20Gb of MP3s. They're all mine. Ripped from CD's I own. Occasionally my CD was too badly damaged to get a good rip, so I've gotten a copy of a rip from a friend who owns the same album. Legal nit-picking aside, I think I have every legal right to do that.
I've never bothered with Napster, Kazaa, Gnutella or their like. I make intellectual property for a living, and I believe artists and creators ought to get paid for their work. (A discussion as to whether they actually _do_ get paid anything by the music publishers is beyond the scope of this rant.)
I want to buy more MP3s, legally. But I'm not going to bother with these half-assed more-expensive, more-restricted offerings. Sooner or later, they'll realize they have to offer equivalent or greater value to the consumer to win their business.
I want to listen to my newly-purchased songs in WinAmp, right along side my existing rips that I legally own. And if I want to put them on my laptop and listen to them while traveling, so be it. And MP3 players, while cycling. And maybe burn some to a CD to listen to in my car. It's my music, I can do what I want with it. Anything less is unacceptible.
Buying an entire album one song at a time and ending up paying _more_ than that album costs down the street at a bricks & mortar store? And getting a crippled, compressed, proprietary format that locks you to one CPU (what if it dies?) and only certain players? Who thought that was a clever idea?
The end of insane music publishing margins and selling the same music multiple times to a consumer (vinyl, tape, CD, DVD-Audio, MP3, etc) is here. The industry needs to learn to trim the fat like everyone else, and actually deliver value. And, to treat their customers like customers, not criminals.
I want to buy music. A lot of it. I'd probably drop $300 the first week such a reasonable system were available. And that's just the start. But lose this stupid business and operational model that they keep coming up with. Nobody wants less for more.
paper publishing takes a long time. gathering, analyzing data and making sure you're coming to proper conclusions takes lots and lots of research and double checking. And then theres peer review, which takes months as the paper gets submitted to academic peers who read and analyze and comment on it - when they've got the time.
In any case, the data points themselves arent as relevant as the topology and structure of growth. doesn't matter if the data is from 2001, theres plenty to be learned from.
-
This is a very old (in internet terms) report. Its results are taken from when gnutella and napster were two "popular" p2p architecuters (report refers to data gathering in May of 2001). Since then napster has died and been reborn in a new form and gnutella has adopted a 2-tier topology such as kazaa has. Companies such as clip2, who are long dead and buried, are referenced and bandwidth usage is stated from 2001 making the results useless and the references impossible to find.
I assume its an old report resubmitted by somebody who doesn't know better otherwise research like this is worse than useless because it provides completely inaccurate results.
27 comments and not one actually on topic. Does anyone care about these statistics? Or know what to do with them? For that matter, has anyone successfully read the paper without their eyes glazing over? I'm sure its a fascinating paper to someone, but I can't get past the first two pages without loosing all concentration. And I'm weird enough that I usually like this stuff!
Javascript + Nintendo DSi = DSiCade
This study is based on extremely old data and is not particularly relevant for today's Gnutella. The Gnutella crawl data is from 2001, a time when Gnutella was a vastly different network with a completely different searching architecture. Gnutella at the time was a very young protocol. Since then, the search architecture has moved beyond the flooding model, now using a combination of distributed indexing and "dynamic querying." These techniques are specified in detail here.
The data on average number of shared files and uptime is interesting, but there's really not a lot in here that is actually useful for peer to peer development. There's a lot of active, very useful research being done elsewhere. The folks at Stanford have done a great deal of work in this area, much of it very applicable. Their work is here.
Adam Fisk
at:http://slashdot.org/articles/03/05/2
I've been using the software to send files securely to trusted friends, I wonder if this isn't the direction sharing mp3s will go in the future, in order to avoid the RIAA.
In any case... Nullsoft has since banned using the software, but its still available under the GPL at sites like:
http://grazzy.mjoelkbar.net/waste/mirror/
Snarf on!
F the RIAA
"Simplify, simplify, simplify!" Thoreau
can be found here.
smd4985
This is the first useful comment in the entire thread. And unfortunately, seems to confirm my opinion that this is a boring, outdated paper. Well, let's hope that someone at least got a good grade from it.
Javascript + Nintendo DSi = DSiCade
And here's the text summary from the researcher:
Stop using P2P clients you fscking pirates, you're wasting all my pr0n bandwidth at the university.
The name Napster didn't seem like a catchy name to begin with. It also got associated with "song theft" or "Geek/Techie rights fighters"
The Napster of today isn't NEARLY as fast due to the fact it's no longer a peer to peer system. It can't even begin to compete (bandwidth wise) with Gnutella. On a 56k modem I can get a song of of LimeWire (which partially uses the Gnutella network) in about 3 to 3.5 minutes. On Napster, it takes about 8 minutes. Neither is a problem with broadband.
That said, I could also get a file that was cross platform compatible of the "old napster" - the new Napster can be used effectively with Macs because of the DRM format chosen.
And yes, I am aware WMP9 came out for X the other day, it still doesn't have the playlist management iTunes or even Audion has.
Yell & scream & rant & rave... it's no use... you need a shaaaave ~ Bugs Bunny
As a major developer of one of the world's leading Gnutella clients this data is old, untimely, and really not "new news" to anyone involved in Gnutella.
Much of this data is based upon estimates & reported crawler (ha!) data.
Want some real, hardcore data about Gnutella (or at least the BearShare portion of it)?
I invented a revolutionary distributed stats system that is in place in the latest versions of BearShare. No more guessing about p2p network information, like transfer bandwidth, etc. Try checking out some of my results.
This data is collected from the network, in a brand new, distributed, 'polled-not-crawled' scheme with remarkably fast turnaround times on data (new data points every 5 mins, on average).
Much, if not all, of this in the above report information is actively being summarrized for Gnutella (again, the BearShare portion at least) and some early (non-automated graphing) of the results can be found in the above links.
Expect (some of) this data (like node count, shared files/bytes, etc) to be available on our website (in real time) soon.
Kinda interesting...
In any case , story data is not novel any more, certainly not timely. =)
I like my data collections much better.
-dave-
The pig browse. With Google. Sigh is to the chicken. Chicken is fool. Giggle. The DailyWTF giggle.
The editors changed the story and didn't mark it as an update OR give credit! Thanks a lump, guys.
Javascript + Nintendo DSi = DSiCade
without loosing all concentration
LOSING, LOSING, LOSING!
* AKAImBatman beats himself over the head with a wet mackerel.
I think Safari needs a grammar checker...
Javascript + Nintendo DSi = DSiCade
What about those of us who despise this incessant obsession with music and movies and p2p? Slashdot has turned into every other news outlet- endlessly gabbing about music or movies(or both). I fully expect to see a Bennifer story here before the end of the year.
I like listening to music as much as the next guy, but beyond listening, I really couldn't give a crap about music, and I'm really getting tired of Musicdot's...er, I mean, slashdot's, endless obsession with it, nor p2p software, nor universities doing this or that, nor the latest drivel from the industry groups. ENOUGH. At least Timothy is picking worthwhile causes to obsess about.
Please help metamoderate.
I'm starting to get the sense that Science really should stick with the timeless concept. 2 years is a blink of an eye when preparing a paper on particle physics, or mathematics. 2 years is at least 8 lifetimes on the internet. By the time you write about it, it's obsolete.
"Learning is not compulsory... neither is survival."
--Dr.W.Edwards Deming
Come on trolls, I know you can do it!
Dude, I feel your pain.
Javascript + Nintendo DSi = DSiCade
mod it how you want, that shit is fuckin hilarious!
If a slew of INEFFECTIVE pills, powders, and equipment are adding needless expense to your PERMANENT WEIGHT LOSS quest, please read on... Does Permanent Weight Loss Require Supplements or Equipment? I wish there was a way for me to scream "NO!!!" loud enough for all to hear my cry. STOP investing in a slew of supplements that will NEVER work, no matter how long or often you use them (read on to learn why). NEVER purchase gimmicked exercise machines that promise miracle results (whether it be for the stomach, buns, hips, thighs, or ANY body part), but in the end, only serve as a cheap giveaway at your next yard sale. Ab machines promising to firm your stomach and help you lose weight, all in a mere 30 days, DO NOT ENHANCE THE APPEARANCE OF OR FLATTEN YOUR WAISTLINE, and will NOT BURN ONE OUNCE OF EXCESS FAT. Yet, they do add nicely to your weight loss related junk collection. This is only a small sample of the MANY misconceptions regarding permanent weight loss, and in the following paragraphs I will try to END all of the unnecessary confusion. Realize that body fat not only attaches itself to our stomach, hips, thighs, and arms, but also to our FACE...losing fat improves the way we look from HEAD TO TOE! Trust me, I know...since I once had a chubby everything..
When you see leetspeak in the summary, you know to keep your distance from the actual article.
You're right, I wouldn't steal a car. But if it were possible, I sure as hell would download one!
Why doesnt somebody implement the draft FastTCP protocol for P2P.
Its crying for a boost.
Get yer fingers out.
The problem was that the process ran for 5 days, so if it started on Sunday, you could know what Monday's weather would be by the following Friday.
This study (and I do understand it takes time to pull together this kind of comprehensive usage data in an organized format) falls along the same lines. It would have been far more relevant had it been published when the original Napster was actually (1) in its prime or at least (2) still up.
So *YOU* are that assfucker responsible for Bearshare? That lameass spyware client?
Your days (here) are counted.
Thanks to the structure of scientific papers, you don't have to actually RTFA in order to know what is all about:
5 Conclusions
In this paper, we presented a measurement study performed
over the population of peers that choose to participate in the
Gnutella and Napster peer-to-peer file sharing systems. Our
measurements captured the bottleneck bandwidth, latency,
availability, and file sharing patterns of these peers.
Several lessons emerged from the results of our measure-
ments. First, there is a significant amount of heterogeneity in
both Gnutella and Napster; bandwidth, latency, availability,
and the degree of sharing vary between three and five orders
of magnitude across the peers in the system. This implies that
any similar peer-to-peer system must be very deliberate and
careful about delegating responsibilities across peers. Second,
even though these systems were designed with a symmetry of
responsibilities in mind, there is clear evidence of client-like
or server-like behavior in a significant fraction of systems'
populations. Third, peers tend to deliberately misreport in-
formation if there is an incentive to do so. Because effective
delegation of responsibility depends on accurate information,
this implies that future systems must either have built-in in-
centives for peers to tell the truth or systems must be able to
directly measure and verify reported information.
Singularity: a belief in the "God" idea with the "demiurge" relation inverted.
Measurement, Modeling, and Analysis of a Peer-to-Peer File-Sharing Workload at http://www.cs.washington.edu/homes/gribble/papers/ p118-gummadi.pdf
and
An Analysis of Internet Content Delivery Systems at http://www.cs.washington.edu/homes/gribble/papers/ p2p_osdi.pdf
let's burn all those rubbishy theoretical textbooks - speed of light? that could change at any time!
Y'all are missing the point, thanks once again to the many-headed beast that is the word "P2P".
In this case, the academics are strictly concerned with P2P as a network organization, with little regard to what apps are built on top of it. This has nothing to do with "Napster" or "Gnutella" as "file sharing systems". Instead, Napster and Gnutella are being studied by the academics because they are the only things you can get hard numbers for, because few-to-none of the academic P2P systems have been implemented on such a wide scale. They do not perfectly implement what the academics are studying but they are close enough to provide some data about how other systems might behave in the real world.
Academic P2P systems tend to concentrate on "pure" P2P, where there are no servers and ideally no "supernodes" (though they'll settle for dynamic organization that emerges from the protocol itself with no human intervention). This is a much different and much harder problem then "Let's share music!".
The closest to a wide-scale academic P2P system that has been actually deployed that I know of is Freenet; for ideological reasons (pure P2P, no servers) it shoots for the same goals that the academics shoot for for other reasons (mostly that pure P2P systems are hard enough to be interesting, whereas Napster's organization could be created by one teenager without much difficulty; no disrespect to Fanning but it's basically another varient of client-server). Note how much trouble it has had scaling up, just as Gnutella has had trouble; "pure P2P" is friggen' hard in the real world.
This is "old news" as a couple others have noted because of the peer review process, but to the academics this is valuable to have such peer-reviewed hard data, because you can model and simulate your network to your heart's content, but until you see it in the real world on a large scale you can't be sure it works. Without this kind of hard data they're adrift in a sea of pure theory.
This paper isn't for "you", so the fact that "you" don't understand what it's for or that "you" think this is useless is rather uninteresting. This paper is for academic P2P practicianers; if you don't know about academic P2P theory, you can ignore this safely. Academic P2P and what "you" think of as P2P are quite different.
(The "you" here is the "average Slashdot poster to this article. Apply it to yourself (or not) as appropriate.)
Note that in this paper "academic" is not used as a perjoritive; it's just that as I said, there's such a huge disconnect between academic and non-academic P2P goals that they hardly deserve to be lumped under the same name.
it's important that you start with the base of the shaft and measure to the tip.
In the great CONS chain of life, you can either be the CAR or be in the CDR.
In this paper, we presented a measurement study performed over the population of peers that choose to participate in the Gnutella and Napster peer-to-peer file sharing systems. Our measurements captured the bottleneck bandwidth, latency,availability, and file sharing patterns of these peers. Several lessons emerged from the results of our measure-ments. First, there is a significant amount of heterogeneity inboth Gnutella and Napster; bandwidth, latency, availability,and the degree of sharing vary between three and five orders of magnitude across the peers in the system. This implies that similar peer-to-peer system must be very deliberate andcareful about delegating responsibilities across peers. Second,even though these systems were designed with a symmetry ofresponsibilities in mind, there is clear evidence of client-likeor server-like behavior in a significant fraction of systems'populations. Third, peers tend to deliberately misreport in-formation if there is an incentive to do so. Because effectivedelegation of responsibility depends on accurate information,this implies that future systems must either have built-in in-centives for peers to tell the truth or systems must be able to directly measure and verify reported information.
Words to men, as air to birds.
Don't use WASTE. The encryption model is weak (crackable, yes) and the whole thing pigs bandwidth. A false sense of security can be worse than none sometimes.
This thing is plainly very outdated for Gnutella. Their conclusion recommendations include things like having various levels of responsibility for nodes.
If it were current, they'd at least have mentioned ULTRAPEERS or LEAF nodes! Gnutella currently DOES have nodes which 'volunteer' to carry more load.
In conclusion---it's really not worth reading anymore, because the designs they studied are dead and replaced already.
-Terr
Troll win! Seth FAKELSTEIN scores again! He's not Seth FINK-EL-STEIN.
I first read that headline as "Napster and Genitalia Measurements". I guess that doesn't make much sense at all.
Agreed! That was fucking hilarious.