Slashdot Mirror


Gnutella Not Scaling?

cbull writes "ZDNet Music has an article that makes an argument that "Gnutella is Going Down in Flames". Basically, the argument is that Gnutella isn't as scalable as Napster."

60 of 137 comments (clear)

  1. Time travel is possible! by don_carnage · · Score: 2

    I have finally done it! I've traveled back in time and read an article that was posted on Slashdot two weeks ago. Wooohooo! I'm going to be rich!
    --

  2. Improving GNUtella by Xentax · · Score: 3

    Well, this is just shooting from the hip, but someone should look into writing an improved client for broadband connected users. This client would feature caching of results to and from its immediate connections, and perhaps out to two or 3 nodes distant.

    If you've got a big pipe, and you're going to be connected to gnutella for awhile, this would improve the performance of your client and those closest to you.

    Of course, if you really want improvement, you'd have to build this capability into the protocol. Allow clients to register as either low or high bandwidth. Then low bandwidth clients could do anything, but traffic could only go through them for a level or two. Ideally, you'd want every client to be able to reach a high-bandwidth node within 3-5 hops. A connected client would then note and rely upon these distribution nodes to do the work. Perhaps even reconnect to distributors directly...

    Just a thought. Isn't this the kind of thing that Freenet already does?

    Xentax

    --
    You shouldn't verb words.
  3. What about Hotline? by //violentmac · · Score: 2
    The granddaddy of peer to peer file sharing is never mentioned on /. Why is that?

    http://www.bigredh.com

    http://www.thestar.com/thestar/back_issues/ED20000 812/money/20000812BUS01b_FI-HOTLINE.html

    On behalf of /. I want to thank our friends from the Great White North, eh.

    --
    --------

    get jiggy w/ ayn rand!

  4. Re:Not likely! by steve_bryan · · Score: 2

    Why is it that people who have never even looked at a gnutella packet stream or contributed a line of code to a client are so damn willing to offer their worthless, uninformed opinions (I'm reacting more to the lame-ass article on ZDNet but the article I'm replying to qualifies also)? Anyone who has taken a close look at the traffic is aware that gnutella has been subject to a denial of service attack ever since the first injunction against Napster was almost enforced. The goal of this attack is to convince the deep thinkers on the net that gnutella "will not scale" and hence to give up on true peer to peer networking in favor of whatever the RIAA does with Napster once they manage to steal the technology with the aid of their judicial accomplices.

    For those who have not bothered to read, every gnutella packet has a TTL (time to live which really translates to hops to live) so that it only gets seen by at most 'TTL' nodes which is supposed to be 7 by default. For those keeping track that means there is really nothing that needs to be 'scaled' regardless of how many total nodes there are. Packets on a "well behaved" network will die a natural death before causing a melt down. We were handling large networks (thousands of distinct nodes) just fine before the attacks began. What we have to do now is release clients that defend against the DOS attack and get enough such nodes out there to restore the previous performance.

    Again for those who have not looked at the issue, the way you can mount an attack on gnutella is to set up as many clients as you can that don't route back any responses and at the same time spew out an unending stream of pings and possibly nonsense search queries (meant to load other clients but not produce query response packets). One way to fight back is to drop all pings on connections that have an inordinate proportion of pings and drop connections that appear to be generating too many queries that don't result in any responses. The first strategy is easy to impement and is in the current version of Mactella. The second is harder and is under development now.

    Those who are loudly proclaiming that gnutella is failing because it does not 'scale' are little more than unwitting dupes of the sinister forces that are trying to generate precisely that impression. It may be true that it can't adapt to overcome malicious attacks but that is far from proven at this point.

  5. Re:Of course it doesn't scale by jovlinger · · Score: 3

    erm. this seems like a problem that is solvable in any number of ways. Replication seems to be easiest. Cache popular content onto fast pipes (provisions for bandwidth limiting are assumed). Encode a forwarding requirement into the protocol -- every file you download, you have to allow someone to grab that file from you. Use multicast and PPV style scheduling (requesters register for a file, letting the server determine when (within a short timeperiod) to multicast it).

    I suprised by this being an issue at all. I haven't looked at the gnutella infrastructure, but these are issues that I would have thought tackled during the initial design.

  6. Re:Yeah no shit. by Sanity · · Score: 4
    Actually with Freenet it seems to be a log(N) problem. Much better.

    --

  7. That's not the only problem by jandrese · · Score: 2

    I don't know if anybody else has noticed this, but all of the Unix clients for Gnutella suck. They seem to range from the unbeliveably confusing and undocumented console mode applications (gnut) to crash prone X applications (gnubile -- never runs more than once between reinstalls!) to leech only clients (gtk-gnutella).

    I'm not going to connect just to leech files, which basically leaves me with 0 options for the client. Plus it seems like the majority of the users are leeches on there already, and those that aren't are on modem connections (and always disconnect the instant someone starts to snag a file from them).
    That's my $0.02

    --

    I read the internet for the articles.
  8. Scalable vs. Distributed by Limecron · · Score: 4

    The problem is quite obvious and has been around as long as peer-to-peer and server based networks have both existed. Peer-to-peer networks work wonderfully when they're small. Server based networks are much more effiecent and thereby are nearly always used for large networks. Can Gnutella still work? Yes, but it will have be divided into smaller networks... For example: You have separate networks for: Pop MP3s Rock MP3s Country MP3s Rap MP3s Jazz MP3s Movies Warez..err..Shareware Of course, each network should have a critical mass and then divide in half when it reaches that point. Wow, maybe I should get programming...

  9. tendency by vla1den · · Score: 2

    There is interesting tendency:
    Napser has central server, keep information on client side, and it works.
    Gnutella does not have central server but still keep information on client side, and it barely works.
    Freenet does not have central server, and does not keep information on client side, and it is not practically usable (yeah, I know it's the most promising technology, but still...).

    Also all of them call themselves peer-to-peer but napster actually has central server, and freenet do not have second peer to connect to at all. Did somebody can tell me what is it - P2P?


  10. Make Your Own Tunes, Fool! by Will+The+Real+Bruce · · Score: 2

    May I have your attention please,
    may I have your attention please,
    will the real bruce perens please stand up,
    I repeat will the real bruce perens please stand up
    .....we're gonna have a problem here.........

    Ya'll act like you never seen a slash poster before
    mouse all on the floor
    like mom and daddy just burst in the door
    and started whoopin yer ass worse than before
    they first had endorsed
    buyin' ya a crappy computer (aaaaaah)
    It's the return of the...
    "awww..wait, no wait, you're kidding,
    he didn't just say what I think he did,
    did he?"
    and Mr. Cray said...
    nothing you idiots, Mr Cray's dead
    he's locked in my bassment
    microsoft women love Sig '11
    chicka chicka chicka bruce perens,
    "I'm sick of him, lookit him
    walkin around, grabbin his GNU know what
    flippin' to GNU know who"
    "yeah, but he's so smart though"
    yeah, I probably got a couple of screws up in my head loose
    but no worse than what's goin on in your sister's webcam (eheheheh)
    sometimes, I wanna get on ZD and just let loose
    but cant, but it's cool for RMS to hump a dead GNU
    My mouse is on your link, My mouse is on your link
    and if you're lucky, I might just give it a little click
    and that's the message that we deliver to little kids
    and expect them not to know what a free software is
    of course they're gonna know what Microsoft is
    by the time they hit 4th grade
    they got MS-NBC, dont they?
    we ain't nothing but omnivores
    well, some of us carnivores
    who read other people's mail like crackwhores
    but if we can read your e-mail like it's available
    then there's no reason that a man can't forge spam from your account
    but if you feel like I feel, I got the antedote
    trolls wave your penis birds, sing the chorus and it goes........

    I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so won't the real Bruce Perens please stand up,
    please stand up, please stand up
    cause I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so wont the real Bruce Perens please stand up,
    please stand up, please stand up

    Sig 11 don't got to cuss in his posts to get Karma
    well I do, so fuck him and fuck you too
    you think I give a damn about my Karma
    half of you trolls can't even stomach me, let alone stand me
    "but bruce, what if you win, wouldn't it be weird"
    why? so you guys can just lie to get me here
    so you can sit me here next to Natalie here
    shit,Enoch Root's momma better switch me chairs
    so I can sit next to trollmastah and Post First
    and hear em argue over who modded it down first
    little troll, flamed me back on IRC
    "yeah, he's fast, but I think he types one-handed, hee hee"
    I should download some audio on MP3
    and show the world how you released it BSD (aaaaaah)
    I'm sick of you little troll and l33t groups
    all you do is annoy me
    so I have been sent here to destroy you
    and there's a million of us just like me
    who post like me, who just don't give a fuck like me
    who code like me, walk, talk and act like me
    and just might be the next best thing, but not quite me......

    I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so won't the real Bruce Perens please stand up,
    please stand up, please stand up
    cause I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so wont the real Bruce Perens please stand up,
    please stand up, please stand up

    I'm like a head trip to listen to
    cause I'm only givin you things
    you troll about with your friends inside you rabbit hole
    the only difference is I got the balls to say it
    in front of ya'll and I aint gotta be false or sugar coated at all
    I just get on the web and spit it
    and whether you like to admit it (riiip)
    I just shit it better than 90% you trollers out can
    then you wonder how can
    kids eat up these posts like gospel verse
    it's funny,cause at the rate I'm going when I'm thirty
    I'll be the only person in the chat rooms flirting
    cyberin with nurses when I'm jackin off to porno's
    and I'm jerkin' but this whole bag of viagra isn't working
    in every single person there's a bruce perens lurkin
    he could be workin at Micron Inc., spittin on your SDRAM
    or in the printer queue, flooding, writin I dont give a fuck
    with his windows down and his system up
    so will the real perens please stand up
    and click 1 of those fingers till you drag up
    and be proud to be outta your mind and outta control
    and 1 more time, loud as you can, how does it go? ...........

    I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so wont the real Bruce Perens please stand up,
    please stand up, please stand up
    cause I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so wont the real Bruce Perens please stand up,
    please stand up, please stand up

    I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so wont the real Bruce Perens please stand up,
    please stand up, please stand up
    cause I'm Bruce Perens, yes, I'm the real Perens
    all you other Bruce Perens' are just imitating
    so wont the real Bruce Perens please stand up,
    please stand up, please stand up

    haha guess it's a bruce perens in all of us........
    fuck it let's all stand up

    1. Re:Make Your Own Tunes, Fool! by MrEd · · Score: 2
      Moderation Totals:Offtopic=10, Troll=5, Redundant=1, Funny=24, Overrated=5, Total=45.

      Howza! Like it's been said before, Metamoderating's going to get some abuse later on today...

      --

      Wah!

    2. Re:Make Your Own Tunes, Fool! by Will+The+Real+Bruce · · Score: 2

      Dude, I take back all that shit I just said, 'cuz I just got bitchslapped for no reason!

      And this shit is WACK, how the hell do you get a (-1, Funny) rating with no Overrated moderations? That's just not possible.

      Someone fix this shit, man, ALL my posts are modded down, even unrelated ones! Who has mod points like that?

  11. Limiting the network? by _Quinn · · Score: 2

    Wouldn't it be easier just to implement bandwidth-based routing, instead of specifying minimum bandwidth in the search? Right now, I think the search goes to everyone and the low-bandwidth answers are filtered out. If a node were not to forward searches for which nothing can be returned anyway, you can avoid wasting time and bandwidth. All it requires is that the high-bandwdth servers be well-connected, which could be induced by allowing preferences for higher-bandwidth links...

    -_Quinn

    --
    Reality Maintenance Group, Silver City Construction Co., Ltd.
  12. Probably not, but good suggestion anyway! by raygundan · · Score: 2

    I don't think Gnutella is dead quite yet, but you make a good point.

    The idea of pre-categorizing the Gnutella network by file type makes good sense. Split the system into Gnutella for mp3s, Gnutella for software, Gnutella for trolls, Gnutella for pictures, etc...

    This would drastically reduce the size of each network subsection, and would help keep things to a reasonable size for searches. Plus, your results would be more likely to be relevant, due to the fact that everything on that particular network section is at least of the type you are looking for.

  13. Yeah no shit. by kevlar · · Score: 2

    This is the problem with ALL distributed architectures. Its an N^2 problem.

    1. Re:Yeah no shit. by Kaa · · Score: 5

      This is the problem with ALL distributed architectures. Its an N^2 problem.

      Only if you insist on reaching all the nodes all the time. If you can afford to reach only a subset of the nodes for any given request, then the problem becomes one of proper clustering.

      Note that Napster also implements kind of clustering: you see the files of people in your "cluster", not of all Napster users on Earth.

      Kaa

      --

      Kaa
      Kaa's Law: In any sufficiently large group of people most are idiots.
  14. Re:ALL distributed architectures by Foogle · · Score: 2
    Fundamental difference in what you're trying to accomplish. With IP, you don't have to send a request to every node of a network. Routers forward your packets directly along a path to their destination.

    -----------

    "You can't shake the Devil's hand and say you're only kidding."

  15. Freenet by Chalst · · Score: 3

    Freenet is of course an approach to peer to peer file sharing that tries to address these scalability issues. Shame the article doesn't mention it.

  16. hmmm? So? by dr_labrat · · Score: 2

    Eventually it will find its own level anyway...

    Impatient larval warez doods will move on to something that better suits them.

    People who use it and like using it will continue to use it.

    --
    The secret of success is honesty and fair dealing. If you can fake those, you've got it made. (Marx)
  17. Freenet isn't searchable by Animats · · Score: 3

    The Freenet people haven't figured out how to do distrbuted searches efficiently yet, although they realize that's a problem. They may well crack that problem, but probably not quickly.

    1. Re:Freenet isn't searchable by Sanity · · Score: 5
      It is true that fuzzy searching has not yet been implemented - although searching by song title, artist, and album are possible using "subspaces", a mechanism present in our recent 0.3 release. I recently posted a proposal for this to the Freenet mailing-list and I think some guys are working on it.

      The underlying Freenet architecture should actually be quite a good fuzzy-searching system, it is just that we have not got around to enabling that functionality yet as we have been concentrating on getting the underlying architecture right.

      --

  18. This is hardly news by biftek · · Score: 3

    Has everyone else noticed that they get a strange sensation of deja-vu whenever reading slashdot. It is rare to find something which is actually news (and new). Perhaps the geeks of the world need to create some more news, to keep slashdot fed and healthy......

    1. Re:This is hardly news by nachoman · · Score: 2

      There is a reason for this...

      http://bbspot.com/News/2000/7/news_sou rce.html

      It's the magical news elf Glandritek.

  19. Re:Gnutella IS going down in flames. by Kierthos · · Score: 3

    *nod* And the search capabilities seem to be remarkably moronic. On a friend's computer, I watched him wade through all sorts of files that weren't even germane to the parameters he'd searched for. In the end, it all comes down to how people describe the files they are sharing over Gnutella.

    On the plus side, he eventually did manage to find every single .mp3 he was looking for... it took him a while, but the thing of it is, some of these files he couldn't find at all on Napster.

    Is there any reasonable way to determine usage stats for Gnutella?

    Kierthos

    --
    Mr. Hu is not a ninja.
  20. Gnutella is open source... by AustenDH · · Score: 3

    Therefore it is as scaleable as you want it to be. It is stuff like this that reminds me of the good-ol-days when one had to bitch and whine about missing features, and wait around until the people developing said features would come out of the woodwork.

    There are still people like that in the world today. What a shame! It seems that ZDnet likes to cater to this crowd. So now they are bitching to an entire community, of which they were - by default - invited to participate.

  21. To be honest by NoWhere+Man · · Score: 2

    When Gnutella first came out I used it quite alot. Then I stopped downloading for awhile because of connectivitiy issues, then a few months later with new versions the service just seemed slower. Think it may have had alot to do with how spread out the network is. As they said unlike Napster there are no centralized servers, it is easy to lose contact.

    --

    "Imagination is the only weapon in the war against reality." -Jules de Gautier
  22. It NEEDS a central index and reference. by crovira · · Score: 3

    This is an endemic situation with ALL friggin web content.

    If you use search engines which don't check the accuracy of the data they scrounge or run your own with Archie/Veronica types of searches or worse, become your own search engine, snooping on everybody's hard drives, you're going to take longer and longer to retrieve indexes to content that is of more and more dubious quality.

    The world NEEDS MP3.com types of businesses that rate & index as well as store content.
    The world NEEDS engines that can demand micro-payment from the recipient before sending a file.
    The world NEEDS micro payment services like X3.com to catch the pennies and send the content producers their due.

    And SCREW the RIAA, MPAA and other Luddites and SCREW the culture vultures who rip off the concent creators (artists and writers etc.) and rip off the consumers by over charging simply because they put themselves in everybody's faces.

    --
    MSBPodcast.com The opinions expressed here are my own. If you don't like 'em... Think up your own stuff.
  23. Part of a solution by PureFiction · · Score: 5

    There is a way to start resolving this problem, and it is currently in development.

    The gPulp project is currently working on all of these issues. Check proposals and ideas at: http://gnutellang.we go.com/go/wego.pages.page?groupId=133015&view=page &folderId=136401&pageId=177268&JServSess ionId=3fe61b505308701b.415222.969643886549

    There is also a server oriented gnutella application which aims to start resolving some of these issues in the near term. Features such as:

    1) Provide a server for broadband / dedicated network users to provide content with a true server oriented gnutella node. This will be similar to a modified apache for singular installations, or a federated distributed server architecture for routing and caching fun.

    2) Remove broadcast push requests (in all future clients)

    3) Proxy and cache support for slow users. This will allow beafy servers to take over some of the load which dialup / slower clients experience. This will be somewhat ala freenet, as popular data will propagate through caches in various nodes. Also, this can provide a level of anonymity which is not present.

    4) Adaptive servers which configure their network connections for optimal efficiency. Not too busy, not too slow, and with the widest distance topologically from their peers (if linked) and fuzzy / reactive propogation algorithms so that TTL's and routes can be dynamically modified as load increases or other factors require.

    There is nothing fundamentally flawed with the gnutella architecture, and it is far from a 'dead' horse'. However, there are significant innefficiencies and complications which are causing problems right now. Rest assured these will be fixed.

  24. Yes, it doesn't scale; we know that. by Animats · · Score: 4
    I've pointed out several times that the Gnutella protocol doesn't scale well. It's not impossible to fix this, but it needs a major rethink.

    The basic problem is that small sites either take a lot of search hits to which they will answer "no find", or their index has to be mirrored elsewhere, which introduces centralization. There's an economy of scale to searching.

    So automatic, distributed, redundant, partial centralization is necessary. This is hard. It also has to be reasonably secure against hacking; look at the problems IRC has. It probably needs a reputation service, so people who spam the indexing system lose.

    On the other hand, music interest, being a popularity thing, follows a power law; the music most likely to be searched for will be found easily. A simple hack on Gnutella so that it queries servers slowly, in order, starting at the one with the best response time, stopping with the first find, will keep the thing from collapsing until somebody cracks the hard problems. It's not necessary to crack the general distributed search-engine problem to fix this.

    1. Re:Yes, it doesn't scale; we know that. by tqbf · · Score: 2
      The problem with centralization is that it creates a target (legal, technical). This is one of the core bulletpoints Gnutella has --- its "distributed" nature makes it harder to regulate.

      The trouble Gnutella is going to have as it attempts to scale beyond community applications to infrastructure applications (like using the Gnutella community as a search engine for the web) is that large-scale apps won't work across the Gnutella peer-to-peer fabric. They will need to be "directed" by a "persistant" server network of some sorts.

      Building a server-based distributed database isn't trivial, but it is (IMO) a "solved problem". The hard, unsolved problem Gnutella has is trying to self-organize into something approximating an efficient server-based network.

      I think this is somewhat silly. I think that if Gnutella can solve that problem, there are more interesting applications for it than Search.

      I think a more realistic angle for the Gnutella supporters to take is to bifurcate: the distributed, amorphous network is valuable when there are lots of them --- it's very hard to censor. Gnutella needs a directory system (ala Shoutcast's system) to locate these groups. The distributed search system is also valuable, but has different requirements.

      Either problem is realistically solveable in the near term. Solving both of them simultaneously is much harder.

    2. Re:Yes, it doesn't scale; we know that. by Phil+Gregory · · Score: 2

      That's why you don't create a hard-coded central location like Napster has. Ideally, each set of 'adjacent' hosts should hold an election amongst themselves to determine which one will hold the index. The election could be weighted by factors such as bandwidth and processor speed. With a setup like this, there's still no central location, but there are dynamically-determined common indexing points.


      --Phil (Why does Slashdot go on and on about Napster and Gnutella but never mention Hotline?)
      --
      355/113 -- Not the famous irrational number PI, but an incredible simulation!
  25. Distributed server by vla1den · · Score: 3

    Well, actually it's the problem with all server-less architectures. Is you have to have searches you've got to have server. If you want to make it P2P classic -- make the server invisible. One way is to create distributed server. More on this here.

  26. Math... by Hobbex · · Score: 5

    I can't understand why this is news to anyone. Those of us who spend time thinking about these things said it right away when Gnutella was released, and we had discussed and rejected the broadcast model for routing several times before that (see the Freenet development list archives if you don't believe me).

    The Math behind it is simple:

    - Every user that that adds Cu amount of capacity to the network (on average).
    - Every user also adds Tu amount of traffic (also on average). However, because of the broadcast nature that traffic is sent to all users, so with N users, each user generates Tu*N amount of traffic.

    This means that the total capacity of the network is:
    C = Cu*N
    (Capacity per user times the number of users). The total traffic on the other hand is:
    T = Tu * N * N = Tu * N^2.

    For the network to work C needs to be greater than T, if T C. You simple cannot win using a broadcat model.

    On the Freenet-dev list we have a standing rule that two words are indecent and offensive: "centralize" and "broadcast". We think we can pull it off without them, but it makes everything 1000% more difficult, which is the simple answer to why Freenet is developing more slowly then the one hundred million Napster and Gnutella variants outthere. That, and the fact that you are not helping us...

    1. Re:Math... by PureFiction · · Score: 4

      You forget a few vital points.

      1) Every bit of information is NOT sent to every other client. Many requests are dropped, ignored, or simply do not reach their destination when the TTL expires.

      2) The nature of the clients ensures that slow connections have fewer peers, propogate fewer requests, and receive fewer requests than faster ones.

      These two attributes greatly reduce the theoretical maximums encountered when doing math.

      The real world implementation does not even remotely follow the absolute mathematical predictions.

    2. Re:Math... by Hobbex · · Score: 2


      Yes, I simplified it, and things are never the same in reality as they are on paper. But the basic observation that traffic grows quadratically (or close to quadratically) while capacity only grows linearly does hold. It is a little like ordo calculations for algorithms - running Quicksort will not take exactly n*log(n) operations and a program will running it will never be ideal, but that does not change the fact that there is always an n for which it is faster than any implementation of an O(n^2) sorting.

    3. Re:Math... by Q*bert · · Score: 2
      From what I have read about Gnutella they also "scale by seperation", meaning that messages do not actually reach the entire network, but only to some Nn number of nodes (this what they refer to as the horizon). Optimally, you would want to choose Nn so that you get equality in the equations from my last port. That may work, but as soon as you have hit Nn number users, you loose the network effect as new users joining will no longer bring any additional value to other users - which defeats the entire purpose IMHO.

      Isn't that what IRC does, thus causing the dreaded netsplits? Actually, I'd be interested to know how IRC addresses similar problems. It works pretty well most of the time.

      IETF RFC page, here I come...

      Vovida, OS VoIP
      Beer recipe: free! #Source
      Cold pints: $2 #Product

  27. Re:Not likely! by ichimunki · · Score: 2

    Total nitpick, but the function described in this example is not exponential, it is a basic parabolic polynomial: y=.5x^2-.5x. In fact, each unit change in the x variable produces a increasingly smaller incremental change (percent-wise) in the y variable. For this function to be exponential the function should look something like y=2^x. In any case, unless I misunderstand Gnutella, the problem is not that each peer is connected directly to each other peer but that the network is made up of subnetworks which get choked off when one subnetwork is connected to another subnetwork via a connection which is too small (i.e. 56K modem). This is the same kind of problem one has when using a typical star schema and one attempts to make too many joins for the (i.e. the data is a little too normalized). In order to only have one connection, you would have to arrange this in a client-server fashion, which would defeat the whole purpose of decentralizing the search function. The internet itself is a star schema which works fairly well, but only because nobody puts a 56K modem as a router in between two T3s-- which according to the article is the problem with Gnutella right now.

    --
    I do not have a signature
  28. Napster? Scalable? by Th3+D0t · · Score: 2

    Napster isn't scalable. Why do you think they have separate, non-connected servers?
    ---

    --
    I am the dot in slashdot.org
  29. If/when Napster is shutdown... by Displaced+Cajun · · Score: 2
    Try this: Napigator

    --
    Executive ability is deciding quickly and getting someone else to do the work. --John G. Pollard
  30. Re:Yeess.... It doesn't scale well, so I wrote my by Th3+D0t · · Score: 2

    Why doesn't it show up on SourceForgery now? You don't have to let anyone else work on it until you are finished, and the CVS repository is a great way to make backups. (-as well as perform version control, duh).
    ---

    --
    I am the dot in slashdot.org
  31. Just like mail-order and barter economy by digitalbeing · · Score: 2

    There will have to be an exchange rate, because the taxman will have his due. Some exchange rate will have to be declared, and it will be your responsibility to submit taxes to the relevant state and federal authorities.

    No different from the fact that you are supposed to submit tax from out-of-state mail order purchases directly to your state, and no different from the taxes levied on barter economies like the many community-issued currencies like IthacaHours: http://www.ithacahours.org

    Note if you barter goods you are also responsible for the relevant taxes, for instancing if you "swap" cars.

  32. Re:but what about taxes? by rkent · · Score: 2
    What happens when the US decides to start taxing purchases made on the internet?

    Well, if mojo isn't cash, why does it need to be taxed? It's more of a barter system; I don't think there's tax on that.

  33. Re:demonstration - Gnutella Kicks Napster by nachoman · · Score: 2

    I would have to agree with this. Gnutella is more the protocol then anything else. It is as way of sharing files. There are many modifications to Gnutella out that that use a different set of servers. ABMNet is an example of one. It's popular amoungst newsgroupies.

    ABMnet is a modification for mostly videos/multimedia. (I use it to snag Dr Who videos). It's much better then just using gnutella for a few reasons. There are less users and they all share similar interests in what files are shared. Less users also mean less queries, and so the servers don't get bogged down.

    By using gnutella in such a way to tailor to individual market needs, it can be much better then napster could ever be. If there were a set of gnutella servers just for a particular style of music, the searches would be faster and performance be much better for the users and the servers.

    If you look at it from this point of view, you can't really extend napster too easily (although it has been done with things like napigator).

  34. I may be helping soon... by FascDot+Killed+My+Pr · · Score: 2

    Remember my message of a few days back about how I wasn't helping because it's written in Java? Well, I got spanked for that (and I've gotten spanked re: other anti-Java postings) so I downloaded Kaffe last night. I'll be doing some ramp-up on Java for a while and if my negative view of Java melts away I'll pitch in with FreeNet.
    --
    Linux MAPI Server!
    http://www.openone.com/software/MailOne/

    --
    Linux MAPI Server!
    http://www.openone.com/software/MailOne/
    (Exchange Migration HOWTO coming soon)
  35. Gnutella may not scale, but it is still useful by (void*) · · Score: 4
    Yes, it does not scale. Anyone who has done basic CS101 will tell you that. But this does not mean it is not useful. It just means that it was not cut out to span the entire net. I can see Gnutella working within a college's residential dormitory, for example. Or within an office building. Maybe not to the entire internet, but certainly for small networks, this might still be useful.

    So I don't think Gnutella is going down in flames. Since it is open source, we may take that as a lesson learnt and perhaps rip out the offended non-scalable part and build a better file sharing device that actually works this time.

  36. And in other news by Hairy_Potter · · Score: 2

    ZDNet has reported that Microsoft's peer to peer NetBUIE network does not scale as well as Microsoft NetBIOS over TCP/IP network.

    ZDNET has also reported that when you are setting up a network of more than 10 computers using Microsoft NetBIOS networking, you may wish to consider a client-server network as opposed to a peer-to-peer network.

    And after this commercial break, we report on the latest findings about using coaxial cable for network wiring.

    Like, duh!

  37. Gnutella IS going down in flames. by AFCArchvile · · Score: 3
    Ever seen a list of what the Gnutella client is wading through when it performs a search? I have, and it's not pretty: Metallica, Eminem, Photoshop, Win2k, DivX, Natalie Portman, Britney Spears, 3DSMAX, and a whole slew of smut which I'll omit for the sake of decorum.

    Gnutella was a good idea; it was just taken the wrong way by the moronic serverops who can't avoid sticking a ruler between their legs. Personally, I'd prefer having separate servers for content (mp3 specific network, DivX specific network, binary specific network, etc.).

    --
    "Ancillary does not mean you get to rule the world." --U.S. Circuit Judge Harry Edwards, speaking to the FCC's lawyer
  38. demonstration by TheTick21 · · Score: 4

    I've always thought of gnutella as more of a demonstration than a finished product. While it may not be the best implimentation it shows that distributed file sharing can work well with no central server...its an important step...this version of gnutella may have reached its limit...but there will be more...just some thoughts


    My Home: Apartment6

  39. Death of Gnutella a little premature. by Derek+Pomery · · Score: 5

    In the article they point out that the load could be cut in half by fixing some bad code.
    They further mention that proposals for redesigned version have already been made.
    link from article
    Not only that, it says support and resources for this project are being sought out - it's active, it's open source, what more do we want?
    Given the interest in Gnutella, I don't see any problem finding people to fix known bugs.
    Rather then seeing this as the death of Gnutella, I saw it more as a positive article pointing out known bugs that are being fixed, and announcing a the planning of a new and even more powerful version.

    --
    -- perl -e'print pack"H*","6e656d6f406d38792e6f7267"' /. ate my old sig. Bastards.
  40. Try Self-Organizing by SEWilco · · Score: 2
    The problem with the 56K dialup bottleneck can be reduced by changing the way it uses the network (as the article mentions), and re-organizing the network. It would help if it could detect faster links and group machines based on both service and network characteristics.

    More caching could also help -- a machine might not have a particular item, but it may remember that it recently saw the item. So queries for popular items would quickly encounter a cache entry and be directed to a source. That could be done by having responses be noticed by both the requester and to the machine which passed the query onward -- if there is an "upstream", the popular results would float upward.

  41. Re:Try Java by jandrese · · Score: 2

    Ah, I forgot to mention that one, slow and buggy. I think this has more to do with the terrible Java implementation under FreeBSD though (like Java ICQ).

    --

    I read the internet for the articles.
  42. This isn't "Insightful" by gaudior · · Score: 2

    It's stupid. The architecture of Gnutella is what's broken, not the code which implements it. A true peer to peer network is inherently limited.
    --

  43. a 2^N problem: Metcalf's law by Phokus · · Score: 3

    Another thing came to mind: Metcalf's law. The power over the Internet is equal to 2 to the power of the number of nodes who are actually on the 'net. If you look at the graph of that, it's exponential. I figure in Gnutella's case, it's power would be inversely proportional to the graph. Any comments?

  44. screw gnutella by Frijoles · · Score: 2

    I used to think Gnutella was great. It had speedy searches and was pretty fast. But now it just sucks. It's not so much that searches take forever now, it's that the searches return so much shit with them. Ads for webpages, viruses, things that don't even pertain to what you were searching for.

    Gnutella needs a replacement and doesn't need to continually get a facelift that makes it look nicer.

    --
    -Frijoles-
  45. is gnutella practical anymore? by bloosqr · · Score: 3

    Everytime i've tried gnutella i've managed to find nothing in comparision to napster (even wrapster) i've actually tried just randomly downloading things on gnutella i.e. 60k (goatsex) files and just get timed out. I've heard it was much more usable in the summer however. The only upside of the current version of gnutella is that its highly entertaining watching the stream of searches coming in :)

    Its been mentioned before but some ways of fixing the situation may include doing things like making the searches bandwidth related to filter out the modems. Perhaps a better idea would be to have an auto peer mode where high bandwidth connections become servers for a cluster of machines near them. (Gaining mojo points to take the mojo example for instance) Then clients can just search the (relatively) finite connection of high bandwidth high speed servers much like in the form of napster but the client/server analogy is a bit more fluid..

  46. Moderation Suggestion by intmainvoid · · Score: 2

    Offtopic?

    You americans really don't get sarcasm/irony, do you.

    Maybe it could be a checkbox in preferences "I understand sarcasm and will moderate accordingly".

  47. Re:demonstration - Gnutella Kicks Napster by JabberWokky · · Score: 2
    ABMNet is an example of one. It's popular amoungst newsgroupies.

    So where is it? Other than a group of equestrians that like Arabians, and the Anything But Microsoft Net parody of ZDNet, Google dosen't show anything.

    --
    Evan

    --
    "$30 for the One True Ring. $10 each additional ring!" -- JRR "Bob" Tolkien
  48. check out Mojo Nation by burris · · Score: 5
    check out Mojo Nation which is an open source distributed filesystem that is attempting to address many of the issues that plague systems like Gnutella.

    It uses centrialized content tracking servers, but anyone can run one by just clicking a switch in their client. The content trackers store XML metadata describing the file, so you can search on different fields in different file type categories (easily defineable).

    The the files themselves are broken into small redundant pieces and spread over the network. You only need half of the available pieces to reconstruct the original file. This way the system is resistant to servers disappearing. It also means you distribute your load over many hosts and clients with slower connections can still provide block services.

    The coolest thing is that Mojo Nation has a built in digital cash called "Mojo" and a microcredit system that effectively turns it into a barter system for disk space, bandwidth, and CPU. Whenever you upload, download, search, or otherwise consume another systems resources, you must compensate them with Mojo. The Mojo represents the disk space, CPU, and bandwidth you are using. You can get Mojo by contributing your resources to the network through the client software (it's automagic). This way nobody can consume more resources than they are contributing to the system. Each person that uses it helps to make it stronger. Of course, being a real digital cash system, nothing stops people from sending Mojo to eachother in e-mail and settling the transaction with something like PayPal.

    It's really cool, check it out.

    Burris

  49. Optimization... by pb · · Score: 4

    Some of these problems could be easily solved.

    I think there needs to be a way to tell what the network load on an individual node is, and attempt to negotiate connections with machines of similar connection speeds or ping times up to a maximum load cut-off.

    Of course, there will still be people with hacked clients that report a bandwidth of 0 and a load of 10, but suspiciously have low pings. Those leeches should be killed, or at least swamped with connections...

    Also, it would be nice if the network could re-organize over time, as in, promote people in your segment who give you back successful searches, and cut off branches that don't yield search results. Then everyone who wants free books would eventually find each other, and be separate from everyone who wants free porn (the other 99%, it seems)
    ---
    pb Reply or e-mail; don't vaguely moderate.

    --
    pb Reply or e-mail; don't vaguely moderate.
  50. Bad design by NineNine · · Score: 2

    Peer-to-peer searching was just a bad design. It doesn't make any sense to have to hit thousands of different nodes with each search. Of course there'd be a backup! What's lacking with Open Source developers is a basic understanding of data and databases. The two existing databases are sad compared to Oracle and DB2. Until some database expertise (usually, older, experienced developers) comes in the the Open Source arena, bad data designs like the one in Gnutella is going to continue.