Slashdot Mirror


Shirky On P2P

There's an interview with Clay Shirky over at O'Reilly's OpenP2P network regarding P2P. Some of the piece is wordy ruminations over what peer to peer (and dear lord do I hate that term) is, and where it's going - but the most interesting part, IMHO, is the talking about web services and the changing definition of "client" and "server".

27 of 97 comments (clear)

  1. terms by Satai · · Score: 2

    (and dear lord do I hate that term)

    Me too - but not as much as I hate CRM, B2B, and all the other crap that's always sprayed across the front of InfoWorld.

    /me thinks the 'free subscription' was just a ploy to dumb him down with acronyms.

    1. Re:terms by Satai · · Score: 2

      Perhaps it should be P2P as in: 'Person 2 person' as Point 2 point is a little to obvious and non-descriptive.

      I thought that's what it was. Isn't PPP the abbrev'n for Point to Point Protocol?

  2. Re:P2P by GlassUser · · Score: 2, Interesting

    Well email WAS peer to peer, way back in the day when you would telnet into a server (or just use a serial cable with a dumb terminal), you had POP and SMTP right there. Later in the day, it would dial up with whatever peer was scheduled, and belch out its mail, get fresh mail, and sort it. Repeat for the next host. It's only recently that we have the luxury of most servers having high-speed always on connections.

  3. Rise and Fall of a Buzzword by number+one+duck · · Score: 2

    Its clear to me that the 'p2p' fad as begun to slip away, through a combination of people realizing it was nothing new and TLA's realizing that that part of the natural order must be crushed in order to maximize profits. (Thats right people, be afraid... they don't want to *ensure* profits, they want to *maximize* them, so throw any images of altruism out the window please).

    In comparison, I'd like to draw your attention to another recent buzzword/fad combination, the repeating rifle. Previous to its adoption as a standard military tool, it was employed by some individuals to great effect. Later, as one side adopted it wholesale, it gave an unbelievable advantage to a single army (The United States of Napster). Nowadays, however, everyone has a repeating rifle, thanks largely to the datahaven provided by the USSR... cheap AK-47's are available anywhere in the world, usually for about US $25. At this point it was a moot point, since the buzzword race had moved to nuclear weapons by this time.

    Where my analogy breaks is I don't think .NET and 'internet services' are anywhere near nuke significance. Someone else must be coming up with something... somewhere...

  4. And it goes marching on by kurowski · · Score: 4, Interesting
    I never cease to be amazed by how much effort is put into creating new ill-conceived technologies to work around old ill-conceived technologies. For example,
    • because we chopped up the IP address space based on byte boundaries rather than bit boundaries, an artificial scarcity was created that led (in part) to the widespread use of DHCP and NAT
    • DHCP and NAT arguably broke DNS and prevented people from running traditional server processes on their boxen so we created P2P software
    • due to the numerous security problems that surface (due primarily to misconfigurations) we invent firewalls that block traffic
    • due to firewalls blocking everything but HTTP, we invent a whole new protocol stack on top of HTTP (i.e. SOAP)
    and so on and so on... I'd include the push of XML to "fix" the problem of differing binary data formats, and the creation of XML Schemas to make up for the lost type information in all those mismatching DTDs and so on. But you all get the point.

    I do admit that the ultimate goal of the web services vision is admirable, but it seems to me to be just a bloated (UDDI+WSDL+SOAP+XMLSchema+HTTP(+P2P?)) version of what many software agent research groups have been after for years. Come on people, stop the insanity! There's gotta be a better way!

    (and no, I didn't read the whole article, i had to stop and release the built up rant pressure before the insanity blew my head open. go ahead and mod me down for being an offtopic troll now.)

  5. Another definition? by iforgotmyfirstlogon · · Score: 3, Funny

    I had a friend that got a promotion because he got to be good friends with the guy that owned the boat next to his in the marina.

    Would that be considered "Pier to Pier Networking"?

    - Freed

    --
    "Coffee should be black as hell, strong as death, and sweet as love." -Turkish Proverb
  6. Web services my arse by imipak · · Score: 2

    There was some discussion of "web services" on Perl Advocacy list recently. I come down on the side that says Apache is all you're ever going to need. Look, Slashdot is technically an application... does that make Slashcode an n-tier application server? Purlease. It's just marketing - web servers are SOOOOO 90s, now we call 'em "web services".

    1. Re:Web services my arse by imipak · · Score: 2
      I'm following up on these comments waaay to late to be read, but wtf :)

      lash stopped being just a news/discussion web app and started being a web service when they proffered xml so that automated agents can query & filter stories so that by the time it gets to the human, the experience is easily customized according to your rules and does what you need it. That's what a web service is.

      So 'web services' are only of any use to developers? (I'm assuming that that a user who is capable of scripting some sort of RDF parser to pop up the latest /. headlines on their desktop comes under the heading 'developer'.) Users of such applets are still just Users. And let's face it, you don't need a fancy XML framework to enable a script to go grab the latest /. stories: that's what LWP::Simple and regular expressions are for ;)

      WRT the 'time spent sifting HTTP data' argument... hmmm. Personally, I find that the process of sifting is what the Web experience is all about. Intermediaries such as Slashdot aggregate others' content and provide links and commentary; I trust some more than others, but I don't read every /. story (by any means). I'm more than happy for skilled human editors *cough* to play the part of intermediaries; Slashdot of course allows anyone to submit a story and become an editor themelves. /THAT/ is what the web experience is all about: many to many, via an arbitary subset of mediators. I'm sure there's an apposite quotation from The Cluetrain Manifesto at this point, but I don't have the book with me right now...

  7. Not really - Client / Server communications... by Midnight+Ryder · · Score: 2

    I don't know what the big fuss is all about. Hasn't the Internet always been peer-to-peer? Why even come up with a new name for it?


    Not really - try Client / Server instead. For instance, you don't send email to someone directly - instead you send it to you server, which then talks to another server, and the end client downloads the email from the server.


    Browsers talk to servers - you are the client. FTP clients talk to servers. It goes on and on... most of the Internet has been (and probably will continue to be) Client - Server comminications, not Peer to Peer communications.


    --

    Davis Ray Sickmon, Jr - looking for something to read? Check out my three free novels at MidnightRyder.org

    1. Re:Not really - Client / Server communications... by Jace+of+Fuse! · · Score: 2

      The funny thing is -- that everybody's acting like "Peer to Peer" is some recent buzzword that was created in this new age of unwashed idiot internet users.

      It wasn't coined recently. It's been around forever. It's just that nobody ever bothered saying "Yes, this network is peer to peer..." or "...this one has a server."

      I remember hooking up two Amigas with a parallel cable and running that nifty little tool called "Parnet". It was supposed to create a "Peer to Peer" network of ... uh ... two computers.

      Not much of a network, but in a way it kind of resembles the internet of today. A kludge.

      --

      "Everything you know is wrong. (And stupid.)"

      Moderation Totals: Wrong=2, Stupid=3, Total=5.
    2. Re:Not really - Client / Server communications... by Greg+W. · · Score: 2

      For instance, you don't send email to someone directly - instead you send it to you server, which then talks to another server,



      I don't do it that way -- I run my own mail services on my own Unix systems, with a static IP.



      and the end client downloads the email from the server



      If someone's using dial-up, that's their problem. I have no control over the messages once they're handed to the MX.

  8. Web Services: How different from the Web? by cshirky · · Score: 4, Informative

    This is a really important debate right now, and there are no good answers. The debate comes down to how much do we need to do to the Web as we have it today to be able to create an environment where programs can be as interoperable as web browsers and servers are today?

    There are growing criticisms of the consensus vision of web services -- http / SOAP / WSDL / UDDI -- largely on the grounds that its complexity is un-web-like, and that there are uninvented and possibly uninventable layers required above UDDI for any two arbitrary applications to be able to find each other in the dark.

    Dave Winer of Userland, inventor of XML-RPC and co-designer of the SOAP spec, advocates an embrace of these two protocols by the Open Source movement as a lightweight way to advance the battle for interoperability. (Dave's ideas in many ways answer the Will Open Source Lose the Battle for the Web? article form earlier this month.)

    Another group, in line with your "Apache is all we need" idea, has taken Roy Fielding's idea of the REST (REpresentational State Transfer) architecture as a way to extend existing web semantics furhter into the domain of applications. They have started a RESTWiki to expand on those ideas.

    This is all a big mess right now, with no obvious clarity coming any time soon, but two things we can be certain of are that experiments with application-to-application traffic is going to increase dramatically in the next 12 months, whatever the framework, and that with MSFT driving this idea as part of .NET, even if a lot of it is hype, it will affect our world a great deal.

    -clay

    1. Re:Web Services: How different from the Web? by imipak · · Score: 2
      But... forgive me if I appear dense... why should we want web sites to be interoperable? I guess this is the reason I'm so baffled by this 'web services' thing: I just don't understand what they're needed for. OK, Microsoft would like Expedia to be able to share user data with, say, Hotmail - perhaps so they can implement a single sign-on, perhaps so that they can make sure they rotate the banner ads you see. Whatever. But why should the sites I use (to take a random example) need to interoperate? Slashdot, NASA Space Science, The Register, BBC News, Security Focus. Hmmmm. Single sign-on isn't going to save me much time there. Is this some sort of eCommerce thing? And if so, why should competitors want to share customer data?

      Sorry, I just don't see it. I think it's marchitecture designed by people who took Wired magazine a little too seriously. "Experiments with application-to-application traffic"? Do me a favour! It smells like a dead duck, it looks like a dead duck, and frankly it quacks like one, too.

      Time will tell - personally, I reckon this is the first 'VRML' of the 21st Century.

    2. Re:Web Services: How different from the Web? by smallpaul · · Score: 2
      But... forgive me if I appear dense... why should we want web sites to be interoperable?

      This reply is a little late but this question seemed so strange to me that I couldn't help but answer it.

      First, you discredit single sign-on but if you are a typical end-user with a dozen subscriptions to a dozen sites, single sign-on is a big deal and a massive improvement over sticky notes on your monitor.

      Second, if you are selling something, wouldn't you want your product specifications (and in some cases your price) disseminated as widely as possible? If you sell digital cameras, you would absolutely love it if digital camera sites can easily incorporate your product specifications into their site.

      People already do this stuff. How do you think the non-Slashdot Slashboxes work? They are XML-based web services (not SOAP, but web services nevertheless). The hype around web services is just about standardizing the information sharing that organizations already do. One you standarize it, you build network effects and economies of scale.

      Is this some sort of eCommerce thing? And if so, why should competitors want to share customer data?

      Competitors don't. Partners do. Anyhow, you seem a little obsessed with single sign-on and user data. User data is just one kind of data worth sharing. There is also product data. Realtime product availability information.

    3. Re:Web Services: How different from the Web? by imipak · · Score: 2
      It's the discussion that refuses to die ;)

      I'll address your points in order.

      Firstly, I /am/ a fairly typical end-user, and I do what 95% of end-users do: I have a small number of username/passwords which I have been recycling for the past four or five years. Obviously you don't want to do this for anything super-sensitive, but who in their right minds entrusts super-sensitive personal data to a third party?

      Secondly: if I'm selling something on the web, then my specifications and pricing data are /already/ as widely distributed as possible (routing glitches permitting.) That's what the first two "W"s in "WWW" stand for! I definitely wouldn't want third parties snarfing product data from my site and selling on to consumers: I'd be losing all that interesting marketing and demographic data. If "DigitalCameraNews.com" o whatever wants to link to my site, fine, I'm delighted.

      Slashboxes? Does anyone actually use them? I don't. Perhaps I'm not that typical an end-user after all... my preferred sources of news are not a subset the given slashboxes: slashboxes are all very kewl, but they don't really scale very well.

      Realtime product availability data comes from the vendors own stoick control systems. You really think Argos (a typical UK consumer goods reseller) are going to entrust their stock control to manufacturers? I just don't think it's going to happen on any significant scale.

      Returning to my VRML example: were you around when VRML was being hyped as the future of the Net? Just because something is technically possible, doesn't mean it'll work in the real world. (See WAP for another example: if you want to make pots of money, short stocks of telcos who spent a fortune on 3G licenses now, cos they'll be bankrupt or taken over within five years. )

      Lots of time and money was put into demonstrating that the whole idea just wasn't going to fly. I'm open to the remote possibility that I'm wrong about this ;) but I'm not holding my breath. I guess only time will tell.

    4. Re:Web Services: How different from the Web? by smallpaul · · Score: 2
      There are good reasons for organizations to share structured data. My company does it. Slashdot does it (slashboxes). Yahoo does it (where do they get stock quotes and maps?). Google does it (ODP RDF dumps drive the Google Web directory). General Motors does it (EDI). That's what a purchase order is. Do you think that we'll still use primarily paper purchase orders in ten years?

      The only question is whether we all hand-roll our own solutions or have standards for doing it. XML is the structured data specification and web services are about how to move the information from place to place.

      VRML was totally different because it was about building customer demand for a new product (3D). Sharing structured information is not new. Most web-connected organizations do it in one way or another today. Just as the Internet glued together the disparate proprietary networks, the web services standards try to glue together disparate information sources.

      If you want to argue against the necessity for particular standards, we could have an interesting discussion. But you seem to want to deny that organizizations need to share information in real time. Or that we need standards to lower the cost of doing that.

    5. Re:Web Services: How different from the Web? by imipak · · Score: 2
      OK, some good points. I'm certainly not arguing that enterprises have no need to exchange structured data, or that XML isn't a Good Thing that is being widely used already and will grow. As you say, in the real world, [ very expensive but highly reliable and available] systems such as EDI, or the UK BACS cheque clearing system (interbank funds reconciliations) etc are used. And, at the other end of the spectrum, there are Slashboxes and probably 'some' similar uses.

      This certainly does /not/ mean that a significant number of /web sites/ need to share data. Commercial partners: yes. Web sites? nah. EDI is expensive partly because it doesn't run over the internet - let alone over HTTP. There are very good reasons for this...

      VRML wasn't purely marketing driven. Everyone who jumped aboard the bandwagon had an angle on how it was going to be great, including many intelligent dedicated code hackers and highly technical people. In the same way, I think the 'web services' meme clicks with a lot of developers who've had to reinvent the wheel over and over again. I fail to see how this can drive it's use, though; companies stay prosper or file chapter 11 on other criteria than whether the developers have a fun time building the systems.

      Perhaps I have misunderstood what is meant by "web services". A backend database replication or stock updating system is nothing to do with the web except that the data /may/ end up used on a site. But that's nothing new: how does Slashdot (or ZDNet, for that matter) get their content? How does Amazon get it's content?

    6. Re:Web Services: How different from the Web? by smallpaul · · Score: 2

      Okay now we are converging.

      "Web Services" don't necessarily have anything to do with "Web Sites" except insofar as most modern development is exposed through a website in one way or another.

      Web services are called Web Services because they use Web standards like HTTP and XML. Plus it just gets the VCs excited to prefix anything with the word "Web" (or it did a couple of years ago when the term was coined). Essentially they are distributed computing protocols built on top of existing Internet protocols.

      Even so, some web SITES do want to share structured information. Check out meerkat.oriellynet.com. Slashdot probably gets its slashbox content using a system similar to meerkat. Google gets XML content from the Open Directory Project.

      Also, one point that Clay Shirky made is that there are some radicals who think that HTTP is the only protocol you need to do structured information interchange -- whether you are doing "Web site" stuff or not, they claim you should expose your structured data through HTTP(s). (even if you only give the password to your partners)

      EDI is expensive partly because it doesn't run over the internet - let alone over HTTP. There are very good reasons for this...

      Many people disagree with you. Most EDI people are running towards the Internet as quickly as possible. That's the whole point of ebXML. Maybe value added networks will survive for security and quality of service but non-IP protocols are dead.

  9. SOAP by BierGuzzl · · Score: 2

    What I see in this article, the constant references to web services learning from P2P and vice-versa, is already realized in SOAP. We've just got to harness it.

  10. Flamesuit and thinking cap ON. by Odinson · · Score: 2

    I bet some people would pay alot for a gnutella (for example) anonymizer/redirect cache service.

    example:
    [customer machine]
    (connects too)
    [SUPER NODE:file location cache,server cache,new anonymous name]
    (connects too)
    [gnutella network cloud.]

    Slogan: Garrunteed anonimity barring court order, instant connects, instant searches.

    Hey anonimity might work for ISP's too, but no infrastructure would be neccesary for the big cache service, just bandwidth.

    PS:cmdrtaco "Lameness filter encountered. Post aborted!" was trigered by an ASCII network diagram.

  11. Not TLA by sulli · · Score: 2

    FLAA. (Four Letter Asshole Associations)

    --

    sulli
    RTFJ.
  12. The first network I ever owned... by Midnight+Ryder · · Score: 2

    The funny thing is -- that everybody's acting like "Peer to Peer" is some recent buzzword that was created in this new age of unwashed idiot internet users.


    Strange how that works, eh?


    It wasn't coined recently. It's been around forever. It's just that nobody ever bothered saying "Yes, this network is peer to peer..." or "...this one has a server."


    Concerning the Internet, yeah. For networking in general, the term was out there. Even MS was making the distinctions in thier manuals for Windows for Workgroups 3.11 (insert flashback to much worse days... WfW 3.11 *SHUDDER*) The term has been kicked around for a long time, but, now with this new 'peer to peer' networking thinggy on the Internet, it introduced quite a few people to the term. And, as someone else pointed out, Peer to Peer means Napster or some other evil technology these days it seems. *SIGH*


    I remember hooking up two Amigas with a parallel cable and running that nifty little tool called "Parnet". It was supposed to create a "Peer to Peer" network of ... uh ... two computers.


    hehehe - man I remember this. I built that stupid bidirectional parallel cable and hooked up the two 1000's. (IIRC, there was a slight difference between the 1000's and the 2000's parallel port that screwed hooking up to the 2000 - which had a bigger HD) I thought that was like the coolest thing... then realized I had almost nothing useful to do with it! ;-)

    --

    Davis Ray Sickmon, Jr - looking for something to read? Check out my three free novels at MidnightRyder.org

  13. It's economic and political, not technical by dpilot · · Score: 2

    So far it seem to me that everyone except "Trollman 5000", the only mention of RIAA and MPAA in this whole topic, is missing the point.

    There are major economic forces, forces so big that they are (hopefully temporarily) superceding the US Constitution, that are effectively trying to turn the Internet into a big broadcast medium. Essentially, to a media mogul used to TV and Radio, every electronic distribution means ought to look like TV and Radio. (Kinda like the old hammer/nail thing)

    Centralized focus means ease of control. It means you can easily go after an ISP for content posted on their servers. The lawyers can wield a big OFF button.

    Peer-to-peer is much more difficult to police, though it sounds as if they're trying against Gnutella.

    But then realize just WHO runs the cable ISPs, and then take a look at their TOS, and it's immediately obvious WHY. Aside from not having adequate amounts of the correct competence to run a data network, they know that personal servers and peer-to-peer are more difficult to control. Therefore, "No servers for the use of others" is the most common rule on Cable. Note that DSL is generally more open, and that fits with the parent organization being a non-content-owner.

    But as a cable subscriber with no hope of DSL, peer-to-peer is beyond my reach.

    So...

    We need a peer-to-peer proxy, for two reasons.

    First, it lets me connect out of cable, and once connected to the proxy, it lets me act as a peer. If the cable companies got a little more enlightened, they might even let run the proxy themselves. (Yeah, right! Who wants to wait?)

    Second, as Code Red has shown, with default Microsoft security and Joe Sixpak running his home PC, the Internet simply isn't a safe place. For the most part, perhaps ISPs should allow NO incoming connections, by default*. A peer-to-peer proxy would be the only thing keeping the concept generally viable, in that case.

    (*) By the same token, they should allow the knowledgable user to open ports. (Again, fat chance!)

    --
    The living have better things to do than to continue hating the dead.
  14. Making peer to peer go away by Animats · · Score: 2
    There's a big push in the telco industry to get DSL "under control". RedBack Networks is providing much of the technology for this. Their white papers are scary.

    RedBack has a model for DSL that the telcos love.

    • "You click on an icon for the service or application you require, fill in some basic subscription and payment information and gain access to the service you need. When you have finished using the service, you "hang up".
    And they mean it. They want users to open separate PPPoE connections for separate, and separately priced, services. Their video conferencing example uses $0.35/minute as a suggested price. Users will no longer connect to "the Internet", they will connect to specific, paid services, billed through the telco via the PPPoE connection mechanism.
    • The SMS allows Service Providers to "resell" the same link by offering subscribers dynamic access to multiple services, thus generating more revenue per subscriber.
    That's pitched to telcos. The whole RedBack push is "more revenue per subscriber line". Quality of service can be different for each PPPoE connection. Thus, the "quality of service" mechanism can be used to throttle the non-premium services down to low data rates. This encourags use of premium services, and slows down "unauthorized" distribution of content.

    The telcos have tried this business model before, with X.25 (an overpriced flop), Minitel (an overpriced flop in the US), ISDN (an overpriced flop in the US), and 900 numbers (an overpriced success, but only for porn.) Here we go again.

    None of this would go anywhere except that in the US, DSL is becoming an unregulated monopoly. This gives monopoly telcos the power to force this on their customers.

  15. Mojo Nation and other swarming apps by Jim+McCoy · · Score: 2
    I think that the sort of systems you are talking about are the so-called "swarming" systems. Pioneered by Mojo Nation, these systems break content up into lots of pieces which can be served in parallel, speeding up transactions as the network gets larger. Other swarming apps are Swarmcast, EDonkey2000, and it looks like Centerspan is going to be pushing a swarming app soon.

    Many hands make light work...

  16. web services, big deal by scrytch · · Score: 2

    Jeepers, we were going to have a shiny happy remoted interconnected interoperating world with CORBA. And before that it was RPC. Now we're supposed to get it with UDDI and SOAP and so forth. Why? What's changed that people are going to completely throw out the window the idea of orthogonal client and infrastructures.

    Let's look at CPAN for a second. Here's how you run a CPAN site: cd to a public ftp directory and wget --recursive ftp://some-cpan-url. The smart client figures out the rest, and people can use dumb ftp clients too.

    Here's how slashdot disseminates its feeds in XML and RDF and HTML: you grab it from a URL, and the webserver shovels it at you, blithely ignorant of the semantic meaning of the bits it's transferring around.

    In the magical world of webservices, you now get to write special methods on the server end, configure the server to invoke them, and in general ensure that you don't interoperate with anything. Oh yes, you also get to classify the whole system with some big bureaucratic UDDI schema that is supposed to describe it all to any capable client, as if you didn't already write the client to work with this domain-specific protocol already.

    All this might be great for intranet apps ... I just don't see it serving its purported purpose of generic information interchange.

    --
    I've finally had it: until slashdot gets article moderation, I am not coming back.
    1. Re:web services, big deal by Matts · · Score: 2
      Here's how slashdot disseminates its feeds in XML and RDF and HTML: you grab it from a URL, and the webserver shovels it at you, blithely ignorant of the semantic meaning of the bits it's transferring around.

      Welcome to web services.

      There's a lot of possible layers there. Yes you can use SOAP and WSDL if you want to, but at it's simplest layer you're providing a service of information (rather than HTML) over the internet (doesn't have to be over HTTP). Slashdot is providing a simple web service in its RSS feed. I think you'll see a lot more people coming to the conclusion that they don't need SOAP and WSDL. Straight XML served over HTTP perhaps with parameters in the querystring is an excellent way to deliver web services.

      I have a paper on why this is an excellent way to do things that I gave at the open source conference, but my web server is offline right now and won't be back up for about 4 weeks (due to the wonderfulness of British Telecom). When it's back, you'll be able to find it at http://axkit.org/docs/presentations/tpc2001/

      --

      Matt. Want XML + Apache + Stylesheets? Get AxKit.