Slashdot Mirror

← Back to Stories (view on slashdot.org)

Inside MySpace.com

Posted by kdawson on from the like-Topsy dept.

lizzyben writes "Baseline is running a long piece about the inner workings of MySpace.com. The story chronicles how the social networking site has continuously upgraded its technology infrastructure — not entirely systematically — to accommodate more than 26 million accounts. It was a rocky road and there are still hiccups, several of which writer David F. Carr details here." From the story: "MySpace.com's continued growth flies in the face of much of what Web experts have told us for years about how to succeed on the Internet. It's buggy, often responding to basic user requests with the dreaded 'Unexpected Error' screen, and stocked with thousands of pages that violate all sorts of conventional Web design standards with their wild colors and confusing background images. And yet, it succeeds anyway."

42 of 250 comments (clear)

  1. I Would Have Signed Up... by Wandering+Wombat · · Score: 3, Interesting
    ... but apparently Tom has enough friends.


    Seriously, I had a look at a few pages, and when I eventually managed to CTRL-ALT-DELETE my browser into submission, I made damn well sure never to go back there. Are there people that actually have enough computing power to handle some of those profiles?

    --
    I like to place meaningful quotes in my sig, so people will know that I know what meaningful quotes are.
    1. Re:I Would Have Signed Up... by Short+Circuit · · Score: 5, Insightful

      Firefox doesn't respond to a normal application close signal when stuck in intensive Javascript loops. I run into similar problems in some articles on Slashdot.

      They really need to break the Javascript engine into a separate thread and avoid hinging all browser response on it. Or maybe that's just a flaw with the XUL way of doing things. Dunno.

      --
      tasks(723) drafts(105) languages(484) examples(29106)
  2. Everyone uses it by burbankmarc · · Score: 5, Interesting

    It's not the stability or the design,it's just that people now adays say "what's your myspace" rather than "what's your phone number" There's tons of other sites out there with more functionality and more stable servers, but...no one uses those, do they?

    1. Re:Everyone uses it by garcia · · Score: 4, Insightful

      It's not the stability or the design,it's just that people now adays say "what's your myspace" rather than "what's your phone number" There's tons of other sites out there with more functionality and more stable servers, but...no one uses those, do they?

      Who are you talking about? Teenagers and college students? You must be, because as an adult, I don't know anyone that says anything of the sort and if they did I would ignore them from that point on. Please note, I'm only slightly outside of the age range where that site is most popular.

    2. Re:Everyone uses it by abigor · · Score: 3, Informative

      Tons of bands use it, small independent movie studios and film productions, etc. etc. Basically, anyone with anything to promote.

      As far as personal profiles go, I'd suspect most people are pretty young, like 20s. But I know of many people in their 30s with MySpace sites also.

    3. Re:Everyone uses it by StarvingSE · · Score: 3, Interesting

      It's called a generation gap. I am in my 20's and admittedly use myspace. I think its a good tool for keeping in touch with old friends or getting back in touch with people you went to high school with. It is buggy, but it does a fairly decent job of sorting out those accounts so that you can find people in your school, company, or whatever. There are a lot of communication tools, like pagers in high school, cell phones in college, and even internet forums (like slashdot) that the younger crowd use and consider essential, but the older crowd takes a while to understand.

      Yes, some of the sites on myspace are crap, but thats totally up to the user. The default white myspace page loads pretty quickly. Myspace hosts the content, they can't control what the pages look like. I have friends who have horrible pages, and I tell them that. But its up to them to host whatever content they want, and up to me to decide to view it.

      I don't want to sound like a myspace fanboy, but I think it gets a lot of unneeded bad press because of things like child stalkers and bad page design. While these things suck, they happen because people exploit and abuse the system. Let's face it, myspace is still new and immature, but will probably get better and more polished given time and money.

      --
      I got nothin'
    4. Re:Everyone uses it by nunojsilva · · Score: 4, Informative

      It's the same that's happening with MSN Instant Messaging: It's broken, the official client is the worst IM client I've ever seen, and it does not support important features as formatted text (multiple formatting in a single message), but people use it.

      Also, when somebody wants to discuss something, or just talk, over the Internet, he/she asks "What's your MSN?".

      Talking about MySpace, I've only visited it a couple of times (to see a football (soccer) player's myspace (which, probably, was just built by some fans), and Nick Sagan's one), and I told myself "I've never seen a site like this one - how can they call this a web page?".

      But I know this sort of sites. At school my colleagues don't use myspace, they use hi5. And I've used it some times when I was still accessing it from public computers, with Portable Firefox. But when I accessed it with my laptop (i686 300Mhz 64Mb), it was *very* slow to load.

      Solution? A member of the INDUCKS project invited me to their forum at orkut, so I started exploring that social network. It had the same sort of silly server errors (sometimes you see a "Bad, bad server, no donut for you!"), but they didn't occur as frequently as in hi5, and the site design is clearer than the one used at Orkut.

      Fortunately GMAIL and Orkut have Gtalk integration, which means that everyone with an account in one of these services will be able to login at gtalk. This is good for me because some of my colleagues had to change to GMAIL accounts because a (very good!) teacher told us he wanted to send important documents via e-mail and that Hotmail was not the ideal tool, and the consequency is that now I'm able to talk to them using gtalk instead of MSN.

      The big problem here is "eye candy". People like myspace because it's eye candy. People like the MSN client because it's eye candy. And the same happens with hi5 and other equally bad sites.

      There's tons of other sites out there with more functionality and more stable servers, but...no one uses those, do they?

      May you tell us which better sites do you know? I'd like to know :-)

    5. Re:Everyone uses it by HAKdragon · · Score: 4, Informative

      As an ex-myspacer, I know of the ocular and mental angish caused by some of the pages on myspace. However, greasemonkey and the myspace custome style remover script make using myspace bearable.

      --
      "Our opponent is an alien starship packed with atomic bombs. We have a protractor."
    6. Re:Everyone uses it by um...+Lucas · · Score: 3, Interesting

      The reason myspace became what it's become is:

      Because it allows users to heavily modify their pages. Hell, there's a cottage industry built up of hacks and codes to change a users profile around.

      Because it lets users put songs on their profiles to hear, so that they can feel like their profile is their own (neverminding the other 20,000 profiles with the same song)

      User blogs are published to RSS... i don't know about bulletins or other functions, probably not, because then it'd have to store the user name and password somewhere in order to get it right...

      So, go ahead, write a "better" myspace... and no one will come.

      However, if you look at what users WANT and give them something better, they will... Myspace is nothing but the next generation after LiveJournal, Friendster, etc... There's going to be something new after myspace, and i'm betting there's at least 20 companies out there trying to figure out what it'll be...

    7. Re:Everyone uses it by DerekLyons · · Score: 4, Insightful
      MySpace shouldn't have allowed their users to modify the pages so heavily. They shouldn't have allowed people to have music that plays when you visit the page. They shouldn't have made a system that can't talk to other stuff (like del.icio.us tags or RSS readers). They shouldn't have made it so freaking hard to use. (It takes three times as many clicks to do on something on MySpace than what it should take.)

      It's fascinating to see such a comment modded up on Slashdot - which is normally the bastion of freedom and personal rights to do whatever the hell they want, when they want.
       
       
      I write web apps for a living.

      But here we see the truth - Slashdot who screams the loudest when $MEDIA_MEGACORP tramples on *their* (assumed) rights - bellows equally loudly when their own ox is gored.
       
       
      I know what a good app looks like. I could write a better MySpace clone in the space of a weekend. However, nobody would use it. Why? Because it's not "MySpace."
      It's no wonder they had so much trouble keeping the system up and running, because they're obviously not professionals.

      The term you are looking for is sour grapes.
    8. Re:Everyone uses it by veganboyjosh · · Score: 3, Interesting

      i wonder how many of the 26 million are active only to send spam...

    9. Re:Everyone uses it by kevinbr · · Score: 3, Interesting

      The demographic is now over Thirty in age I read somewhere. People perhaps do not realize that MySpace band space is killing the recording studios.

      I am launching a tiny record label because my A and R man is MySpace. I can find all the talent I need and I can see who might be a success by seeing do they post their gigs ( i.e. they actual play gigs ) and how many people they have as fans and how often people listen to the posted tracks.

      The reality is that bands might not actual need a label - they can self publish but that takes energy which a lot only put into music.

      The other reality is lots of little band makeing 100K smooths out the business away from the 100 bands pulling 99% of the income to a more equitaable world where more musicians can actually make a living.

      My theory is that recorded music is going to be more a teaser for live acts than a main source of income.

      I am working with 4 unknowns to try and get something out this year. Thanks to MySpace.

  3. Scalability by eviloverlordx · · Score: 4, Funny
    In November, MySpace, for the first time, surpassed even Yahoo in the number of Web pages visited by U.S. Internet users, according to comScore Media Metrix, which recorded 38.7 billion page views for MySpace as opposed to 38.05 billion for Yahoo.

    The bad news is that MySpace reached this point so fast, just three years after its official launch in November 2003, that it has been forced to address problems of extreme scalability that only a few other organizations have had to tackle.


    I agree. Keeping up with all of the pedophiles is something that most businesses rarely have to deal with.
    --
    'Loose' is when your pants are three sizes too big. 'Lose' is when you misuse 'loose'.
  4. printer friendly by pezzonovante1 · · Score: 4, Informative

    article here with no ads

  5. For now. by onion2k · · Score: 4, Interesting

    And yet, it succeeds anyway.

    All that "power" that they've given to the users, coupled with the nasty CSS it takes to use it, will be their undoing. There's no way that they can change now without breaking millions of profiles and really annoying a huge number of their users. It's a textbook example of poor long term vision. MySpace is a huge success now, and it will continue to be for a while. One day though someone will make a social network that is quick, easy, and customisable in a well-thought out way. Then MySpace will empty very, very quickly.

    Mind you, there's no reason why that site wouldn't be MySpace2 or something. I'm only refering to the network, not the company.

    --
    http://twitter.com/onion2k
    1. Re:For now. by toadlife · · Score: 3, Interesting

      There's no way that they can change now without breaking millions of profiles and really annoying a huge number of their users. They most certainly can change it, and it wouldn't be as impossible as you think. What they would do is create a new page layout schema but support old one at the same time. When the new schema goes live, all new users would automatically be assigned the new schema while existing users would stay on the old one. Existing users would then be coaxed into adopting the new layout via banner advertisements, or in-house "spam". It would take awhile to do the migration, and a cutoff might need to be implemented after a year or so to take care of orphaned pages, but impossible it would certainly not be.
      --
      I don't always use unix-like operating systems; but when I do, I prefer FreeBSD.
  6. Niche market... by djones101 · · Score: 5, Insightful

    MySpace has the stranglehold on the niche market. Any and every person who just wants their own pegboard, office cubicle side, or office wall to decorate can do so in cyberspace, especially students who otherwise have no way to really express themselves (at least in their own opinion). It takes very little experience to develop your own page that does exactly what you want. It's the Google Gadget system for the common user, or Geektools for High Schoolers, if you want to call it that. Unless someone can find a good way to draw a significant userbase away from MySpace (and I haven't seen anything that will come close), they will continue to succeed.

  7. Everyone signs up because.. by necro2607 · · Score: 5, Funny

    ... they click on the pictures of the hot girls, only to get a "You must be logged in to do that!" message.

  8. Why is it so hard? by dedazo · · Score: 4, Insightful
    Every single time I see a MySpace "analysis" there's that snide, bloghorati uber-alles comment about "web standards" and "lack of design". Holy crap. I am no fan of MySpace, but at least I'm mature enough to realize that people (normal people) don't give a dead rat's ass about CSS, DOM, XHTML, microformats, "mashups" or any of that other stuff that the self-appointed standards nannies of teh interwebs have decided everyone should observe closely or face death. A standardized and structured semantic web space is important, but please rent a fucking clue. They don't care. MySpace is never going to fix something that in their opinion is quite certainly not broken, because their users love it, and they get to dance with it all the way to the bank.

    Just fucking deal with it and stop pointing out that ==--~~L0N3rz1124~~--=='s blog does not validate. We know, and they don't give a shit.

    --
    Web2.0: I love when people Flickr my cuil and digg my boingboing until my google is reddit and I start to yahoo
    1. Re:Why is it so hard? by Jett · · Score: 3, Insightful

      Where is the line then? The few times I've tried to figure out what the hell is up with myspace my browser gets beaten to death by the horrific web design. I saw one page where multiple flash players loaded several video and audio files AT THE SAME TIME. The inmates can only run the asylum for so long. It's great they've managed to build a "web 2.0" version of Geocities, but when half the pages they host required a multi-ghz beast of a machine to even load I don't see how their model can really be sustainable. You either follow standards and good design or you let your users produce web pages which crash most peoples browsers.

    2. Re:Why is it so hard? by Kris_J · · Score: 3, Informative

      Oh, for crying out loud, just install FlashBlock.

  9. Google. by SanityInAnarchy · · Score: 4, Interesting

    I want everyone to remember that when Google came out, there were quite a few well-known search engines out already. Google was simply better enough than the others that it took over.

    If anyone is reading this, and has the resources to do it -- or maybe has some 20% time at Google -- the only real solution to MySpace (other than praying that they fix it themselves) is to offer a competing service that is so ridiculously much better than MySpace that it will do what Google did. Anyone remember Facebook? In college, not a single person used MySpace, yet everyone was in Facebook -- if Facebook was open to the public (not just people in school), it would likely kick MySpace's ass around the block.

    --
    Don't thank God, thank a doctor!
    1. Re:Google. by vasqzr · · Score: 5, Insightful

      In college, not a single person used MySpace, yet everyone was in Facebook -- if Facebook was open to the public (not just people in school), it would likely kick MySpace's ass around the block.

      I believe it is open now.

      Do you really want the people on MySpace taking over Facebook?

    2. Re:Google. by Cairnarvon · · Score: 3, Informative

      Facebook has been open to the general public for months, much to its old userbase's dismay. They introduced the no-network and the regional accounts last September somewhere, IIRC.

  10. And we know why they're there. by Kadin2048 · · Score: 5, Funny

    As far as personal profiles go, I'd suspect most people are pretty young, like 20s. But I know of many people in their 30s with MySpace sites also.

    So, in other words, MySpace's chief demographics are "20-somethings" and "people trying to sleep with 20-somethings."

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  11. Re:Blah... by owlnation · · Score: 3, Funny

    I was personally surprised to see no mention of where they keep the ponies and glitter. I was sure that was how they ran of their technology. Must be a industrial secret...

  12. Well... by remmelt · · Score: 4, Funny

    His keyboard repeat rate probably couldn't keep up with the exponential browser pop ups.

  13. Google & 20% time by remmelt · · Score: 3, Insightful

    You mean like Orkut?

  14. Retrieving comment... by awing0 · · Score: 5, Funny

    Sorry! an unexpected error has occurred.

    This error has been forwarded to Slashdot's technical group.

    --
    Cthulhu Saves.
  15. Examples of horrible MySpace design? by TerranFury · · Score: 4, Interesting

    I keep hearing references to horribly designed myspace profiles. For the benefit of those Slashdotters who haven't see this dreck, please post your most egregious examples in reply.

    1. Re:Examples of horrible MySpace design? by hyperizer · · Score: 3, Interesting

      http://www.myspace.com/farleyjackmasterfunkcom

    2. Re:Examples of horrible MySpace design? by Sloppy · · Score: 3, Interesting

      Horrible profiles are (almost *) totally irrelevant. In Firefox, just go to View/PageStyle/NoStyle, or use the "Toolbar MS" extension and dig the "de uglify" button. Instantly, the user added bullshit goes away.

      MySpace's real problem is that the website just plain sucks, regardless of cosmetic issues and user-modified stylesheets. Some examples...

      • Javascript!!!! They use Javascript for lots of things instead of links. Go to "view all my friends" and try to right-click the next and previous links so that you can open them in new tabs without losing the current page. Oops. Can't. They're not really hyperlinks. They methods. This error is pervasive through many many parts of MySpace. There are tons of places, tons of lists, that can't be navigated like "normal" websites, because they use javascript as alternatives to hyperlinks. There is no excuse for this. They went to extra trouble to make the website harder to use.
      • Book III: Sorting and Searching
        • This amazes me: MySpace can't sort. If you have a couple hundred friends, go ahead and try to find a specific one. I pity the people with thousands. Sorting a list is one of the most basic fundamental things that programmers learn to do, in order to make it easier for a user to find something in a long list. MySpace still doesn't have it, after 3 years. Sorting! How old were you when you learned to sort?
        • Likewise, you can't search your friends list. Know someone's name on your list? Then page through your list sequentially, until you find them. And hope your eyes don't miss. This blows my mind, it's such a basic fuckup that should be so trivial to fix. It's staggering. Maybe I'm paranoid, but I just can't imagine how this isn't intentional. Nobody fucks up this bad. Like the sorting problem, this is also pervasive. Post something in an active forum or group, and try to find your post later so that you can read replies. Good luck, you're going to need it!
      • Complaint du jour... Calendars have been semi-broken for the last couple of weeks. I click on "manage calender," it defaults to bringing up a totally random date in 1935 or 1998, and well, well over half the time I try to enter something and save it, I get the "unexpected error" page (like it's really unexpected by now!). How hard is it for a machine to know the current date? How hard is it to save a calendar entry? (Ok, the article is sort of actually about this.. MySpace has serious database problems. I finally realized, when they say "SQL Server" they're not so much describing a piece of software, as they are naming it: they're using Microsoft products! Holy shit! Microsoft products on busy servers!)

      * That said, there is one semi-serious cosmetic problem with MySpace. Apparently users can customize their profiles to such an extreme degree, that their profile looks like a MySpace login page, submitting the form to a different server. In other words, you can connect to MySpace, thinking you're on a login page, but send your authentication credentials somewhere else. So that's why so many people post bulletins about Free Ringtones and Anime porn! ;-)

      This post brought to you by the punctuation character "!"

      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
  16. Re:Membership Milestones? by Viper+Daimao · · Score: 4, Funny

    No, they went from 150 million down to 26 million. You obviously forgot this story.

    --
    "In the game of life, someone always has to lose. To me, if life were fair, that someone would always be Oklahoma." -DKR
  17. Re:Membership Milestones? by arthurpaliden · · Score: 3, Interesting

    Only about 30% of all accounts are really active, accessed once every 2 weeks. (Yes I have the data)

    --
    Undetectable Steganography? Yep, there's an app fo
  18. tips for browsing myspace by vindimy · · Score: 3, Informative

    1) Use Firefox (more secure) with pop-up blocker
    2) Use Adblock plugin for Firefox (blocks most ads) with auto filter updating
    3) Use Flashblock for Firefox (blocks most movies and survivor ads)
    4) Block CSS/JavaScript if your eyes hurt or you're getting dizzy
    5) Use Web Developer toolbar for Firefox if you need more control
    6) Get a 13-year-old to translate the pages for you (old people hack)

    Enjoy

    --
    Check out Pandora by Music Genome Project
  19. MOD PARENT DOWN!! by adamofgreyskull · · Score: 3, Funny

    For the love of god! MOD PARENT DOWN!

  20. The Bright Side of MySpace. by Paulrothrock · · Score: 5, Insightful

    Look at it this way: The more people use MySpace, the fewer "OMG FWD THIS TO EVERY 1 U NO!!!" emails you'll get. It's like a ghetto for annoying people on the Internet.

    --
    I'm in the hole of the broadband donut.
  21. Windows 2003 denial-of-service "feature" by sych · · Score: 3, Funny
    From TFA:
    Last summer, MySpace's Windows 2003 servers shut down unexpectedly on multiple occasions. The culprit turned out to be a built-in feature of the operating system designed to prevent distributed denial of service attacks--a hacker tactic in which a Web site is subjected to so many connection requests from so many client computers that it crashes. MySpace is subject to those attacks just like many other top Web sites, but it defends against them at the network level rather than relying on this feature of Windows--which in this case was being triggered by hordes of legitimate connections from MySpace users.

    "We were scratching our heads for about a month trying to figure out why our Windows 2003 servers kept shutting themselves off," Benedetto says. Finally, with help from Microsoft, his team figured out how to tell the server to "ignore distributed denial of service; this is friendly fire."

    WHAT?!

    So, Windows 2003 has a "feature" that deals with denial-of-service attacks - it shuts down! Brilliant!
  22. What were they thinking? by Percy_Blakeney · · Score: 4, Informative

    I'm a bit surprised that at the sequence of stages that their architecture went through. They bought expensive servers, mega-expensive SAN's, completely changed their platform from ColdFusion to ASP.NET, tried data segmentation...

    And then finally implemented a caching layer in front of the databases!

    That should have been the very first thing that they tried, as any experienced developer would have known. Instead of buying that SAN for a billion dollars, maybe they should have just invested in some competent employees.

    1. Re:What were they thinking? by kiran_n · · Score: 3, Interesting


      Finally a comment on the architecture of the whole thing (which, if anyone would have bothered to RTFA - wait am on Slashdot...). What is conspicuous by its absence is the lack of consideration of other Web Server technologies. I'm sure other technologies would have been considered - any Web Server architect worth his/her salt would surely have looked at alternate Apache/Linux or Apache/FreeBSD and other database technologies.

      The comments on Slashdot definitely are going downhill.... Would have expected to see more on the analysis of the movement from ColdFusion to ASP.NET...

    2. Re:What were they thinking? by davros-too · · Score: 3, Insightful
      That should have been the very first thing that they tried, as any experienced developer would have known.

      I guess the problem is not much overlap between the 'internet startups' developers and the 'corporate megasite' developers. If the developer's whole career has been building and supporting sites where they think a few million page views a month is big, they are going to really struggle when that turns into millions per day or per hour.

      Would a caching layer have solved myspace server problems without also implementing SANs for storage and clustering db servers? I've no idea, not having any experience with such large sites, but I sort of doubt it. Would love to see some comments from people who have... anyone? ... anyone?
      --
      In theory, there's no difference between theory and practice; in practice there is.
  23. It was founded by spammers by qzulla · · Score: 3, Interesting

    MySpace founders Chris DeWolfe and Tom Anderson had previously founded an e-mail marketing company called ResponseBase that they sold to Intermix in 2002. The ResponseBase team received $2 million plus a profit-sharing deal, according to a Web site operated by former Intermix CEO Brad Greenspan. (Intermix was an aggressive Internet marketer--maybe too aggressive. In 2005, then New York Attorney General Eliot Spitzer--now the state's governor--won a $7.9 million settlement in a lawsuit charging Intermix with using adware. The company admitted no wrongdoing.)

    In 2003, Congress passed the CAN-SPAM Act to control the use of unsolicited e-mail marketing. Intermix's leaders, including DeWolfe and Anderson, saw that the new laws would make the e-mail marketing business more difficult and "were looking to get into a new line of business," says Duc Chau, a software developer who was hired by Intermix to rewrite the firm's e-mail marketing software.

    Fancy that.

    qz