Slashdot Mirror

← Back to Stories (view on slashdot.org)

For League of Legends Creator Riot Games, Big Data Is Serious Business

Posted by Soulskill on from the they-just-need-a-good-jungler dept.

Nerval's Lobster writes "Riot Games created the very successful League of Legends gaming franchise, which hosts millions of monthly users. Barry Livingston, director of engineering for the company's Big Data group, talks about how Riot Games scaled up to deal with that enormous data load. Consider all the millions of people playing the game in real time. Picture joining three massive tables — player data, game data, and session data — and you begin to see the full scope of Riot Games' issue. Gamer activity generates more than 500 GB of structured data and over four TB of operational logs every day. Riot Games has also posted 60 open-source Chef and Opscode recipes, among other code samples."

14 of 33 comments (clear)

  1. Massive bandwidth used for streaming by Whatah1 · · Score: 1

    During the LoL Season 2 World Championships a couple months ago the event stream made up 5% of NA internet bandwidth.

    Casual events streamed on twitch.tv tend to break 40,00 viewers and large events break 100,000

    1. Re:Massive bandwidth used for streaming by blackraven14250 · · Score: 1

      I have no idea why they're using a standard streaming format, when they could probably integrate their spectator mode with some extra streaming bits (for shoutcasters between matches, player images at the bottom of the screen, voiceovers, etc) and a couple tidbits like having the camera directed by a central operator instead of the user in order to save a massive amount of the bandwidth they use to host one of these events. It would be a huge technical undertaking to develop, but has the potential to reduce bandwidth by such a large amount that I'm surprised it's not even considered at this point AFAIK.

    2. Re:Massive bandwidth used for streaming by preaction · · Score: 1

      It probably is/was being considered, but a normal video player is ubiquitous even on mobile platforms, as opposed to what amounts to a spectate-only client which would cost money to develop. And, if they host the video on a provider like Youtube, they don't pay for the bandwidth (unless there are rules above a certain limit).

    3. Re:Massive bandwidth used for streaming by blackraven14250 · · Score: 4, Informative

      Well, they already have a spectator mode built in to their client, with the ability to watch any PvP game being played on their servers on a 3 minute delay (to prevent using it to cheat). There's all of the other technical issues like the ones that I mention that would be required to allow the other functions of a championship game to be broadcasted, but a spectator mode does already exist. Hell, I use LOLReplay, which automatically connects to the spectator view for any and all games I play and saves the replay for later viewing. You can probably use that file size to estimate a cap for bandwidth savings. The largest replay I have is 22MB for a game that lasted an hour and 20 minutes. To stream that in 1080, you're probably looking at over 2GB of bandwidth, so your maximum savings is almost 2GB per viewer. With 10 million viewers (and there were more than that watching the championships on Twitch alone, which was just one of the US streaming providers; I remember seeing 14 and 15 million nearly the whole time), that's an enormous 20 petabytes. Obviously, once you have shoutcast voices and the other streaming bits, you're going to cut into that, but it's going to be a huge savings that could be pocketed rather than given up to the streaming provider (since they're running the ads and taking their cut to pay for that bandwidth before paying Riot their share).

    4. Re:Massive bandwidth used for streaming by hibiki_r · · Score: 1

      That's what Dota 2 is doing: They have an external player, and you can connect to games directly from the game too. There's player spots for official announcers, so you can listen to them, and use their camera view if you wish.

      It provides all kinds of other advantages, like being able to see statistics that the announcer is not looking at, or even see the game for a player's perspective, which is great for learning high level play.

  2. Re:"League of Legends gaming franchise" by LordLucless · · Score: 2, Informative

    Just as much as every FPS ever is just a rip-off of Wolfenstein

    --
    Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
  3. Re:"League of Legends gaming franchise" by Slotty · · Score: 2, Informative

    More accurately: isn't it just one rip-off? It's just DotA.

    Seeing as League of Legends was created by the guy that created DotA he didn't rip it off he just decided to take his own work and develop it into a successful business instead of relying on the ever trustworthy Blizzard who has the best intentions for all their community based developers

  4. Re:"League of Legends gaming franchise" by jhoegl · · Score: 4, Funny

    PPFFTT, that was just a rip off of Pong.

  5. Re:"League of Legends gaming franchise" by Whatah1 · · Score: 2

    There are "obsessive completionists" who are not "professional players". I know people who have played the heck out of this game for a couple years and have saved up enough of the free "IP" to buy every champion in the game without spending any actual money. If they also want to spend actual money to get Riot Points so they can then buy totally unneeded (but perhaps cool) alternate skins for those champs then that is their business.

    From your comment I am not sure if you are referring to the "obsessive completionists" or actual "professional players."

    There are actual pro players, some who get money from streaming, and other who are on a sponsored team getting paid 5 figures + prize money and who live as a team in a house where they practice all day and stream all night. There are about 6-10 popular NA/Eur teams right now, and then a few that come over from China/Korea for the big events. Many of the weekly tournaments have 10k+ prizes (which have to be shared between the 5 players) and the larger events have much larger prizes (season2 championships had a $2,000,000 prize pool with 1mil going to winning team.)

    http://leaguepedia.com/wiki/Season_2_World_Championship

  6. Just sayin' by ThePhilips · · Score: 1

    Gamer activity generates more than 500 GB of structured data and over four TB of operational logs every day.

    Fits in RAM of a single, well stocked server.

    Just sayin'.

    --
    All hope abandon ye who enter here.
    1. Re:Just sayin' by flimflammer · · Score: 1

      ...and?

    2. Re:Just sayin' by BitZtream · · Score: 1

      And ... what they are dealing with isn't that hard to deal with and for most of us who have done any moderately sized projects ... we don't call that 'big data'.

      They are clearly doing it wrong.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
  7. Re:"League of Legends gaming franchise" by flimflammer · · Score: 1

    No.

  8. Discount Jeans,jersey,sunglasses,Hoodies sale by iueyuqru · · Score: 1

    Hello, everybody, the good shoping place, the new season approaching, click in. ===== http://www.sowotrade.com/ ===== Discount Air Jordan (1-24) shoes $35, Air max shoes (TN LTD BW 90 180) $36, Nike/shox (R4, NZ, OZ, TL1, TL2, TL3) $35, Handbags ( Coach Lv fendi D&G) $36, T-shirts (polo, ed hardy, lacoste) $20, Jean (True Religion, ed hardy, coogi)$35, Sunglasses ( Oakey, coach, Gucci, Armaini)$16, New era cap $12, (NFL MLB NBA NHL) jerseys $25, free shipping, Accept credit card and (PAYPAL), ===== http://www.sowotrade.com/ =====