Slashdot Mirror


Netflix Open-Sources "Janitor Monkey" AWS Cleanup Tool

Nerval's Lobster writes "Netflix has released 'Janitor Monkey,' an open-source tool for killing old Amazon Web Services (AWS) instances, that began life as an in-house product. While those hosting a private data center will have little use for this scrubbin' simian, those enterprises with a public cloud can add Janitor Monkey to their administrative bag of tricks. The premise behind the tool is a simple one: while AWS allows for easy (and cheap) experimentation, it's easy for even the most diligent IT pro to rack up unnecessary costs when they forget to shut off a particular instance. While Netflix's Asgard tool—open-sourced in June, because this is how the company rolls—allows administrators to delete unused resources, Janitor Monkey takes things one step further by allowing those instances to be automatically found so that Asgard can clean them up. Over the past year, Janitor Monkey has deleted more than 5,000 resources running in the Netflix production and test environments, the company said. Janitor Monkey detects AWS instances, EBS volumes, EBS volume snapshots, and auto-scaling group."

34 comments

  1. Tool for killing non-in-house instances? by MikeTheGreat · · Score: 0

    an open-source tool for killing old Amazon Web Services (AWS) instances that began life as an in-house product

    This is awesome! My other problem is that I've got a number of AWS instances that did not begin life as in-house products. Will NetFlix release a tool to kill those off as well? Ba-dum-ching! I'll be here all week, folks :)

    1. Re:Tool for killing non-in-house instances? by kelemvor4 · · Score: 1

      an open-source tool for killing old Amazon Web Services (AWS) instances that began life as an in-house product

      This is awesome! My other problem is that I've got a number of AWS instances that did not begin life as in-house products. Will NetFlix release a tool to kill those off as well? Ba-dum-ching! I'll be here all week, folks :)

      It's open source, so fork it.

    2. Re:Tool for killing non-in-house instances? by MikeTheGreat · · Score: 1

      an open-source tool for killing old Amazon Web Services (AWS) instances that began life as an in-house product

      This is awesome! My other problem is that I've got a number of AWS instances that did not begin life as in-house products. Will NetFlix release a tool to kill those off as well?

      Ba-dum-ching! I'll be here all week, folks :)

      It's open source, so fork it.

      *whoooosh*!

      :)

  2. Any relation to the Bathroom Monkey? by Anonymous Coward · · Score: 0

    http://www.nbc.com/saturday-night-live/video/bathroom-monkey/1354961/

    1. Re:Any relation to the Bathroom Monkey? by roc97007 · · Score: 1

      I got bored waiting for the commercial to end, never saw the skit.

      How about the trunk monkey.

      --
      Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
  3. Torn about Netflix by Apu+de+Beaumarchais · · Score: 0

    I'm rather torn about Netflix. I'm not the biggest fan of their service as I see it as kind of expensive for a low quality rental service. Low quality in terms of their "HD" streams being low bitrate for the resolution they are; unless they changed it I have higher bitrate for my 480p rips to h.264 than their HD stream, because otherwise the quality is diminished.

    On the other hand their work on hardening services in the Amazon Cloud is fascinating and the fact they share not just their insights learned from several issues in the Cloud, but also their tools they use to overcome these issues, and now also tools for reducing waste, makes me respect them and consider using the service even though I prefer to license media in the long term.

    1. Re:Torn about Netflix by alen · · Score: 1

      $7.99 a month is expensive?

    2. Re:Torn about Netflix by Anonymous Coward · · Score: 0

      You're just upset they're cutting into the video rental business at the Quik-E-Mart.

  4. Mozilla will sue them by K.+S.+Kyosuke · · Score: 1

    I'm pretty sure they wanted this name for their new GC implementation for the Firefox JavaScript VM.

    --
    Ezekiel 23:20
  5. Slashvertisement? by Anonymous Coward · · Score: 0

    samzenpus posts a "submission" from one of the Geek.net monkeys which just links to a Slashdot "datacenter" rehash. So the /. front page is just clickbait for more /.?

  6. This was needed by sandytaru · · Score: 4, Interesting

    I had an AWS instance that just wouldn't die. Turns out it had some EBS function on the image that caused the instance to zombie itself and come back from the dead every time I killed it - wouldn't shut off permanently til the EBS thing was killed first. Very annoying.

    If Janitor Monkey can do this automatically, it'll save some admins a lot of headaches - and money.

    --
    Occasionally living proof of the Ballmer peak.
  7. License is Apache 2.0 by CrashandDie · · Score: 4, Interesting

    For those of you wondering, the code is open sourced under the Apache 2.0 license.

    You'd think that kind of information would be in the summary, or at the very least the article, but no, you actually have to go and find the repository to find what license it's released under.

    1. Re:License is Apache 2.0 by Anonymous Coward · · Score: 0

      Robert, is that you? Seriously, you remind me of a sysadmin I work with. Quibble much?

    2. Re:License is Apache 2.0 by Anonymous Coward · · Score: 0

      Probably because it isn't an important detail.

    3. Re:License is Apache 2.0 by wiredlogic · · Score: 1

      The Slashdot editors just roll that way, home slice.

      --
      I am becoming gerund, destroyer of verbs.
  8. Netflix uses Amazon Cloud by HardYakka · · Score: 3, Interesting

    Isn't it odd that Netflix runs their streaming service on Amazon's infrastructure, given that they are a streaming video customer competitor?

    1. Re:Netflix uses Amazon Cloud by cdrudge · · Score: 3, Informative

      No different than Apple at one time (and maybe still) running iCloud on Microsoft's Azure cloud service in addition to Amazon's.

    2. Re:Netflix uses Amazon Cloud by Anonymous Coward · · Score: 5, Informative

      Just went to an Amazon conference where they talked about just that thing. Netflix CEO and Jeff Bezos talked about it on stage. Basically, neither of them are threatened by the other, and are happy to play nice. Netflix's business benefits AWS, and obviously vice versa. Just a bunch of nerds, getting along.

    3. Re:Netflix uses Amazon Cloud by luckymutt · · Score: 1

      I'm rather surprised that Netflix isn't using the Azure cloud instead, considering their relationship with MS.

    4. Re:Netflix uses Amazon Cloud by StormReaver · · Score: 1

      Just a bunch of nerds, getting along.

      No, this is Netflix realizing that they are essentially owned by Amazon at this point, and putting on their best facade. And this is Amazon realizing the same thing, and putting on the shit eating grin of an imminent conqueror. Once Amazon's streaming customer base becomes competitive with Netflix's, the former will crush the latter. This is how "cloud" computing is supposed to work, from the viewpoint of the "cloud" owner -- we control your vital asset (delivery), and can take it away at anytime of our choosing.

      People should take technology history classes before running a technology company. Netflix is screwed.

  9. Warning by ThatsNotPudding · · Score: 1

    "Janitor Orangutan will not wear diapers."

  10. Cuz that's how we roll. by Rob_Bryerton · · Score: 2, Insightful

    How about releasing a Linux client, then you can tell us how cool you are, how you "roll".

    1. Re:Cuz that's how we roll. by Anonymous Coward · · Score: 0

      +1, for god sakes, man.

  11. Netflix can't impess me much... by Anonymous Coward · · Score: 0

    ...they don't have a client for my Linux.

  12. Open source: We run it but don't support it by whois · · Score: 2, Insightful

    Thanks for releasing something to the world that someone else might have a use for. Why does your service, which completely defines your company, and uses Linux heavily in it's backend, consider Linux users to be pirates and not allow them to use your product?

    I "roll" with other services, like youtube, or hulu, or amazon which allow users to stream to Linux platforms.

    1. Re:Open source: We run it but don't support it by snemarch · · Score: 1

      Probably because they'd be ripped to pieces by certain Linux zealots if they released a product that support only a few distros because of support reasons? Or because they release a client that isn't opensource? (Which they probably have a hard time doing because of Pesky Patents and Evil NDAs.)

      I personally hate DRM, but I kinda doubt the whole big media mafia will wake up and smell the coffee anytime soon, so what are we going to do in the meantime? Say "screw you, if you treat me like a pirate I'll act like a pirate" and leech .mkv files?

      --
      Coffee-driven development.
    2. Re:Open source: We run it but don't support it by Anonymous Coward · · Score: 0

      Who are you asking? This isn't a customer support line of netflix. You must be confused.

    3. Re:Open source: We run it but don't support it by Anonymous Coward · · Score: 0

      Probably because there's just no Silverlight implementation on Linux that exposes the proper DRM APIs. Anything that requires Flash >11.2 is out as well. This doesn't leave the Netflix devs a whole lot of room to appease the studio assholes who insist on the DRM in the first place.

  13. what could it possibly do? by Anonymous Coward · · Score: 0

    How does it determine cruft resources automatically when I can't even tell what's cruft?

  14. this scrubbin' simian - huh? by Anonymous Coward · · Score: 0

    I guess you have to work in a datacenter to know what this money business is about.

  15. Private clouds by PTBarnum · · Score: 1

    While those hosting a private data center will have little use for this scrubbin' simian

    I don't see why this isn't useful to anyone running dynamic virts; whether on private or public infrastructure. I assume the code as released depends on the Amazon API, but as long as similar functions exist in your private cloud API, it should be possible to adapt the software.