Slashdot Mirror


The Wayback Machine is Deleting Evidence of Malware Sold To Stalkers (vice.com)

The Internet Archive's Wayback Machine is a service that preserves web pages. But the site has been deleting evidence of companies selling malware to illegally spy on spouses, Motherboard reported Tuesday. From the report: The company in question is FlexiSpy, a Thailand-based firm which offers desktop and mobile malware. The spyware can intercept phone calls, remotely turn on a device's microphone and camera, steal emails and social media messages, as well as track a target's GPS location. Previously, pages from FlexiSpy's website saved to the Wayback Machine showed a customer survey, with over 50 percent of respondents saying they were interested in a spy phone product because they believe their partner may be cheating. That particular graphic was mentioned in a recent New York Times piece on the consumer spyware market.

In another example, a Wayback Machine archive of FlexiSpy's homepage showed one of the company's catchphrases: "Many spouses cheat. They all use cell phones. Their cell phone will tell you what they won't." Now, those pages are no longer on the Wayback Machine. Instead, when trying to view seemingly any page from FlexiSpy's domain on the archiving service, the page reads "This URL has been excluded from the Wayback Machine."

92 comments

  1. Thatâ(TM)s a shame by Anonymous Coward · · Score: 0

    Thatâ(TM)s a shame.

    1. Re:Thatâ(TM)s a shame by FatdogHaiku · · Score: 1
      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
  2. robots.txt by Thad+Boyd · · Score: 5, Interesting

    The Wayback Machine obeys robots.txt, even retroactively. If a site puts up a robots.txt file, archive.org will remove old versions of the site.

    1. Re:robots.txt by thegreatbob · · Score: 1

      Indeed, it's not an immutable archive of all that ever was. I would hope they would actively preserve the data if presented with a court order, at least.

      --
      There is no XUL, only WebExtensions...
    2. Re:robots.txt by Anonymous Coward · · Score: 0

      Automated System Works As Designed!! SJW's With Axe To Grind In Uproar!!! News At 11!!!1!One!

    3. Re:robots.txt by Anonymous Coward · · Score: 0

      because vice.com is such a reliable source of real journalism, never pulls bits out-of-context to create 'stories' out of thin air, and never over-sensationalizes or hypes anything their editors can dream up.

    4. Re:robots.txt by gnick · · Score: 3, Insightful

      The thing about preserving data is that you need to do it before the court order to be of any use.

      --
      He's getting rather old, but he's a good mouse.
    5. Re:robots.txt by jythie · · Score: 3, Interesting

      It is not all that mysterious that such a policy or mechanism exists, but it still highlight's the piece's argument that we need more archives since a single point of failure is, well, a single point of failure. I remember growing up people talking about how 'the internet is forever' and 'once it is out there it is always there', but over the decades one slowly finds more and more things that seem to be gone for good if they fail to be popular enough to keep spreading.

    6. Re:robots.txt by Anonymous Coward · · Score: 1

      And then they stopped obeying it: https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/

      Which is bad and will lead to countermeasures from an increasing number of people. I for one intend my web sites to be a transient form of communication. I don't care if you personally make a copy for yourself, but the pages are not for someone who didn't read them when they were published. I absolutely do not want to fuel any stalking, mild or threatening. I am not a politician, celebrity or other person of interest. I stopped posting to Usenet when DejaNews showed up with an archive from times long before people were aware that their every comment would be archived. If these militant archivists don't honor explicit requests to not have a site archived, then they will destroy the public web. Everything will go the Facebook way: Hidden behind logins and access control lists.

    7. Re:robots.txt by Bryansix · · Score: 1

      True story bro. That's why Tim Pool left that garbage organization.

    8. Re:robots.txt by Anonymous Coward · · Score: 0

      Then send them an email saying you do not wish your site to be indexed. They say they honor all such requests.

    9. Re:robots.txt by rahvin112 · · Score: 4, Interesting

      The internet archive (Wayback Machine) does not delete the data for sites with robots.txt that restrict data access. It simply marks the pages as unavailable if it already has them. Now I don't know if they will download new copies once the robots.txt is changed but they don't delete data they already have.

    10. Re:robots.txt by Anonymous Coward · · Score: 0

      Or they could behave themselves like non-psychopathic people and not ignore an explicit statement that disallows archiving. If they don't want to do that, they can have the escalation they're asking for. I have a couple hundred megabits/s at my disposal: How about I crawl their site and ignore robots.txt? I like my archives very up to date.

    11. Re:robots.txt by Anonymous Coward · · Score: 0

      Spot on.

      https://www.flexispy.com/robot...

      User-agent:Yandex
      Allow: /common/*.css
      Allow: /common/*.js
      Disallow: /*?
      Host: www.flexispy.com

      User-agent: *
      Disallow: /*?
      Sitemap: https://www.flexispy.com/sitem...

    12. Re:robots.txt by Anonymous Coward · · Score: 2, Informative

      the wayback machine does not delete stuff. It will remove it from the public site at the request of robots.txt, but it doesn't actually delete its archive. If robots.txt changes again, it comes back

    13. Re:robots.txt by Anonymous Coward · · Score: 0

      So very true. Want to get drivers for old (ie, XP or earlier) PC hardware? Good luck. Most companies that still exist in one form or another have blanked out their archive. Others that still have it around (Asus and Via) may have a BIOS update but fail to include the flasher, so good luck figuring out which one to use and hunting on their website for the right version, or they include drivers but the actual look-up tool on the website is broken in some web browsers (worked in Firefox and not Chrome).

      I mean, overall I've been lucky because there's other retro people around and so long as your hardware is reasonable popular there's still some support for it from other people into "retro" hardware. Other bits are still very hit and miss--my sound card in my SS7 has drivers installed from when I got it and looking online has at best found similar drivers by the chipset maker (but not the card maker) and a lot of websites that are clear clickbait (and probably malware) providers.

      It's even more fun when you actually get into information on compatibility. What games require Windows 98 and would be a good fit*? What programs even work on Windows 98 and the Win32 support is not a misnomer? That's really hit and miss.

      * Lots of sites offer pointers of games that were popular on 98 but perhaps 90% of them at least either work fine on Windows 7/10 (good job Microsoft) if you can get them installed or there's patches to make them work on Windows 7/10. More interesting are the games that only really work on 98 or for which the patching process makes it not really worth it to get it working on later Windows machines if you have a 98 machine**.

      ** And why have a Windows 98 machine? Because I've upgraded multiple times, people sell older dual core laptops for $5, and so there's a lot of machines that are virtually overpowered for Windows 98 and can functional as near-free top-of-the-line systems for older games. It'd be nice to take a hand at repurposing some of those machines and not just trashing them. No point in Linux (since that's my main machine and everything gets recompiled, so no real compatibility thing to worry about). So, DOS/Windows 98 is one area to explore.

    14. Re:robots.txt by Anonymous Coward · · Score: 0

      robots.txt is not "an explicit statement that disallows archiving".

    15. Re:robots.txt by Anonymous Coward · · Score: 0

      But this is. And if I tell their crawler specifically that it is not to crawl the site, then that's pretty clear too, isn't it?

    16. Re:robots.txt by Anonymous Coward · · Score: 0

      because vice.com is such a reliable source of real journalism,

      All news organizations fuck up, because nobody is perfect. The question that matters is how they handle their fuck-ups - do they correct them, do they learn from them so they won't repeat the same mistake, etc. So, if you have specific accusations, lets see them so we can evaluate how vice handled their shit. Otherwise quit wasting our time.

    17. Re: robots.txt by Anonymous Coward · · Score: 0

      This has fuck all to do with social justice, you sad one trick pony.

    18. Re:robots.txt by jythie · · Score: 1

      It can get even worse when looking for non-commercial stuff. Tracking down old blog posts or amature music videos can be a real pain, or they can just be outright gone. Stuff that does not get meme worthy disappears when either the single source goes away or when google/youtube purges it.

    19. Re:robots.txt by brewthatistrue · · Score: 2

      Yes it does, which is unfortunate. In the past I've noticed this when domain squatters acquire an expired domain and the Web Archive begins denying access to archived pages from the original site.

      This appears to be a misread of the robots.txt intent.

      Apparently, the "Robot Exclusion Protocol" was intended to prevent unattended crawlers.
      However, the Internet Archive also prevents human initiated crawls, and retroactively removes access to previous crawls.

      Here is a quote from the FAQ of Archive.is, an internet archival service similar to the Internet Archive's Wayback Machine:

      > Why does archive.is not obey robots.txt?

      > Because it is not a free-walking crawler, it saves only one page acting as a direct agent of the human user. Such services don't obey robots.txt (e.g. Google Feedfetcher, screenshot- or pdf-making services, isup.me, )

      which links to Google Feedfetcher's FAQ:

      > Why isn't Feedfetcher obeying my robots.txt file?

      > Feedfetcher retrieves feeds only after users have explicitly started a service or app that requests data from the feed. Feedfetcher behaves as a direct agent of the human user, not as a robot, so it ignores robots.txt entries. Feedfetcher does have one special advantage, though: because it's acting as the agent of multiple users, it conserves bandwidth by making requests for common feeds only once for all users.

    20. Re: robots.txt by Reverend+Green · · Score: 1

      How fortunate then, that no one is asking you to pay for Internet Archive.

    21. Re:robots.txt by Calydor · · Score: 1

      That is EXTREMELY short sighted.

      If a company dies should we just forget they ever existed, without ever being able to go back to look at who and what they were? There were never any Amigas because Commodore went and died later on, and if Microsoft were to shut down tomorrow suddenly Windows and DOS have never existed?

      You are promoting the very revisionism this article is complaining about.

      --
      -=This sig has nothing to do with my comment. Move along now=-
    22. Re:robots.txt by Anonymous Coward · · Score: 0

      No it doesn't. The second post on the page you linked to has a link to a blog post about why the Wayback Machine has stopped obeying robots.txt.

    23. Re: robots.txt by Anonymous Coward · · Score: 0

      i put my robots.txt in ur momz

    24. Re: robots.txt by Anonymous Coward · · Score: 0

      I can prove it too cuz @urMomz texted "Put It In Me!" to @Robots yesterday.

  3. if you make site unavailable by Anonymous Coward · · Score: 1

    with robot.txt i read that this causes wayback to remove *all* previous references to site. Correct me if i'm wrong :)

  4. Just like the "Internet Archive": It's bullshit by Anonymous Coward · · Score: 0

    Don't like a webpage archived by IA? Just buy the domain and reactivate it, removing IA's archive!

    What a fantastic bunch of historians!

    1. Re:Just like the "Internet Archive": It's bullshit by SirSlud · · Score: 1

      They're not historians.

      --
      "Old man yells at systemd"
  5. They will delete yours too, if you ask by Anonymous Coward · · Score: 5, Informative

    See https://archive.org/about/faqs...
    If you want to delete your site from the wayback machine, all you have to do is ask them. They are not obligated to keep any page in the archive, whether it contains "evidence" or not. You can also exclude ia_archiver user agent in your robots.txt, which will prevent your site from being indexed in the first place. This way you will not even have to ask them.

    1. Re:They will delete yours too, if you ask by jarkus4 · · Score: 3, Informative

      Robots.txt will not work as they started ignoring it (https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/), but the email method still works.

  6. It wasnt malware by Anonymous Coward · · Score: 5, Funny

    It wasnt malware, in the American language it would be called something like a "analytics's and management platform, with realtime reporting and active asset monitoring and protection"

    1. Re:It wasnt malware by Anonymous Coward · · Score: 0

      Analytics. Hmm. Not... plural... enough. Let's add an s and see what happens. Analyticss. No, that looks a snake said it. Hmm. I got it! I'll put an apostrophe in there! Analytics's. Perfection!

    2. Re:It wasnt malware by AvitarX · · Score: 1

      I think what you mean is "Management and Analytical Logging softWARE"

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    3. Re:It wasnt malware by Anonymous Coward · · Score: 0

      Okay. *shrugs* You got me. Where do I send the investment money?

  7. A.S.I.B. by Anonymous Coward · · Score: 0

    And So It Begins!

  8. Yep, that's how it works by Anonymous Coward · · Score: 5, Insightful

    It is very annoying, but that's how it works. The worst is when a site that is owned by an entity who goes out of business is preserved by the wayback machine, but then another entity gets the domain, puts up a robots.txt and there goes all the history.
    For all the good it is doing, it would be so much better if it did not apply robots.txt retroactively. It doesn't even make sense, robots.txt says "bots stay out", which is not nearly the same as "bots, forget whatever you had visited in the past"...

    1. Re:Yep, that's how it works by bill_mcgonigle · · Score: 3, Insightful

      Almost certainly this is how archive.org manages to not get sued out of existence by malicious litigants who want to hide their misdeeds.

      If you can figure out how to make the legal system non-abusive, let's do that and then I'm sure archive.org will keep all their old crawls available.

      In the meantime let's support them for staying around.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  9. Illegally spying on spouses? Stalking? by shaitand · · Score: 0

    I guess legally separated couples might be an exception but seriously, how do you "stalk" someone you are already married to? It wouldn't even rate "stalking" if you were just checking up on someone you were dating to see if they were being loyal. As a married couple you'd generally own whatever device you are putting malware on and at worst have a definite legal claim to ownership until the spouse proved you didn't contribute financially directly or indirectly to them being able to have that device.

    Thanks to tinder and the like has cheating really become pervasive enough that public opinion sides with finding excuses to stop something that really does nothing more than make it harder to cheat?

    1. Re:Illegally spying on spouses? Stalking? by jythie · · Score: 2

      Having a pre-existing relationship doesn't make anything more or less stalkery.

    2. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 1

      Regardless of legality, putting spyware on your significant other's phone is stalking, plain and simple, and is a sure sign of an abusive relationship.

    3. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      OMG. Marriage is not ownership.

      Are you saying cheating is becoming mainstream because of technology? Citation needed.

    4. Re:Illegally spying on spouses? Stalking? by Bryansix · · Score: 2

      I'll just go out on a limb here and say that I'm sure this law varies state to state.

    5. Re:Illegally spying on spouses? Stalking? by nuckfuts · · Score: 2

      ... how do you "stalk" someone you are already married to?

      Gee, I dunno, maybe you could "intercept phone calls, remotely turn on a device's microphone and camera, steal emails and social media messages, as well as track a target's GPS location".

    6. Re:Illegally spying on spouses? Stalking? by imidan · · Score: 1

      If you mistrust your wife so much that you feel like you need to install software on her phone to spy on her, what you should be thinking about is not whether this is legal because you technically part-own the phone. You should be thinking about getting a divorce. You're obviously unhappy, and your paranoia and controlling behavior is probably not making her life any better, either.

    7. Re: Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 1

      Considering the statistics on cheating (roughly half of both married men and women will admit to researchers they have cheated on their spouse at least once), the odds are very much in the favor of truth not paranoia if you think your spouse is cheating.

      Once you get to that point it doesnâ(TM)t matter who or how often or whatever unless youâ(TM)re in one of those shitty places that require a reason for divorce.

      Thank God for no-fault divorce.

      â"happier now after dumping that bitch

    8. Re:Illegally spying on spouses? Stalking? by Shotgun · · Score: 1

      Would hiring a private investigator also be considered abusive stalking?

      There are significant legal and financial ramifications to being married to a cheating spouse, and one thing you have to have is proof. But, I guess you feel that only those able to afford a private investigator deserve justice.

      --
      Aah, change is good. -- Rafiki
      Yeah, but it ain't easy. -- Simba
    9. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      Yes, it is abusive stalking. If you're that suspicious of your spouse, just get the divorce. It would be inevitable at that point, anyways.

    10. Re:Illegally spying on spouses? Stalking? by viperidaenz · · Score: 1

      It's not ownership of the person, but legally it's joint ownership of their assets.

    11. Re:Illegally spying on spouses? Stalking? by shaitand · · Score: 2

      So you have two modes, absolute blind trust and bail at the first sign of anything that manages to wiggle through it? Your spouse is human, humans lie, humans do selfish things, humans make mistakes.

      Your spouse doesn't need to know your every thought or action but if there is something you are making available for literally any other third party (network provider, government, friend, etc) and you don't think marrying a person implicitly and automatically amounts to granting consent to that plus more you'd never share with another party it's you who should probably just get a divorce.

      There are very important and obvious reasons for that, not the least of which is if you are unconscious your partner has the right to give access to all that information to someone else and also make choices like whether or not a doctor should do something that will kill you if you've eaten X or been exposed to Y in the past 24hrs.

      There are paranoid partners out there but having a doubt or suspicion in an innately fallible thing isn't the issue. Not seeing your partner as someone you ultimately trust is a marriage killer. I might write something in a message I'd rather my wife not see and I'd be annoyed if she were looking in my messages with out some sort of reason but of course she has the right to look at them without legal consequences. Your spouse can give consent to a law enforcement officer to search your possessions and information waiving your right to privacy but you think they shouldn't be legally entitled to waive that the same right when they have need?

      In my house the bar for looking at one another's text messages is at the "oh yeah, I remember (s)he sent that address I'm trying to find to Joe last week."

    12. Re:Illegally spying on spouses? Stalking? by shaitand · · Score: 1

      "OMG. Marriage is not ownership."

      Giving up the right to sex without the consent of the person you are marrying is one absolute and universal thing that marriage absolutely includes. That consent is required even if the sex doesn't involve them. Just because someone doesn't own you doesn't mean they don't have rights or that you can do anything you want without consequences. If you violate that agreement they have a right to know and for that information to be disclosed in a divorce. Of course if you are at the point where you are willing to have sex your partner doesn't consent to it baffles me why you aren't getting divorced already since that is pretty much the only thing marriage is, the ultimate level of commitment not to have sex your partner doesn't consent to.

    13. Re:Illegally spying on spouses? Stalking? by shaitand · · Score: 1

      Which would be stalking... if you were doing it without some sort of legal relationship that gives a party the legal right to that information or even to authorize others to it like say an ISP agreement or a LEGAL MARRIAGE.

      Remember a few years back DOD funding resulted in a process that let researchers extract an image someone had seen from their visual cortex? Your spouse can consent on your behalf to have that procedure done and see the results.

      How is this any different than hiring a private investigator? People lie and break commitments, no amount of blind trust is going to change that nobody deserves blind trust and that when someone breaks that trust the other party has a right to know and they deserve to face the consequences.

      But forget cheating for a moment. What is the harm in real stalking? There actually isn't any, it's just creepy. All the rest of the justifications on making such activity illegal revolve around slippery slope fallacies but really its freaking creepy. But what is creepy about your spouse being able to locate you or your phone? If there is some kind of emergency who is the person you are supposed to trust to make the call on whether reaching you is more important than your privacy in that moment and needs to be able to act on it. Your spouse. Your cell phone provider already has malware shipped with your phone that includes these capabilities, they can and at times do all the things you've listed above. You risk the horny entry level AT&T guy watching you in the dressing room for the sake of being able to take pictures with animal faces replacing your friends, did you somehow think marriage wasn't consenting to share data to a larger degree than the click-through on FB?

      Seriously, if your spouse hearing something you are saying on a call, seeing you changing, or anything you might say in an email or social media message, or being able to see where you are gives you the creeps you should probably be married to someone you trust and who isn't so creepy.

      That person who keeps his partner a prisoner... one in hundreds of millions, partners dramatizing situations to the point where they sound like they are comparable to keeping a spouse locked up in a mountain cabin or a basement dungeon more like 1 in 20. Now take a moment to filter anytime you consider if something which is creepy or wrong should be illegal consider whether you'd rather have it happen than be locked in that basement dungeon for years because that is what you are literally saying should be done to the person who did that wrong thing.

    14. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      Hiring a private investigator is perfectly legal, not abusive, and not stalking. It's an essential part of a lot of divorce and custody battles. But not everyone can afford thousands of dollars to hire an investigator.

      It's probably illegal to install some types of spyware on the cheating spouse's phone (such as the ones that record calls), but laws vary, and some may be perfectly legal to install on a jointly-owned phone that the spouse happens to be using. And it's also probably legal to hook up forensic software and download everything.

      Even those who can afford an investigator will need to know where to send the PI, and when, so surveillance tools can save thousands - that will be better spent on the kids.

    15. Re: Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      Under the American Empire many people have been thrown in the Gulag for "raping" their wife. Something bad happened to their culture. Americans have come unhinged - they lust for the iron boot of tyranny.

    16. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      That's funny because as little as I understand why people would marry at all, I've always presumed it had to do with finances, taxes, inheritance and offspring. Many married couples don't practice monogamous sex. Even more married couples don't practice any kind of sex. Something about your notion of marriage is off.

    17. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      1. A spouse isn't property. Being married doesn't entitle either party to control or monitor the other. Would it be acceptable to install spyware on a coworker or friend's phone? Or have a PI follow them? Of course not. Why should it be any different for a spouse? That's like saying that hitting your wife or husband is okay because you're married.

      2.

      So you have two modes, absolute blind trust and bail at the first sign of anything that manages to wiggle through it? Your spouse is human, humans lie, humans do selfish things, humans make mistakes.

      It is the one who can't control his or her own suspicions that is the problem, and it is the partner that needs to escape an abusive marriage.

      People cheat because they have a need that isn't being fulfilled at home. Put the shortest, tightest leash on them and it's still going to happen. And doing so might actually make it worse if that unfulfilled need is trust and comfort.

      I just tell my wife to make sure the guy is rich and likes to change diapers.

    18. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 0

      Maybe, but of the couples that *don't* practice monogamous sex, they either entered into the relationship with that understanding or mutually agreed to it, which means "consent". Shaitand is exactly right in this regard. If my wife had unprotected sex with a stranger she met in a bar and I didn't know about it, she has put *me* in danger and taken away my right to informed consent!

      On the other hand, if I *knew* she was whoring around, I wouldn't touch her with someone *else's* junk until she got tested and came back clean.

      When my wife cheated on me, I simply looked at the cellphone records for our jointly-held account to get all the information I needed. Since I was paying the phone bill and it appeared in the online account information, I considered it "fair game". I didn't install spyware on her phone because I didn't care about her text messages or phone calls or anything else! She didn't want the kids, so there wasn't going to be a long custody battle where I would have to prove she was unfit, and even if she had wanted them, there were plenty of reasons why a judge wouldn't have granted her custody without going through all the trouble...

      Now you can *bet* I gave my kids cellphones and turned on the tracking features before my ex ever took them out of state for the first time, because I wanted to make sure she didn't kidnap them... But that's a different situation!

    19. Re:Illegally spying on spouses? Stalking? by retchdog · · Score: 1

      "Remember a few years back DOD funding resulted in a process that let researchers extract an image someone had seen from their visual cortex?..."

      uh, no? we're easily decades away from that, if it's possible at all, but it's pretty easy to cook up a "demo" that's convincing enough to part rubes from their money. of course, there are plenty of cash-flush rubes in DOD... good old financial incentives can get scientists and engineers to accomplish anything, even the impossible, as long as you don't look too close at the smoke and mirrors.

      --
      "They were pure niggers." – Noam Chomsky
  10. Respectful attitude by CustomSolvers2 · · Score: 1

    As already commented in this thread and in other previous ones, the Wayback Machine reacts to robots.txt restrictions by deleting all the records retroactively. Even though I might personally prefer a different behaviour, this is undoubtedly a very honest approach: deleting all the collected information after the first indication that the given site/person might not want it! Quite a few sites should learn something from them.

    --
    Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    1. Re:Respectful attitude by tepples · · Score: 1

      If the owner of a particular domain wishes that the HTML documents available through that domain be made available indefinitely, even after the domain owner's insolvency, what should the domain owner do to prevent the domain from being snapped up by a third party that sets robots.txt?

    2. Re: Respectful attitude by Anonymous Coward · · Score: 1

      Bullshit, there's no reason for a robots.txt to be retroactive. I corresponded with someone at archive.org probably 15 years ago and they don't get that domains change ownership and there's no reason or really any right of a new owner to disallow information that archive.org's robots previously collected, especially as a domain parking company or reseller can, for no good reason block access to a site that although at the time had the same domain, was never theirs. Think of a museum that allowed pictures to be taken of the historic and creative works that had, another business comes along and buys the building and suddenly all your pictures disappear or you get a legalese form from saying that you no longer have the right to have those photos and that they must be destoryed. Doesn't make much sense does it?

    3. Re: Respectful attitude by Anonymous Coward · · Score: 0

      Even in this case, which is a different situation, there's nothing immoral or unethical about archiving a site that allowed it at the time, even if they change their minds later. robots.txt should NOT be honored retroactively.

    4. Re:Respectful attitude by CustomSolvers2 · · Score: 2

      If the owner of a particular domain wishes that the HTML documents available through that domain be made available indefinitely, even after the domain owner's insolvency, what should the domain owner do to prevent the domain from being snapped up by a third party that sets robots.txt?

      I don't like that scenario and, probably, most of people doesn't do either. But it seems an unavoidable drawback of this whole approach. This is a private company with private interests and obligations (not precisely providing a public service for any random internet user) which, as such, can do whatever they want with their data. There seems to only be one limitation to that absolute power: what the person/company referred by that data wants to do with it. Bear in mind that we aren't talking about the typical user-opens-account->generates-data->user-tells-how-to-use-data, but about systematic collections of data which, in most of the cases, happen without the given user knowledge. How to know who is the owner now and yesterday? How to deal with eventual ownership conflicts?, etc. Everything would become too complicated, too invasive (all this additional personal information would have to be stored), etc. They might have chosen a more conservative alternative like deleting only the current files, but preferred to make sure that no information without a clear permission will be kept.

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    5. Re: Respectful attitude by AvitarX · · Score: 2

      They're erring on the side of caution, because they don't want lawsuits.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    6. Re: Respectful attitude by CustomSolvers2 · · Score: 1

      As written above, this scenario of multiple owners does sound bad, but accounting for it seems quite difficult. From the point of view of the current approach of the Wayback Machine, there aren't owners but domains, assumed to always belong to the same person. I am not defending their current approach or even saying that I like some of these outcomes, just appraising their honest attitude (in case of doubt, don't keep anything!) and understanding their difficult position. Also as commented above, accounting for different ownerships would add a further layer of complexity/personal data collection which might provoke other problems or might be beyond what they are willing to do.

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    7. Re:Respectful attitude by _Sharp'r_ · · Score: 1

      Don't sell the domain? Make your own copy of the html documents in question and publish them elsewhere? Publish a copy from the backups you kept?

      These are simple solutions which don't require you to rely on a third-party to do stuff for you for free...

      --
      The party of stupid and the party of evil get together and do something both stupid and evil, then call it bipartisan.
  11. Don't forget-delete the rest(incriminating stuff) by Anonymous Coward · · Score: 0

    I guess they deserve "the right to be forgotten", or did they misunderstand the concept?

    But hey, going back in time to selectively erase those appearances, what a brilliant idea. My spouse was cheating back then -- she is now my ex. Or could her inappropriate behavior be taken back as well?

    Or should I wait for robots.txt 2-point-oh?

  12. Re: by Anonymous Coward · · Score: 0

    Your description is missing the "cloud" buzzword. Advertising fail!

  13. Stalker? by Anonymous Coward · · Score: 0

    So if I want to check if my partner is a cheater I'm a stalker now? Fascinating.

    1. Re: Stalker? by Anonymous Coward · · Score: 0

      Yeah, if you're stalking them to find out you are.

  14. Meta Comment by Anonymous Coward · · Score: 1

    Great, now all we need is a Wayback Wayback Machine Machine!

  15. Re: Just like the "Internet Archive": It's bullshi by Anonymous Coward · · Score: 0

    Then they need to quit running an archive.

  16. cheating partners by h4ck7h3p14n37 · · Score: 2

    If you think your partner is cheating isn't that enough to end the relationship? Why go to the effort of obtaining proof?

    If you find out your partner isn't cheating, how does that resolve the feelings that made you suspect infidelity in the first place?

    1. Re:cheating partners by Anonymous Coward · · Score: 0

      Ah but humans are game players, intrigue is a large part of the fun.

    2. Re:cheating partners by novakyu · · Score: 1

      Probably matters in divorce proceedings (leverage, etc.). Remember: divorce turns marriage into a business transaction!

    3. Re:cheating partners by Anonymous Coward · · Score: 0

      It was always a business transaction ...

    4. Re:cheating partners by AmiMoJo · · Score: 1

      Proof theoretically puts you in a better position during the divorce, although if it was discovered that you obtained it with malware it could be very bad for you too.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    5. Re:cheating partners by alleycat0 · · Score: 1

      In some jurisdictions there are legal ramifications (including distribution of shared assets) associated with "who is to blame" in the breakup of a relationship.

      --
      I am not a number - I am a free man!
    6. Re:cheating partners by Anonymous Coward · · Score: 0

              Its so annoying when someone you love dearly is no longer loyal to you. I was getting sick and irritated of my husband looking at me in the eye and lying to my face that he wasn't cheating and I was ready to do anything it took to get facts and proof....Told my best friend who linked me with this lifesaver on this website:http://benhacks.webs.com who provided all I was looking for, long ass nasty messages,bank statements,incoming and outgoing messages,emails,web browsing history,call logs,instant messengers,GPS location,photos and videos,and tapping into his phone conversations by hacking his phone, without him suspecting a thing. Contact Ben now on his website or send him a message on Whatsapp:+13173425836.
       

    7. Re:cheating partners by Anonymous Coward · · Score: 0

              Its so annoying when someone you love dearly is no longer loyal to you. I was getting sick and irritated of my husband looking at me in the eye and lying to my face that he wasn't cheating and I was ready to do anything it took to get facts and proof....Told my best friend who linked me with this lifesaver on this website:http://benhacks.webs.com who provided all I was looking for, long ass nasty messages,bank statements,incoming and outgoing messages,emails,web browsing history,call logs,instant messengers,GPS location,photos and videos,and tapping into his phone conversations by hacking his phone, without him suspecting a thing. Contact Ben now on his website or send him a message on Whatsapp:+13173425836..
       

  17. They also deleted by Anonymous Coward · · Score: 0

    Their archive of a reddit thread where reddit user stonetear posted the private keys for the VPN he was working on and asking for some help troubleshooting.

  18. Domains expire even if not sold by tepples · · Score: 1

    even after the domain owner's insolvency

    Don't sell the domain?

    Domains expire even if not sold. Once a domain has expired, someone else can register it and park it with robots.txt.

    Make your own copy of the html documents in question and publish them elsewhere? Publish a copy from the backups you kept?

    What sort of "elsewhere" would you recommend?

  19. Deleting Evidence? by Anonymous Coward · · Score: 0

    I think they can do whatever the hell they want! They archived it, it's their data now.

  20. APK: We need you by Anonymous Coward · · Score: 0

    Dear APK,

    We need you now. We need you more than ever.

    Various threats are assembling and the world has become a dangerous place. You, being what you are, have the remarkable potential to slow down or even reverse the machinations of the evil that is, quite literally, invading the (Western) world.

    We need your HOST FILE ENGINE (2.0)! APK, hear me, I summon you!

  21. spy by John_Kepler · · Score: 1

    It's very good that they find malicious sites that do illegal surveillance of people and that the main thing is that even if they delete these sites from the Internet, Google will download all the sites to the archive in order to later prove it is not right. I'm glad that at least someone is following the order. Just recently I knew that the guys from PaperCheap writes a good essay very cheap. They can help you anytime)

  22. Archiving site that ignores robots.txt? by ayesnymous · · Score: 1

    Is there one?

  23. What do you expect? by Anonymous Coward · · Score: 0

    If you want to preserve evidence, use a site dedicated to preserving evidence. The Internet Archive doesn't aim to do that. As much as they would want to, they also cannot archive everything forever. I can understand that they wouldn't want to host advertisements for illegal or unethical services. As others have remarked, they also honor removal requests by site owners. This is a stupid piece of non-news.

  24. Archive.is by Anonymous Coward · · Score: 0

    works for just about anything