Slashdot Mirror


The Wayback Machine is Deleting Evidence of Malware Sold To Stalkers (vice.com)

The Internet Archive's Wayback Machine is a service that preserves web pages. But the site has been deleting evidence of companies selling malware to illegally spy on spouses, Motherboard reported Tuesday. From the report: The company in question is FlexiSpy, a Thailand-based firm which offers desktop and mobile malware. The spyware can intercept phone calls, remotely turn on a device's microphone and camera, steal emails and social media messages, as well as track a target's GPS location. Previously, pages from FlexiSpy's website saved to the Wayback Machine showed a customer survey, with over 50 percent of respondents saying they were interested in a spy phone product because they believe their partner may be cheating. That particular graphic was mentioned in a recent New York Times piece on the consumer spyware market.

In another example, a Wayback Machine archive of FlexiSpy's homepage showed one of the company's catchphrases: "Many spouses cheat. They all use cell phones. Their cell phone will tell you what they won't." Now, those pages are no longer on the Wayback Machine. Instead, when trying to view seemingly any page from FlexiSpy's domain on the archiving service, the page reads "This URL has been excluded from the Wayback Machine."

48 of 92 comments (clear)

  1. robots.txt by Thad+Boyd · · Score: 5, Interesting

    The Wayback Machine obeys robots.txt, even retroactively. If a site puts up a robots.txt file, archive.org will remove old versions of the site.

    1. Re:robots.txt by thegreatbob · · Score: 1

      Indeed, it's not an immutable archive of all that ever was. I would hope they would actively preserve the data if presented with a court order, at least.

      --
      There is no XUL, only WebExtensions...
    2. Re:robots.txt by gnick · · Score: 3, Insightful

      The thing about preserving data is that you need to do it before the court order to be of any use.

      --
      He's getting rather old, but he's a good mouse.
    3. Re:robots.txt by jythie · · Score: 3, Interesting

      It is not all that mysterious that such a policy or mechanism exists, but it still highlight's the piece's argument that we need more archives since a single point of failure is, well, a single point of failure. I remember growing up people talking about how 'the internet is forever' and 'once it is out there it is always there', but over the decades one slowly finds more and more things that seem to be gone for good if they fail to be popular enough to keep spreading.

    4. Re:robots.txt by Anonymous Coward · · Score: 1

      And then they stopped obeying it: https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/

      Which is bad and will lead to countermeasures from an increasing number of people. I for one intend my web sites to be a transient form of communication. I don't care if you personally make a copy for yourself, but the pages are not for someone who didn't read them when they were published. I absolutely do not want to fuel any stalking, mild or threatening. I am not a politician, celebrity or other person of interest. I stopped posting to Usenet when DejaNews showed up with an archive from times long before people were aware that their every comment would be archived. If these militant archivists don't honor explicit requests to not have a site archived, then they will destroy the public web. Everything will go the Facebook way: Hidden behind logins and access control lists.

    5. Re:robots.txt by Bryansix · · Score: 1

      True story bro. That's why Tim Pool left that garbage organization.

    6. Re:robots.txt by rahvin112 · · Score: 4, Interesting

      The internet archive (Wayback Machine) does not delete the data for sites with robots.txt that restrict data access. It simply marks the pages as unavailable if it already has them. Now I don't know if they will download new copies once the robots.txt is changed but they don't delete data they already have.

    7. Re:robots.txt by Anonymous Coward · · Score: 2, Informative

      the wayback machine does not delete stuff. It will remove it from the public site at the request of robots.txt, but it doesn't actually delete its archive. If robots.txt changes again, it comes back

    8. Re:robots.txt by jythie · · Score: 1

      It can get even worse when looking for non-commercial stuff. Tracking down old blog posts or amature music videos can be a real pain, or they can just be outright gone. Stuff that does not get meme worthy disappears when either the single source goes away or when google/youtube purges it.

    9. Re:robots.txt by brewthatistrue · · Score: 2

      Yes it does, which is unfortunate. In the past I've noticed this when domain squatters acquire an expired domain and the Web Archive begins denying access to archived pages from the original site.

      This appears to be a misread of the robots.txt intent.

      Apparently, the "Robot Exclusion Protocol" was intended to prevent unattended crawlers.
      However, the Internet Archive also prevents human initiated crawls, and retroactively removes access to previous crawls.

      Here is a quote from the FAQ of Archive.is, an internet archival service similar to the Internet Archive's Wayback Machine:

      > Why does archive.is not obey robots.txt?

      > Because it is not a free-walking crawler, it saves only one page acting as a direct agent of the human user. Such services don't obey robots.txt (e.g. Google Feedfetcher, screenshot- or pdf-making services, isup.me, )

      which links to Google Feedfetcher's FAQ:

      > Why isn't Feedfetcher obeying my robots.txt file?

      > Feedfetcher retrieves feeds only after users have explicitly started a service or app that requests data from the feed. Feedfetcher behaves as a direct agent of the human user, not as a robot, so it ignores robots.txt entries. Feedfetcher does have one special advantage, though: because it's acting as the agent of multiple users, it conserves bandwidth by making requests for common feeds only once for all users.

    10. Re: robots.txt by Reverend+Green · · Score: 1

      How fortunate then, that no one is asking you to pay for Internet Archive.

    11. Re:robots.txt by Calydor · · Score: 1

      That is EXTREMELY short sighted.

      If a company dies should we just forget they ever existed, without ever being able to go back to look at who and what they were? There were never any Amigas because Commodore went and died later on, and if Microsoft were to shut down tomorrow suddenly Windows and DOS have never existed?

      You are promoting the very revisionism this article is complaining about.

      --
      -=This sig has nothing to do with my comment. Move along now=-
  2. if you make site unavailable by Anonymous Coward · · Score: 1

    with robot.txt i read that this causes wayback to remove *all* previous references to site. Correct me if i'm wrong :)

  3. They will delete yours too, if you ask by Anonymous Coward · · Score: 5, Informative

    See https://archive.org/about/faqs...
    If you want to delete your site from the wayback machine, all you have to do is ask them. They are not obligated to keep any page in the archive, whether it contains "evidence" or not. You can also exclude ia_archiver user agent in your robots.txt, which will prevent your site from being indexed in the first place. This way you will not even have to ask them.

    1. Re:They will delete yours too, if you ask by jarkus4 · · Score: 3, Informative

      Robots.txt will not work as they started ignoring it (https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/), but the email method still works.

  4. It wasnt malware by Anonymous Coward · · Score: 5, Funny

    It wasnt malware, in the American language it would be called something like a "analytics's and management platform, with realtime reporting and active asset monitoring and protection"

    1. Re:It wasnt malware by AvitarX · · Score: 1

      I think what you mean is "Management and Analytical Logging softWARE"

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
  5. Re:Just like the "Internet Archive": It's bullshit by SirSlud · · Score: 1

    They're not historians.

    --
    "Old man yells at systemd"
  6. Yep, that's how it works by Anonymous Coward · · Score: 5, Insightful

    It is very annoying, but that's how it works. The worst is when a site that is owned by an entity who goes out of business is preserved by the wayback machine, but then another entity gets the domain, puts up a robots.txt and there goes all the history.
    For all the good it is doing, it would be so much better if it did not apply robots.txt retroactively. It doesn't even make sense, robots.txt says "bots stay out", which is not nearly the same as "bots, forget whatever you had visited in the past"...

    1. Re:Yep, that's how it works by bill_mcgonigle · · Score: 3, Insightful

      Almost certainly this is how archive.org manages to not get sued out of existence by malicious litigants who want to hide their misdeeds.

      If you can figure out how to make the legal system non-abusive, let's do that and then I'm sure archive.org will keep all their old crawls available.

      In the meantime let's support them for staying around.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  7. Respectful attitude by CustomSolvers2 · · Score: 1

    As already commented in this thread and in other previous ones, the Wayback Machine reacts to robots.txt restrictions by deleting all the records retroactively. Even though I might personally prefer a different behaviour, this is undoubtedly a very honest approach: deleting all the collected information after the first indication that the given site/person might not want it! Quite a few sites should learn something from them.

    --
    Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    1. Re:Respectful attitude by tepples · · Score: 1

      If the owner of a particular domain wishes that the HTML documents available through that domain be made available indefinitely, even after the domain owner's insolvency, what should the domain owner do to prevent the domain from being snapped up by a third party that sets robots.txt?

    2. Re: Respectful attitude by Anonymous Coward · · Score: 1

      Bullshit, there's no reason for a robots.txt to be retroactive. I corresponded with someone at archive.org probably 15 years ago and they don't get that domains change ownership and there's no reason or really any right of a new owner to disallow information that archive.org's robots previously collected, especially as a domain parking company or reseller can, for no good reason block access to a site that although at the time had the same domain, was never theirs. Think of a museum that allowed pictures to be taken of the historic and creative works that had, another business comes along and buys the building and suddenly all your pictures disappear or you get a legalese form from saying that you no longer have the right to have those photos and that they must be destoryed. Doesn't make much sense does it?

    3. Re:Respectful attitude by CustomSolvers2 · · Score: 2

      If the owner of a particular domain wishes that the HTML documents available through that domain be made available indefinitely, even after the domain owner's insolvency, what should the domain owner do to prevent the domain from being snapped up by a third party that sets robots.txt?

      I don't like that scenario and, probably, most of people doesn't do either. But it seems an unavoidable drawback of this whole approach. This is a private company with private interests and obligations (not precisely providing a public service for any random internet user) which, as such, can do whatever they want with their data. There seems to only be one limitation to that absolute power: what the person/company referred by that data wants to do with it. Bear in mind that we aren't talking about the typical user-opens-account->generates-data->user-tells-how-to-use-data, but about systematic collections of data which, in most of the cases, happen without the given user knowledge. How to know who is the owner now and yesterday? How to deal with eventual ownership conflicts?, etc. Everything would become too complicated, too invasive (all this additional personal information would have to be stored), etc. They might have chosen a more conservative alternative like deleting only the current files, but preferred to make sure that no information without a clear permission will be kept.

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    4. Re: Respectful attitude by AvitarX · · Score: 2

      They're erring on the side of caution, because they don't want lawsuits.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    5. Re: Respectful attitude by CustomSolvers2 · · Score: 1

      As written above, this scenario of multiple owners does sound bad, but accounting for it seems quite difficult. From the point of view of the current approach of the Wayback Machine, there aren't owners but domains, assumed to always belong to the same person. I am not defending their current approach or even saying that I like some of these outcomes, just appraising their honest attitude (in case of doubt, don't keep anything!) and understanding their difficult position. Also as commented above, accounting for different ownerships would add a further layer of complexity/personal data collection which might provoke other problems or might be beyond what they are willing to do.

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    6. Re:Respectful attitude by _Sharp'r_ · · Score: 1

      Don't sell the domain? Make your own copy of the html documents in question and publish them elsewhere? Publish a copy from the backups you kept?

      These are simple solutions which don't require you to rely on a third-party to do stuff for you for free...

      --
      The party of stupid and the party of evil get together and do something both stupid and evil, then call it bipartisan.
  8. Re:Illegally spying on spouses? Stalking? by jythie · · Score: 2

    Having a pre-existing relationship doesn't make anything more or less stalkery.

  9. Re:Thatâ(TM)s a shame by FatdogHaiku · · Score: 1
    --
    You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
  10. Re:Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 1

    Regardless of legality, putting spyware on your significant other's phone is stalking, plain and simple, and is a sure sign of an abusive relationship.

  11. Re:Illegally spying on spouses? Stalking? by Bryansix · · Score: 2

    I'll just go out on a limb here and say that I'm sure this law varies state to state.

  12. Re:Illegally spying on spouses? Stalking? by nuckfuts · · Score: 2

    ... how do you "stalk" someone you are already married to?

    Gee, I dunno, maybe you could "intercept phone calls, remotely turn on a device's microphone and camera, steal emails and social media messages, as well as track a target's GPS location".

  13. Meta Comment by Anonymous Coward · · Score: 1

    Great, now all we need is a Wayback Wayback Machine Machine!

  14. Re:Illegally spying on spouses? Stalking? by imidan · · Score: 1

    If you mistrust your wife so much that you feel like you need to install software on her phone to spy on her, what you should be thinking about is not whether this is legal because you technically part-own the phone. You should be thinking about getting a divorce. You're obviously unhappy, and your paranoia and controlling behavior is probably not making her life any better, either.

  15. cheating partners by h4ck7h3p14n37 · · Score: 2

    If you think your partner is cheating isn't that enough to end the relationship? Why go to the effort of obtaining proof?

    If you find out your partner isn't cheating, how does that resolve the feelings that made you suspect infidelity in the first place?

    1. Re:cheating partners by novakyu · · Score: 1

      Probably matters in divorce proceedings (leverage, etc.). Remember: divorce turns marriage into a business transaction!

    2. Re:cheating partners by AmiMoJo · · Score: 1

      Proof theoretically puts you in a better position during the divorce, although if it was discovered that you obtained it with malware it could be very bad for you too.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    3. Re:cheating partners by alleycat0 · · Score: 1

      In some jurisdictions there are legal ramifications (including distribution of shared assets) associated with "who is to blame" in the breakup of a relationship.

      --
      I am not a number - I am a free man!
  16. Re: Illegally spying on spouses? Stalking? by Anonymous Coward · · Score: 1

    Considering the statistics on cheating (roughly half of both married men and women will admit to researchers they have cheated on their spouse at least once), the odds are very much in the favor of truth not paranoia if you think your spouse is cheating.

    Once you get to that point it doesnâ(TM)t matter who or how often or whatever unless youâ(TM)re in one of those shitty places that require a reason for divorce.

    Thank God for no-fault divorce.

    â"happier now after dumping that bitch

  17. Re:Illegally spying on spouses? Stalking? by Shotgun · · Score: 1

    Would hiring a private investigator also be considered abusive stalking?

    There are significant legal and financial ramifications to being married to a cheating spouse, and one thing you have to have is proof. But, I guess you feel that only those able to afford a private investigator deserve justice.

    --
    Aah, change is good. -- Rafiki
    Yeah, but it ain't easy. -- Simba
  18. Domains expire even if not sold by tepples · · Score: 1

    even after the domain owner's insolvency

    Don't sell the domain?

    Domains expire even if not sold. Once a domain has expired, someone else can register it and park it with robots.txt.

    Make your own copy of the html documents in question and publish them elsewhere? Publish a copy from the backups you kept?

    What sort of "elsewhere" would you recommend?

  19. Re:Illegally spying on spouses? Stalking? by viperidaenz · · Score: 1

    It's not ownership of the person, but legally it's joint ownership of their assets.

  20. Re:Illegally spying on spouses? Stalking? by shaitand · · Score: 2

    So you have two modes, absolute blind trust and bail at the first sign of anything that manages to wiggle through it? Your spouse is human, humans lie, humans do selfish things, humans make mistakes.

    Your spouse doesn't need to know your every thought or action but if there is something you are making available for literally any other third party (network provider, government, friend, etc) and you don't think marrying a person implicitly and automatically amounts to granting consent to that plus more you'd never share with another party it's you who should probably just get a divorce.

    There are very important and obvious reasons for that, not the least of which is if you are unconscious your partner has the right to give access to all that information to someone else and also make choices like whether or not a doctor should do something that will kill you if you've eaten X or been exposed to Y in the past 24hrs.

    There are paranoid partners out there but having a doubt or suspicion in an innately fallible thing isn't the issue. Not seeing your partner as someone you ultimately trust is a marriage killer. I might write something in a message I'd rather my wife not see and I'd be annoyed if she were looking in my messages with out some sort of reason but of course she has the right to look at them without legal consequences. Your spouse can give consent to a law enforcement officer to search your possessions and information waiving your right to privacy but you think they shouldn't be legally entitled to waive that the same right when they have need?

    In my house the bar for looking at one another's text messages is at the "oh yeah, I remember (s)he sent that address I'm trying to find to Joe last week."

  21. Re:Illegally spying on spouses? Stalking? by shaitand · · Score: 1

    "OMG. Marriage is not ownership."

    Giving up the right to sex without the consent of the person you are marrying is one absolute and universal thing that marriage absolutely includes. That consent is required even if the sex doesn't involve them. Just because someone doesn't own you doesn't mean they don't have rights or that you can do anything you want without consequences. If you violate that agreement they have a right to know and for that information to be disclosed in a divorce. Of course if you are at the point where you are willing to have sex your partner doesn't consent to it baffles me why you aren't getting divorced already since that is pretty much the only thing marriage is, the ultimate level of commitment not to have sex your partner doesn't consent to.

  22. Re:Illegally spying on spouses? Stalking? by shaitand · · Score: 1

    Which would be stalking... if you were doing it without some sort of legal relationship that gives a party the legal right to that information or even to authorize others to it like say an ISP agreement or a LEGAL MARRIAGE.

    Remember a few years back DOD funding resulted in a process that let researchers extract an image someone had seen from their visual cortex? Your spouse can consent on your behalf to have that procedure done and see the results.

    How is this any different than hiring a private investigator? People lie and break commitments, no amount of blind trust is going to change that nobody deserves blind trust and that when someone breaks that trust the other party has a right to know and they deserve to face the consequences.

    But forget cheating for a moment. What is the harm in real stalking? There actually isn't any, it's just creepy. All the rest of the justifications on making such activity illegal revolve around slippery slope fallacies but really its freaking creepy. But what is creepy about your spouse being able to locate you or your phone? If there is some kind of emergency who is the person you are supposed to trust to make the call on whether reaching you is more important than your privacy in that moment and needs to be able to act on it. Your spouse. Your cell phone provider already has malware shipped with your phone that includes these capabilities, they can and at times do all the things you've listed above. You risk the horny entry level AT&T guy watching you in the dressing room for the sake of being able to take pictures with animal faces replacing your friends, did you somehow think marriage wasn't consenting to share data to a larger degree than the click-through on FB?

    Seriously, if your spouse hearing something you are saying on a call, seeing you changing, or anything you might say in an email or social media message, or being able to see where you are gives you the creeps you should probably be married to someone you trust and who isn't so creepy.

    That person who keeps his partner a prisoner... one in hundreds of millions, partners dramatizing situations to the point where they sound like they are comparable to keeping a spouse locked up in a mountain cabin or a basement dungeon more like 1 in 20. Now take a moment to filter anytime you consider if something which is creepy or wrong should be illegal consider whether you'd rather have it happen than be locked in that basement dungeon for years because that is what you are literally saying should be done to the person who did that wrong thing.

  23. spy by John_Kepler · · Score: 1

    It's very good that they find malicious sites that do illegal surveillance of people and that the main thing is that even if they delete these sites from the Internet, Google will download all the sites to the archive in order to later prove it is not right. I'm glad that at least someone is following the order. Just recently I knew that the guys from PaperCheap writes a good essay very cheap. They can help you anytime)

  24. Archiving site that ignores robots.txt? by ayesnymous · · Score: 1

    Is there one?

  25. Re:Illegally spying on spouses? Stalking? by retchdog · · Score: 1

    "Remember a few years back DOD funding resulted in a process that let researchers extract an image someone had seen from their visual cortex?..."

    uh, no? we're easily decades away from that, if it's possible at all, but it's pretty easy to cook up a "demo" that's convincing enough to part rubes from their money. of course, there are plenty of cash-flush rubes in DOD... good old financial incentives can get scientists and engineers to accomplish anything, even the impossible, as long as you don't look too close at the smoke and mirrors.

    --
    "They were pure niggers." – Noam Chomsky