Slashdot Mirror


How a Team of Geeks Cracked the Spy Trade

drunken_boxer777 sends us to The Wall Street Journal for a lengthy article on a small tech company, Palantir Technologies, that is making the CIA, Pentagon, and FBI take notice. The submitter adds, "And yes, their company name is a reference to what you think it is." "One of the latest entrants into the government spy-services marketplace, Palantir Technologies has designed what many intelligence analysts say is the most effective tool to date to investigate terrorist networks. The software's main advance is a user-friendly search tool that can scan multiple data sources at once, something previous search tools couldn't do. That means an analyst who is following a tip about a planned terror attack, for example, can more quickly and easily unearth connections among suspects, money transfers, phone calls and previous attacks around the globe. ... With Palantir's software 'you can actually point to examples where it was pretty clear that lives were saved.'"

41 of 187 comments (clear)

  1. Call me dense... by Anonymous Coward · · Score: 4, Interesting

    But what is the reference?

    1. Re:Call me dense... by TypoNAM · · Score: 5, Informative

      This: Palentir

      --
      This space is not for rent.
    2. Re:Call me dense... by ObsessiveMathsFreak · · Score: 5, Insightful

      It's interesting in the context of this discussion that Tolkien's Palentir were more than just viewing devices. They could also be used to communicate with other stones, and I think for other purposes. Anyway, when one of the stones fell into evil hands, the Dark Lord was able to use his power over it to control anyone foolish enough to try and use one of the remaining stones.

      There's a lesson here I think.

      --
      May the Maths Be with you!
    3. Re:Call me dense... by nacturation · · Score: 2, Informative

      Let me help you with that:

      http://www.google.com/search?q=palentir

      --
      Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
    4. Re:Call me dense... by bugi · · Score: 2, Funny

      Obviously, it refers to Jack Palance. http://en.wikipedia.org/wiki/Jack_Palance

  2. Name? by Anonymous Coward · · Score: 5, Funny

    > ..a small tech company, Palentir Technologies..

    > ..Palantir Technologies has..

    > The submitter adds, "And yes, their company name is a reference to what you think it is."

    A spellcheck company?

  3. Reference to LotR by Anonymous Coward · · Score: 5, Informative

    It was the seeing stone that Sauron used in Lord of the Rings.

    That is the tool the evil guy used to control the world. Sounds appropriate.

    1. Re:Reference to LotR by Hadlock · · Score: 4, Funny

      Thanks, my internet is down, I was unable to google that myself.

      --
      moox. for a new generation.
    2. Re:Reference to LotR by hooeezit · · Score: 2, Informative

      That's the FUD propaganda. The more balanced perspective is it's the seeing stone anyone could use to see their future. But it was put to evil purposes instead by Sauron.
      Technology by itself is not good or evil. It's how one uses it that makes it so. Remember that the Internet came out of a doom-and-gloom project to create a nuclear-war resistant communication network.

    3. Re:Reference to LotR by jollyreaper · · Score: 3, Informative

      It was the seeing stone that Sauron used in Lord of the Rings.

      That is the tool the evil guy used to control the world. Sounds appropriate.

      The Palantir themselves were not evil, it was simply put to an evil purpose. The last surviving one was so corrupted by Sauron's influence it could never be used peacefully again but you can no more blame the Palantir for that than you could blame a wrench for becoming radioactive when left sitting next to a leaky reactor. Really, the only bit of truly evil magic in the entire book was the Ring itself and, seeing as it bore a measure of Sauron's own power, I think of it less as an object than as a character with a will and mind of its own.

      There is no evil in science, technology, or magic; evil lies not in the tool but the hand that wields it.

      --
      Kwisatz Haderach
      Sell the spice to CHOAM
      This Mahdi took Shaddam's Throne
    4. Re:Reference to LotR by Arthur+Grumbine · · Score: 5, Funny

      Thanks, my internet is down, I was unable to google that myself.

      So how are you posting this?

      Probably using the legendary Posting Stone of Minas Wooshgul

      --
      Now that I think about it, I'm pretty sure everything I just said is completely wrong.
    5. Re:Reference to LotR by hoytak · · Score: 3, Insightful

      Thanks, my bookshelf fell down, and I was unable to read it myself.

      --
      Does having a witty signature really indicate normality?
  4. Sounds like trojan spyware to me by Sporkinum · · Score: 3, Insightful

    With a name like Palentir, it sounds like trojan spy program, not a Google like search tool.

    --
    "He's lost in a 'floyd hole"
  5. Great! by Saija · · Score: 3, Funny

    Palantir Technologies has designed what many intelligence analysts say is the most effective tool to date to investigate terrorist networks

    What? a crystal ball to fight the terrorist:

    A palantír (sometimes translated as Seeing Stone but actually meaning "Farsighted" or "One that Sees from Afar") is a stone that functions somewhat like a crystal ball.

    --
    Slashdot ya no es que lo era! ;)
    1. Re:Great! by dkleinsc · · Score: 4, Insightful

      And creates a great risk of corruption among those who use it.

      --
      I am officially gone from /. Long live http://www.soylentnews.com/
    2. Re:Great! by jeffasselin · · Score: 3, Funny

      Only if you use it to chat with Ozzie Ozbourne on MSN Messenger.

      --
      If he explores all forms and substances Straight homeward to their symbol-essences; He shall not die.
    3. Re:Great! by Abreu · · Score: 3, Funny

      > I just met this guy in the Palantir, he was like, really cool, but shy

      > But he wouldn't, like, send me his picture, only a flaming eye

      > So I asked "ASL?"

      > But he just said: "Build me an army worthy of Mordor"

      > and I was like "WTF? KThxBye!"

      --
      No sig for the moment.
  6. Bad summary by gurps_npc · · Score: 5, Informative
    The summary seems to be a description of a meta-search engine, which is rather common. (Dogpile).

    The actual product seems MUCH more interesting than the silly summary. It compartamentalizes secret info, so if you are classified for level 5, you can still search and find info that is level 6, even if the file also has level 4 information. It can also tag information so that if your level 5 clearance is not enough to tell you how person A is connected to person B, you can still know that the connection exists.

    --
    excitingthingstodo.blogspot.com
    1. Re:Bad summary by fuzzyfuzzyfungus · · Score: 4, Insightful

      The tech sounds quite interesting; but I'm not sure I love the idea of having intelligence agents operate on a "Yes, person A is linked to person B. You aren't allowed to know why; but the omniscient computer assures you that it is so." basis.

    2. Re:Bad summary by NoYob · · Score: 2, Insightful

      The summary seems to be a description of a meta-search engine, which is rather common. (Dogpile).

      The actual product seems MUCH more interesting than the silly summary. It compartamentalizes secret info, so if you are classified for level 5, you can still search and find info that is level 6, even if the file also has level 4 information. It can also tag information so that if your level 5 clearance is not enough to tell you how person A is connected to person B, you can still know that the connection exists.

      Yeah, but if you are classified for level 5 and look at level 6, which presumably is above your classification, then you are in fact looking at classified work even if it has level 4 work - which means the levels of classification are being broken and the security is compromised. And if person A is a 5 and looking at classification 6 which is connected to person B it in effect blows any security clearances out the door. Of course, person C who is a 4 looking at person B who is a ....I've gone cross-eyed, dizzy and I'm nauseous.

      --
      It's NOT me! It's the meds! I'm on 1000mg of Fukitol.
    3. Re:Bad summary by sukotto · · Score: 2, Funny

      Trust the computer. The computer is your friend. (There is no ultraviolet classification)

      --
      Come play free flash games on Kongregate!
    4. Re:Bad summary by steelfood · · Score: 3, Insightful

      It's all about need to know. If you knowing why is necessary to draw a conclusion, you'll eventually be granted this access.

      Under the old system, you outright wouldn't even know that a connection exists, nevermind whether you need to know whether that connection is important or not.

      --
      "If a nation expects to be ignorant and free in a state of civilization, it expects what never was and never will be."
  7. The Palantir Tool is a Double-Edged Sword by reporter · · Score: 5, Insightful
    When you aim the Palantir tool at terrorists, you can easily identify useful patterns in disparate data. These patterns reveal information about the names and the plans of the culprits.

    What happens when you aim the same tool at ordinary people like Slashdotters? You will discover sexual orientation, adultery, etc.

    In other words, the same tool saving us from the terrorists can also defeat the last barriers protecting our privacy. If an intelligence officer in the government hated a particular SlashDotter (due to her articles in this forum), that officer could easily identify her address, her friends, her bank accounts, her adulterous lover, etc. Can you say, "blackmail"?

    1. Re:The Palantir Tool is a Double-Edged Sword by Dancindan84 · · Score: 5, Funny

      If an intelligence officer in the government hated a particular SlashDotter... her friends... her adulterous lover

      A female SlashDotter with friends and a lover... it would take a top tier spy tool to find that unicorn.

      --
      "Always forgive your enemies; nothing annoys them so much." - Oscar Wilde
    2. Re:The Palantir Tool is a Double-Edged Sword by MobyDisk · · Score: 2, Insightful

      No software cannot determine your sexual orientation, nor your hidden adultery. It does not read minds, or hearts. It does not magically know events from the past or the future.

      Now, if you went online and posted about your homosexual adulterous relationship on a board that publicly reveals your IP address, then yes, a tool could indeed find it. In that case, who defeated the last barrier of your privacy? Did the tool? Or is it your own darned fault?

    3. Re:The Palantir Tool is a Double-Edged Sword by Ethanol-fueled · · Score: 2, Insightful

      Our tax dollars at work. But seriously, I call bullshit. Don't be tryin' to scare people.

      Myself and others have talked tons of trash about the U.S. intelligence agencies and leadership on Slashdot and in real-life. The American intelligence agencies would have to be hard-up for funding and job security if they're going to data-mine Slashdot and then go on fishing expeditions to try and find voices of dissent.

      I noticed that none of the info in TFA involved plots within the U.S., just "western targets" overseas. Yawn, public plots to kill westerners in the Middle East are a dime a dozen. We see what a fat lot of good that's doing us, in fact our best solution there just to throw enough money at people to get them to turn snitch. All they really want is to feed their families. If you'll notice, that's also the tactic-du-jour stateside: throw money at snitches(many of them already caught and snitching for a break or lower sentence) and proxies just like the RIAA did with MediaSentry. In short, the American intelligence services are a clusterfuck of corporate bureaucracy and dangerous outsourcing and they should be disbanded and rebuilt from scratch. The CIA's resistance to the recent disclosure of their torture techniques on the grounds of "national security" and "harm to the intelligence community" are an insult to our intelligence.

    4. Re:The Palantir Tool is a Double-Edged Sword by Alpha830RulZ · · Score: 3, Funny

      Adultery? You mean like using your other hand?

      --
      I was taught to respect my elders. The trouble is, it's getting harder and harder to find some.
    5. Re:The Palantir Tool is a Double-Edged Sword by Anonymous Coward · · Score: 2, Interesting

      No software cannot determine your sexual orientation, nor your hidden adultery. It does not read minds, or hearts. It does not magically know events from the past or the future.

      I do not know that you can definitively say that. What the tool can ferret out is going to depend on what data it has, how much data it has and the quality of that data.

      Does the tool have access to credit card data? Does the tool have access to hotel reservation data? Car rental data? Flight reservation data? Phone records? Movie rental data? Other data types too numerous to list that do exist and that the government might get access to?

      Given enough data I don't think anyone can say with absolute certainty that past events cannot be dug out of the data set. Ditto for sussing out probable very near term events based on past events given the proper data in a timely fashion, time to find connections and then bringing those to someone's attention.

      Think things like travel plans, especially those made regularly or semi-regularly. Sure, you could say that someone could figure that out on their own, but that would take time. Throw in software that finds those patterns on its own and it becomes a lot easier to do. The software might even shed light on the cause of the travel.

      When Person A receives a phone call from number N or an email from address E prior to the last weekend of the month then there is a 75% probability person A will travel to city C and stay in hotel H. Now add in that person B is tied to phone number N and email address E and has the same 75% probability to travel to city C and stay in hotel H...

      Now add in a person to see those patterns and look at them and then drill down to the source data that led to the software making those conclusions and also looking into related data.

      Think that person might just figure something out? I think there's a pretty good chance they'll learn something.

  8. Re:Palin? by Daniel+Dvorkin · · Score: 4, Informative

    No, it's a Tolkien reference. IOW, they really are geeks.

    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
  9. Governmentsss spying on their own citizensss ... by Daniel+Dvorkin · · Score: 4, Funny

    ... we hatesss it, Preciousss, yesss we doesss.

    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
  10. Re:Gee it's almost impressive..... by PainKilleR-CE · · Score: 2, Interesting

    but as TFA points out, the people they're looking for often do things that should get them caught, like using the same address and phone number when buying the plane tickets in the case of the 9/11 hijackers. The basic idea is to find a better way to process the data they already have, and to give people the ability to process data that will help them, even when they don't necessarily have access to it (ie the use of data classified at a level higher than the searcher has access to).

    The problem generally hasn't been (so far anyway) that the data wasn't there, it was just that no one had the time or ability to process the information in a useful manner to make these connections. Supposedly this tool does a much better job of it than previous tools, but even if it does, we probably won't hear much more about it either way.

    --
    -PainKilleR-[CE]
  11. Re:"Perhaps they should call it "One Ring"? by castironpigeon · · Score: 2, Interesting

    In case you forgot the term engineer originally applied to constructors of military engines. Engineers have a long and healthy tradition of being clever and morally bankrupt.

    --
    mmmm...forbidden donut
  12. Re:Gee it's almost impressive..... by brainboyz · · Score: 2, Informative

    Except, despite all of this, they still exist in a trackable world. They live and have stuff delivered to addresses, they access information that leaves a data trail, and use identifiers which do the same. If they share anything, or a field observer notices a meeting then it gets tagged as a meeting and connection; then any activity at all is tracked back to a single node (bank account, address, person, phone number, etc) then you can link ALL connected nodes to that activity. Cash, disposables, and other "untrackables" still have temporary information: GPS on phone calls, messages intercepted with keywords or names, or phone numbers used for a material order. The info might not be permanently valid, but the connections it makes between nodes are.

  13. Uhh... No. Wrong perspective... by denzacar · · Score: 5, Insightful

    Good guys used it too. To defeat Sauron AND to "keep the world safe".

    In fact... Good guys made all 7 Palantir mentioned in LotR.
    Sauron got his hands on one of those and used it to corrupt Saruman and Denethor.

    So... No. It is not "the tool the evil guy used to control the world."
    The message would be that "power corrupts". In this case - power in the form of knowledge or information.

    What Palantir really lacked was a decent firewall. No protection whatsoever.
    Very intuitive user interface though. And they were practically indestructible.

    --
    Mit der Dummheit kämpfen Götter selbst vergebens
  14. Re:Palin? by nacturation · · Score: 2, Funny

    It's not like as though the company was named "Rusty Trombones Inc." or something

    That would be a Commander Riker reference?

    --
    Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
  15. Re:Palin? by Planesdragon · · Score: 4, Insightful

    ... a badly written child's fantasy world ....

    Now now, Tolkien's Middle-earth was a badly-written ADULT'S fantasy world.

  16. badly written? by conspirator57 · · Score: 3, Insightful

    i'm guessing you thing Twilight and Harry Potter are works of genius?

    i'm surprised more people haven't taken your flamebait.

    --
    "If still these truths be held to be
    Self evident."
    -Edna St. Vincent Millay
  17. They're also disingenuous astroturfers. by C10H14N2 · · Score: 2, Interesting

    They've plastered the Pentagon with banners practically claiming they single-handedly brought down GhostNet when they were at best on the periphery of the rather large collection of organizations responsible for it.

  18. Re:All we need by tibman · · Score: 2, Informative

    I thought it went down differently than that. Zelaya was trying to rewrite the constitution to allow him more than two terms as president, a step in the direction of dictatorship.

    A judge issued a warrant for his arrest because he had no right to call a vote to rewrite the constitution. The military followed the Judge's order but expelled him from the country instead of arresting him. They later said they did this to prevent his followers from getting access to Zelaya.

    The military was never in charge of the government.. with the order for removal of the President, the Vice President was promoted to full president. The current president of Honduras did not claim power, it was thrust upon him by the line of succession.

    The same thing could happen in the United States.. the Military swears an oath to the Constitution FIRST, then the president. The process to remove the president from power would be different though. He would have to be impeached.. which again comes from the judicial side of the house. The Chief Justice would preside over it and congress would do the voting.

    --
    http://soylentnews.org/~tibman
  19. Re:Palin? by schon · · Score: 4, Funny

    Please turn in your geek card.

    No, that would be nerd card. Geeks have social skills.

    You obviously didn't READ the books.

    neither did I. I tried - I really tried.. but they were so horribly boring and long-winded it was impossible for me to make it through even part of the first one.

    Q: Why did the chicken cross the road?

    A by Tolkein: The chicken, sunlight coruscating off its radiant yellow-white coat of feathers, approached the dark, sullen asphalt road and scrutinized it intently with its obsidian-black eyes. Every detail of the thoroughfare leapt into blinding focus: the rough texture of the surface, over which countless tires had worked their relentless tread through the ages; the innumerable fragments of stone embedded within the lugubrious mass, perhaps quarried from the great pits where the Sons of Man labored not far from here; the dull black asphalt itself, exuding those waves of heat which distort the sight and bring weakness to the body; the other attributes of the great highway too numerous to give name. And then it crossed it.

  20. Re:Palin? by Incadenza · · Score: 2, Interesting

    ...and the battles. When I saw the movies and the battles started rolling, I had a vivid memory of how boring I had found these in the book too (and that was 25 years in the past)