Slashdot Mirror


DARPA Funds Development of New Type of Processor (eetimes.com)

The Defense Advanced Research Project Agency (DARPA) is funding a completely new kind of non-von-Neumann processor called a HIVE -- Hierarchical Identify Verify Exploit. According to EE Times, the funding is to the tune of $80 million over four-and-a-half years, and Intel and Qualcomm are participating in the project, along with a national laboratory, a university and defense contractor North Grumman. From the report: Pacific Northwest National Laboratory (Richland, Washington) and Georgia Tech are involved in creating software tools for the processor while Northrup Grumman will build a Baltimore center that uncovers and transfers the Defense Departments graph analytic needs for the what is being called the world's first graph analytic processor (GAP). Graph analytic processors do not exist today, but they theoretically differ from CPUs and GPUs in key ways. First of all, they are optimized for processing sparse graph primitives. Because the items they process are sparsely located in global memory, they also involve a new memory architecture that can access randomly placed memory locations at ultra-high speeds (up to terabytes per second). Together, the new arithmetic-processing-unit (APU) optimized for graph analytics plus the new memory architecture chips are specified by DARPA to use 1,000-times less power than using today's supercomputers. The participants, especially Intel and Qualcomm, will also have the rights to commercialize the processor and memory architectures they invent to create a HIVE. The graph analytics processor is needed, according to DARPA, for Big Data problems, which typically involve many-to-many rather than many-to-one or one-to-one relationships for which today's processors are optimized. A military example, according to DARPA, might be the the first digital missives of a cyberattack.

53 of 84 comments (clear)

  1. Re:Simple question by spikesahead · · Score: 1

    Computers are machines that help us think. If we can think better, we can do all the rest of those things you are talking about much, much easier. I would say more and better computing power is the only thing that is going to elevate us out of the purely biological drive to expand until collapse.

  2. Re:Simple question by omnichad · · Score: 1

    cure cancer, mitigate climate change

    To be honest, this processor design might have applications for both.

  3. Re:Simple question by ChunderDownunder · · Score: 1

    Imagine a Beowulf cluster!

  4. HIVE by MichaelSmith · · Score: 1

    Thats the worst backronym I have ever heard.

    1. Re:HIVE by arglebargle_xiv · · Score: 1

      My thoughts exactly. I'm going to request funding for a Lexicon Randomword Ocelot Longjmp Pancake Covfefe Cheesecake processor, if they funded Hotpants Illicit Vagina Exploit for $80M imagine how much they'll give me.

    2. Re:HIVE by TheRaven64 · · Score: 1

      You've obviously not seen a lot of DARPA projects then. How about Clean-Slate Design of Resilient, Adaptive, Secure Hosts (CRASH), which was funded by DARPA's I2O (information innovation office - no, I'm not making this up).

      --
      I am TheRaven on Soylent News
  5. Re:Simple question by sheramil · · Score: 1

    Imagine a Beowulf cluster!

    Is there such a thing any more? I recently had access to a lot of second-hand low-end machines and thought it'd be fun to set up a cluster, but I couldn't find the software - it had vanished into a haze of different distros.

  6. Re: Simple question by Anonymous Coward · · Score: 1

    Amen. DARPA should instead focus on things that matter; such as studies on gender inequality, and the apparent inability of the English language to express any notion that is not perceived as racist and misogynistic by the media. The government should instead spend time identifying the race gender and sexual identity and occupation of everyone alive and focus on how they have been marginalized by evil racist trump supporters who luv Russia and want to destroy mother earth. This is how we should conduct science in the future.

    Always remember that you are right and everyone who disagrees has been brainwashed.

  7. Re: Simple question by orlanz · · Score: 1

    Cancer cures, global warming, Mars colonization. All those are pushing computer simulations to their max today. A better processor that could truely "multitask" would be a huge leap in toolset capability for any of those fields.

  8. Re:Simple question by Cipheron · · Score: 1

    They use big data algorithms for medical research. See "folding@home". There's a lot of data out there that needs to be processed, and processing more medical / chemistry data means trying out more combos and quicker / better results. A customized processor that does a specific type of task far faster than traditional processors is a great investment.

  9. Re:Simple question by Cipheron · · Score: 1

    BTW: "the new arithmetic-processing-unit (APU) optimized for graph analytics plus the new memory architecture chips are specified by DARPA to use 1,000-times less power than using today's supercomputers."

    A supercomputer designed to scale better for big data processing, that uses 1000 times less power than current supercomputers. Thus, it has 1000 times less cooling needs. Currently we're effectively using networked PCs scale up to fill data centers for our processing needs. A system designed with big data in mind will knock the socks off the current set ups and lead to much more efficient and scalable big data processing for ALL industries and research needs.

    And the reason it needs government funding is because then it's an open platform that anyone can use, instead of locked down with patent lawsuits for decades. This way, it gets built by the best of the best from multiple companies and it's openly publishable technology. The free market gave you Comcast and Verizon, it's DARPA that gave us the internet in the first place.

  10. Re:Simple question by TomGreenhaw · · Score: 1

    High performance computing is important to national defense. In fact, most computer technology was developed for weapons systems and national defense. Short term profit driven corporate group-think precludes taking the necessary risks to develop new computer architectures that are orders of magnitude faster and more efficient. It is government funded research that often makes important advances possible.

    BTW, I have mod points but think you have a fair question.

    Now if you are going to question why we need to spend so much on weapons, we'll that would be a fair question...

    --
    Greed is the root of all evil.
  11. Those are called FPGAs by Sycraft-fu · · Score: 3, Insightful

    Generic chips that can be programmed in to anything you want in the field. It's a huge industry, they get used in everything from your car to your TV, but they have limitations that means they are never going to be a be-all, end-all.

    There's a place for processors, FPGAs and ASICs, usually all combined.

    1. Re:Those are called FPGAs by Gravis+Zero · · Score: 2

      The problem is that FPGAs are really expensive. Neural networking chips are going to be the death of FPGAs because they can be made with cheap-o fab systems.

      --
      Anons need not reply. Questions end with a question mark.
    2. Re:Those are called FPGAs by Anonymous Coward · · Score: 2, Informative

      No they're not because FPGAs and neural networks are different architecturally and serve different purposes.

  12. Re: Simple question by TomGreenhaw · · Score: 1

    DARPA is an acronym for Defense Advanced Research Projects Agency. They spend our money on defense and weapons research.

    I'm not saying your other priorities are unimportant, but you shouldn't expect DARPA to fund non defense related research.

    --
    Greed is the root of all evil.
  13. Re:Simple question by dbIII · · Score: 1

    There's distributions out there like ROCKS for rolling out the software side of clusters quickly.

  14. Raytracing anyone? by Anonymous Coward · · Score: 1

    On the minus side, they will create Skynet or something more insidious, with slimy humans in charge.

    On the plus side, isn't this how you would make hardware ideal for a raytracer? Fixated on memory, a big heap of global memory (can't really dice the memory locality too much, rays have to go all over in the whole scene) with huge bandwiths flying everywhere, and you just want do zillions of intersections.

    The "Graph Acceleration Processor" could operate on e.g. a sparse octree, to give a simple example?
    I would like if someone more knowledgeable can give some thought or insight.

    In the 90s we still thought we would have a flying car, but that may take the second place to real-time raytraced games! That's what we will play in the future. After the Nintendo that's as powerful as a Silicon Graphics..

  15. It's an accelerator chip by tietokone-olmi · · Score: 3, Informative

    An application-specific integrated circuit, or ASIC. Not a new type of CPU.

    1. Re:It's an accelerator chip by radarskiy · · Score: 1

      It's an ASIC in the sense that a CPU is an ASIC.

    2. Re:It's an accelerator chip by tietokone-olmi · · Score: 1

      Programmability is commonplace in accelerator chips. For example, GPUs. The article's chip cannot support an operating system on its own.

    3. Re: It's an accelerator chip by tietokone-olmi · · Score: 1

      My distinction is not at all arbitrary. An "application processor" is the same thing as an auxiliary CPU; they'll lack things like PCIe lanes and paged memory management. Compare to some ARM chips that'd have a cripped 100% turing-complete ARM core next to a proper CPU for "media processing", basically as an extra FPU to decode video, but unable to execute POSIX software (or a real OS kernel) for having no MMU.

  16. Awesome! by GerryGilmore · · Score: 1

    OK, I'm not making any judgments whatsoever about this new architecture, but...ANY radical change in our "accepted" mode of thinking cannot help but be a GoodThing(TM) - ultimately - IMO. $.02

  17. Content Addressable File Store by Alain+Williams · · Score: 4, Interesting

    This reminds me of the Content Addressable File Store that ICL developed some 50 years ago. OK: different implementation, but today a huge amount of RAM is affordable whereas CAFS needed to search for the data on disk.

    1. Re:Content Addressable File Store by CustomSolvers2 · · Score: 2
      I found very interesting the following part in that linked page:

      disk storage with built-in search capability. The motivation for the device was the discrepancy between the high speed at which a disk could deliver data, and the much lower speed at which a general-purpose processor could filter the data looking for records that matched a search condition.

      It makes me wonder about the actual applicability of an approach which I never considered before (note that I am mostly software concerned and my hardware background isn't too solid): might it be worthy to create custom hardware architectures exclusively focused on maximising a limited amount of scenarios?

      Shouldn't search-engine (or other internet-based, data-intensive) companies, for which the money isn't an issue, do some research on this front to know whether building customised architectures exclusively caring about the limited actions performed by their main algorithms (quickly searching, retrieving and storing) might be a good idea? Not just optimising or re-designing databases, but creating whole database-focused servers completely from the ground up?

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    2. Re:Content Addressable File Store by CustomSolvers2 · · Score: 1

      Thanks for the info. In any case, note that my post took that example just as the starting point of what I never thought before: although current architectures might be (practically) optimal for performing a wide variety of actions, what about coming up with new ones taking care only of very specific aspects?

      Do you need a server to exclusively host databases which have to be accessed as quickly as possible? Why separating hardware, OS and database? Why not creating a specific database server whose basic architecture, hardware elements, OS, software, etc. are fully focused on accomplishing that goal? Why relying on caring-about-everything elements which you will not be using anyway and which have a negative impact on the performance of what you really care about? Additionally, the price of these machines would be lower than the general-purpose computers ones! (= big potential market).

      This is just an idea I had after reading that article, but the more I think about it, the more appealing it seems.

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
    3. Re:Content Addressable File Store by raftpeople · · Score: 1

      Probably the issue you would run into is cost of the specific machine will be greater than the cost of the general machine. For some users it would be worth it, but the market tends towards low cost not good solution, so the company selling it would probably be fighting an uphill battle unless the difference in capability was very significant.

      This is what happened with mini-computers. They typically were designed for business processing workloads and had features (e.g. special disk capabilities for high IO, extra processors managing all non-cpu activity, etc.) not present in lower cost devices (e.g. PC's), but the mass market moves fast, costs lower quickly, the lower end of the existing market gets eaten up first so the niche becomes smaller, unit costs in the niche go up, etc.

    4. Re:Content Addressable File Store by CustomSolvers2 · · Score: 1

      but the market tends towards low cost not good solution

      This is certainly true for the mass market and personal usage, but I am not so sure with big companies. Just having one client like Google or Facebook making a big order should be more than enough for a hardware manufacturer to create a whole new line of machines. Additionally, the resulting advertisement would attract lots of smaller businesses and individuals not even strictly needing it.

      As said, these are just some preliminary ideas which I see more as internal R&D material: a big company with money to burn and interested in improving its own systems.

      --
      Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
  18. Re:Barking up the wrong tree. by tgv · · Score: 1

    Neural networks don't work for generic tasks. Try to sort a bank's records with a neural network, or try to use them to display a UI description.

  19. Re:Simple question by slew · · Score: 2

    And the reason it needs government funding is because then it's an open platform that anyone can use, instead of locked down with patent lawsuits for decades. This way, it gets built by the best of the best from multiple companies and it's openly publishable technology. The free market gave you Comcast and Verizon, it's DARPA that gave us the internet in the first place.

    If only. Typically as part of the deal, DARPA contractors (like Intel and Qualcomm) are allowed to patent (and own the patents) used to commercialize the technology. That may or may not mean an open commercial platform, but it certainly doesn't mean they won't get to own patents on key parts of the technology to potentially keep competitors at a disadvantage.

  20. Re: Simple question by CustomSolvers2 · · Score: 1

    I'm not saying your other priorities are unimportant

    I think that the parent AC is actually implying that these other priorities are less important or, at least, heavily misused and systematically brought out of context. By using a more Slashdot-friendly reply: WHOOOSH!!

    DISCLAIMER: I am plainly sharing some properly-understanding help. I have no relationship whatsoever with this other AC and am not implying that I (dis)agree with anything of what is expressly or implicitly said in any of the previous posts.

    DISCLAIMER TO THE DISCLAIMER: logically, I have some opinion about all this, but my point is that it is completely irrelevant here as far as my contribution is only meant to address what I think that is a real-intention-misinterpretation problem.

    DISCLAIMER TO THE DISCLAIMER TO THE DISCLAIMER: I am not implying that people concerned about certain issues are usually misinterpretation-prone and require lots of unnecessary-for-any-properly-understanding-individual clarifications.

    etc. :)

    --
    Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
  21. Re:Barking up the wrong tree. by Gravis+Zero · · Score: 1

    Wow, you aren't even trying to hide your ignorance.

    --
    Anons need not reply. Questions end with a question mark.
  22. Re: Simple question by K.+S.+Kyosuke · · Score: 1

    DARPA is an acronym for Defense Advanced Research Projects Agency. They spend our money on defense and weapons research.

    And as a bonus, it sounds very close to DERPY.

    --
    Ezekiel 23:20
  23. Re:Simple question by TomGreenhaw · · Score: 1

    DARPA money funded the invention of the Internet. I'd argue that the Internet certainly helps the efforts of curing cancer, mitigating climate change, and colonizing Mars. Computers that do critical tasks 1000 time more efficiently would be a fundamental breakthrough that could help all these efforts and many more.

    --
    Greed is the root of all evil.
  24. Re:Barking up the wrong tree. by tgv · · Score: 1

    Please explain how a neural network would sort bank records. Or how to implement Excel using a neural network. Or ...

  25. How shortsighted peole have become by OneAhead · · Score: 1

    I'm appaled at all the "what's the use of this?" posts. When the principles behind lasers were discovered, they were regarded a physical curiosity with no real practical consequences. It's almost the definition of fundamental research that you can't immediately see the applications - else it's applied research. And DARPA's very mission is to fund research that currently borders on science fiction but one time may have practical consequences. They also played a big role in the development of what would eventually become the internet. With this HIVE project (horrible acronym BTW), they're even being quite conservative, as one can easily see a host of potential applications that are quite relevant to society.

    "What's the use of this" is exactly the wrong question to ask when it comes to funding science/tech. Yeah, it's something populist politicians like to wave around, but in reality, fundamental research pays for itself as a driving force for future economic growth. There will be failed projects that get nowhere and are never heard of again (except in arguments to cut funding), but the success stories easily make up for them. To again cite a very conservative example that is a bit in the gray zone between "fundamental" and "applied": think of Xerox putting a bunch of smart people together at PARC and giving them an allowance to fool around with.

    One could even argue that the generous funding with few questions asked that existed in a "distant" past has helped the US to be at the forefront of tech for decades.

  26. Re:Barking up the wrong tree. by Gravis+Zero · · Score: 1

    Forget implementing Excel, you could run the damn original by creating an x86 processor in a neural network. You do realize that brains are neural networks, right?

    --
    Anons need not reply. Questions end with a question mark.
  27. Re:Barking up the wrong tree. by tgv · · Score: 1

    You do realize that our brains are really, really imperfect: forgetful and illogical?

  28. Re:Barking up the wrong tree. by Gravis+Zero · · Score: 1

    Is this your way of admitting that you know jack shit about neural networks?

    --
    Anons need not reply. Questions end with a question mark.
  29. Graph databases by AveryRegier · · Score: 1

    Take a look at neo4j.com. When you organize graph-like data as a graph instead of the typical set of relational tables, you can vastly speed up certain kinds of queries, and thinking about the solution becomes much clearer.

    This is generic technology with uses far outside military applications. My own needs are for event correlation, and finding the cause in amongst a lot of data telling you the effects of a systems outage.

    Marry graph databases to a CPU that is specially tailored for this kind of work and you get a powerhouse.

    Cloud providers such as AWS can then bring in these machines, virtualization them, and in a cost effective manner rent them out to everyday developers.

    So what can YOU do with it?

  30. Re:Starting from scratch is very expensive. by Immerman · · Score: 1

    Why would you compare to a general-purpose computer? This will be a special-purpose computer, the relevant comparison is to the performance of other architectures in the same problem domain.

    In a similar vein, the operating system itself doesn't necessarily need to leverage the new architecture particularly well, except for the performance-critical subsystems such as memory management - and even that might be handled primarily by the client software. Heck, initially it might not even use an operating system at all - after all they're a convenience, not a necessity, though at least a thin "shim" layer seems likely. In fact, the thinner the better probably, as it's almost certainly going to take many years/decades to work out how to leverage the hardware as effectively as possible, and an operating system tends to obscure hardware realities.

    It will likely be expensive though. Maybe that has something to do with the fact that they're planning for $100 million for the hardware design and $7M-$14M for the software?

    And while it may well need massively overhauled compilers to effectively leverage, I suspect it won't need major changes in the rest of the tool chain. *Maybe* in the assembler, certainly not in a hex editor. After all it's not like any of those tools need to run on the new architecture - cross-platform compiling is pretty standard with novel architectures.

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.
  31. Re:Barking up the wrong tree. by raftpeople · · Score: 1

    You think we should add an additional layer of abstraction and computation that slows things down and eats up more energy to arrive back at the exact same spot we already were (running x86 code)?

    Why would you want to do that?

  32. Re:Barking up the wrong tree. by Gravis+Zero · · Score: 1

    I never said you would, I said you could. Know the difference.

    --
    Anons need not reply. Questions end with a question mark.
  33. non-specific failure mode by epine · · Score: 1

    This kind of weird name is given to pie-eyed future technology projects so that when the dust settles no-one really knows precisely what didn't pan out.

    Because odds are, they're going to have to fund this again—with an inkling of clue & a vaguely comprehensible name—before this twinkle finally deposits a nugget, third time lucky.

  34. Re:Barking up the wrong tree. by raftpeople · · Score: 1

    Uhhhh, that was your response to how to sort bank records, that you "could" implement x86 on a neural network, which leads to a couple questions:

    1 - If you only said "could" knowing that it's not really a good solution, why post it all?

    2 - Given that you seem to agree that is not a good solution (e.g. not efficient), what is your answer to the poster that asked you about how you would sort bank records? (the implied full question of course is "how would you do it efficiently with NN compared to current computing methods?")

  35. Re:Barking up the wrong tree. by Blaskowicz · · Score: 1

    No, they're not. A brain is a neural network as much as a tree (plant) is a tree (data structure)

    I say that with a bit of rhetorical fun, but neural networks aren't actually made from neurons. They don't get drunk and have sex (in no particular order). They don't have a chemical nature and unknown features not the computer "neurons" have DNA.

  36. What else were my professors wrong about? by RogueWarrior65 · · Score: 1

    Back when I was in university for engineering, I had a professor tell us that there was nothing better than Von Neumann architecture so don't bother looking for it. One has to wonder what else university professors are wrong about.

  37. Re:Barking up the wrong tree. by tgv · · Score: 1

    I don't know how you think about our brains, but implementing an x86 in them is not a great idea. That's much better done in silicon, where the components are reliable, small and fast. The fastest signal in our CNS travels at about 20m/s.

  38. Re:Barking up the wrong tree. by tgv · · Score: 1

    There's a 0 missing, but you get my drift.

  39. Re:Barking up the wrong tree. by Gravis+Zero · · Score: 1

    1 - If you only said "could" knowing that it's not really a good solution, why post it all?

    To make a point about the flexibility of NNs, duh.

    2 - Given that you seem to agree that is not a good solution (e.g. not efficient), what is your answer to the poster that asked you about how you would sort bank records?

    Processors designed for NN chips will be faster and scale to new heights. Also, sorting bank records is actually something trained NNs would kick ass at.

    --
    Anons need not reply. Questions end with a question mark.
  40. Re:Barking up the wrong tree. by Gravis+Zero · · Score: 1

    I don't know how you think about our brains, but implementing an x86 in them is not a great idea.

    you're a step behind this fellow.

    --
    Anons need not reply. Questions end with a question mark.
  41. Re:Simple question by CaptQuark · · Score: 1

    There is no such thing as "1000-times less". One times less power would be zero. (If a processor used 1 Watt, then this would use a 1000 times less, as in -999 Watts?) And one thousandth of the original is NOT the same as a thousand times less.

    You can have a thousand times more, but you can't have a thousand times less!

    ---

  42. Re:Barking up the wrong tree. by tgv · · Score: 1

    > To make a point about the flexibility of NNs, duh.

    You don't seem to get that for a neural network there is no difference between memory and processing.

    > sorting bank records is actually something trained NNs would kick ass at.

    I really would like a demonstration of that. Input: a few million bank records. Output: the same bank records, ordered according to some criterion like SSN, bank account or credit.

    But you're a troll, aren't you?