Slashdot Mirror


US NAVY Sonar/Lidar Editing Software Released To the World

New submitter PFMABE writes The Naval Oceanographic Office (NAVO) has spent 16 years developing the Pure File Magic Area Based Editor (PFMABE) software suite to edit the huge volumes of lidar and sonar data they collect every year. In accordance with 17 USC 105, copyright protection is not available to any work of the US government. Originally developed to run on RedHat OS with network distributed storage, it has been migrated to Windows 7. This software, and accompanying source code (Win & Linux), has been released to the public domain at pfmabe.software, free for download with registration.

56 comments

  1. Re:Very nice by Anonymous Coward · · Score: 0

    I see a village is missing its idiot.

    Not like there isn't a need for the worlds navies

    http://www.cnbc.com/id/1019691...

  2. One way to drum up business... by HaGaRzzz · · Score: 5, Informative

    This post was submitted by a company looking to make money by selling training to use the software.

    Looks like the official distribution page is http://shoals.sam.usace.army.mil/PFMABE.aspx

    1. Re:One way to drum up business... by aaronmd · · Score: 1

      The story should be revised to point to the link you provided.

    2. Re:One way to drum up business... by SuperBanana · · Score: 1

      The link provided actually requires even more personal info.

      Here's a way that doesn't require any.

      magnet:?xt=urn:btih:0f76f9cb970aaa105843230c556cda28b7418369&dn=PFMABE&tr=udp%3A%2F%2Fopen.demonii.com%3A1337&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969

    3. Re:One way to drum up business... by MadMaverick9 · · Score: 1

      https://shoals.sam.usace.army....

      This Connection is Untrusted

      You have asked Firefox to connect securely to shoals.sam.usace.army.mil, but we can't confirm that your connection is secure.

      shoals.sam.usace.army.mil uses an invalid security certificate.

      The certificate is not trusted because the issuer certificate has expired.
      The certificate expired on 2014-06-10 02:24. The current time is 2015-04-06 13:17.
      (Error code: sec_error_expired_issuer_certificate)

      Next time provide a link that actually works.

    4. Re:One way to drum up business... by Anonymous Coward · · Score: 0

      Here are copy/pastes of the information they refuse to give you unless you give them your email address:

      http://pastebin.com/N2SeMB0V

      http://pastebin.com/s0NAWUu9

    5. Re:One way to drum up business... by Anonymous Coward · · Score: 2, Informative

      You can ignore/skip the "registration" part and go directly to the download page at this URL.

      https://shoals.sam.usace.army.mil/softwaredownload.aspx

      Note that its SSL certificate is expired, but if you're skipping the part where you provide personal info, that's not really a concern.

    6. Re:One way to drum up business... by Anonymous Coward · · Score: 1

      No. The USACE page, and the software there, is about three years old. The software on the referenced site was updated yesterday. The email sign ups are so you can get update notifications. And, no, I didn't post the article.

    7. Re:One way to drum up business... by jones_supa · · Score: 1

      Yes, but with that Magnet link we lose context. Theoretically it could link to a version of the program peppered with malware.

    8. Re:One way to drum up business... by dbIII · · Score: 2

      It will work if you use a Lenovo machine :)

      The SSL web of trust has had trucks drive through it so a lot of people are not bothering to update their certs. Sadly you are one of the few that actually cares enough to point out an expired cert instead of just clicking through.

    9. Re:One way to drum up business... by Anonymous Coward · · Score: 1

      download the dod certs and suddenly, it will be trusted http://dodpki.c3pki.chamb.disa...

    10. Re:One way to drum up business... by dbIII · · Score: 1

      Make that "sadly few actually care enough" since the above could be taken as an unintended insult.
      I'm updating my certs but many don't bother anymore.

    11. Re:One way to drum up business... by storkus · · Score: 1

      This post was submitted by a company looking to make money by selling training to use the software.

      What's wrong with that? This is the business model of almost all FOSS.

    12. Re:One way to drum up business... by MadMaverick9 · · Score: 1

      The problem that I pointed out has nothing to do with the root certificate authority (rootca), but everything with the fact that the certificate used on their web server expired almost one year ago.

      bash $ openssl s_client -connect shoals.sam.usace.army.mil:443 2>&1 | openssl x509 -noout -enddate
      notAfter=Jun 9 19:24:51 2014 GMT

      But you're right, that is yet another problem with this certificate that the rootca is not available on a normal user's computer.

      And now you want me to download a rootca from some shady link that some dude on slashdot posted and trust that? In your dreams.

    13. Re:One way to drum up business... by PFMABE · · Score: 1

      The USACE version was last updated in Nov 2011. (v6.3.1.41) A little dated. The latest version 6.4.0.15 has the support for CZMIL and LAS

  3. Re:Very nice by Anonymous Coward · · Score: 0

    Please describe the utility of sonar for detecting surface ships?
    Thanks,
    Idiot.

  4. Spyware by Anonymous Coward · · Score: 0

    You just know that the NSA has put a shit load spyware in that software!!

    1. Re:Spyware by linearZ · · Score: 1

      You just know that the NSA has put a shit load spyware in that software!!

      Open source at that.... Well, if the NSA is releasing open source spyware, I'm sure it will get exposed with more than just idle speculation soon enough. Certainly the kind of thing that the myriad of parties trying to untangle NSA mischief would be interested in.

      Somehow I doubt the NSA would do this. They have a tendency to take without giving back to the community.

      --
      Revolution is the opium of the intellectuals.
    2. Re:Spyware by jones_supa · · Score: 1

      Open source at that.... Well, if the NSA is releasing open source spyware, I'm sure it will get exposed with more than just idle speculation soon enough.

      That is idle speculation as well. Never blindly trust Linus' Law, I though we learned that lesson already!

      The US Navy PFMABE program released here contains a lot of code, it's not that obvious that anyone will bother reading through the complete code.

    3. Re:Spyware by Anonymous Coward · · Score: 0

      You just know that the NSA has put a shit load spyware in that software!!

      Open source at that.... Well, if the NSA is releasing open source spyware, I'm sure it will get exposed with more than just idle speculation soon enough. Certainly the kind of thing that the myriad of parties trying to untangle NSA mischief would be interested in.

      Somehow I doubt the NSA would do this. They have a tendency to take without giving back to the community.

      Perchance, what "community" would that be?

      Dare I say the community of geeks in their mothers basement?

      Shall we say the community of selfrighteous arrogant fools who answer to nobody?

      Maybe the community of perfect coders who ca never err? Indeed

    4. Re:Spyware by AchilleTalon · · Score: 1

      Most stupid comment ever. If you expect to effectively propoagate spyware, you don't pick a narrow and very specialized piece of software as a vector.

      --
      Achille Talon
      Hop!
    5. Re:Spyware by Anonymous Coward · · Score: 0

      Somehow I doubt the NSA would do this. They have a tendency to take without giving back to the community.

      As a computer security professional, I am grateful that SELinux exists. It may be too cumbersome for most systems, but for systems with high security requirements it's really good. I am also grateful for their work with TrustedBSD (which is incorporated into FreeBSD nowadays) and SEAndroid, even though I don't use them on a daily basis.

      Aside from their direct contributions to the community, they have also played a part in making Linux popular in government systems, which in turn makes it more popular among government contractors. Sure, the battle hasn't yet been won, but we (as in the open source community) have come a long way. It is easy to find milspec vendors providing Linux-support for their stuff.

      I am not saying the NSA did all this. I am saying they contributed. Sure, they could contribute more, but to say that they don't contribute at all is unfair.

    6. Re:Spyware by spacepimp · · Score: 1

      Unless the goal/userbase of the spyware is very specific to an industry.

    7. Re:Spyware by PPH · · Score: 1

      anyone will bother reading through the complete code.

      People don't really 'read' through code to find exploits anymore. There are some capable analysis tools that do most of the grunt work.

      --
      Have gnu, will travel.
    8. Re:Spyware by jones_supa · · Score: 1

      In that case open source isn't needed either.

    9. Re:Spyware by PPH · · Score: 1

      In that case open source isn't needed either.

      How will you know that the binary you are running came from the source you examined?

      --
      Have gnu, will travel.
    10. Re:Spyware by jones_supa · · Score: 1

      If I examined the source, I wouldn't need the binary analysis tools.

    11. Re:Spyware by linearZ · · Score: 1

      Point taken. SELinux is kinda cool.

      But the NSA certainly doesn't open source spyware. And they don't slip spyware into open source code. The NSA tends to operate here bit more subtly when they want to exploit opensource - like promoting flawed encryption that only a handful of people can actually figure out.

      And it is very rare that the NSA exposing security flaws they find in open source, even when they know criminal are exploiting the same flaws. Not exactly acting in the public interest.

      --
      Revolution is the opium of the intellectuals.
    12. Re:Spyware by linearZ · · Score: 1

      Static analysis tools generally like to have the source.

      --
      Revolution is the opium of the intellectuals.
    13. Re:Spyware by linearZ · · Score: 1

      I'm guessing the NSA is employing trolls these days. Just another in a long line of tactics borrowed from Russian dictators...

      --
      Revolution is the opium of the intellectuals.
    14. Re:Spyware by jones_supa · · Score: 1

      I thought he was talking about dynamic analysis tools, but if not, then you are correct.

  5. here it is without the asshole-y email collecting by SuperBanana · · Score: 4, Informative
    Not really sure why someone felt entitled to hide all this behind a mailing list subscription for a consulting company's email spam list, so here it is via free magnet download. I only included the "required" dataset in addition to the source and required libraries.

    magnet:?xt=urn:btih:0f76f9cb970aaa105843230c556cda28b7418369&dn=PFMABE&tr=udp%3A%2F%2Fopen.demonii.com%3A1337&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969

    That should paste into most torrent clients, watch for CR/LFs though.

  6. What can you do with it? by charlieo88 · · Score: 1

    What can you do with it besides edit lidar and sonar information? Does it have some sort of big data application?

  7. Was it written in Sea ;-) by siri_kan · · Score: 2

    /ducks [ Wait there's another pun here ]

    1. Re:Was it written in Sea ;-) by Anonymous Coward · · Score: 0

      Want to know which *shell* they used?: Fish

  8. MB-System by Anonymous Coward · · Score: 2, Interesting

    Interested parties should also check out MB-System; it's GPL and NSF
    funded. If you are familiar with GMT mapping tools this will be right
    up your alley. Supposidly there's a Windows build using Cygwin, but with
    datasets this large why would you want to?

    http://www.ldeo.columbia.edu/r...

    It is ainly focused on multibeam bathymetry but it despite the name it does
    sidescan sonar processing too. It's not set up for LiDAR but its scripts
    for dealing with massive point clouds could be adaptable.

    1. Re:MB-System by Anonymous Coward · · Score: 0

      Mb-system comes bundled with the OSGeo-Live Linux DVD for geospatial software , http://live.osgeo.org.

  9. Editing LAS files can be a big data application... by linearZ · · Score: 3, Interesting

    Editing Lidar data and binning surfaces seems useful to all sorts of things Lidary, not just the underwater world. If this software can handle large data sets than it could be useful in detecting and tagging objects in a terrestrial scan. Scan large areas, add a database, and this becomes an open source "big data" Lidar tool.

    If this software can't handle large data sets, then who cares beside Sponge Bob, PhD?

    Annoying that this source code has been released in this way. But it is open source as public domain, which mean open season on the code base. If it is worth a damn, I'm sure someone will distribute as a proper open source project soon enough.

    --
    Revolution is the opium of the intellectuals.
  10. I suppose... by linearZ · · Score: 1

    The software is public domain by the US government. All it take is one temporary email account and github to bypass registration nonsense.

    Hydrograpic scanning seems a very narrow field, likely populated by people already knowing how to this software (or software they wrote themselves). If this company thinks they are going to make money training, then they probably aren't going to make very much money.

    --
    Revolution is the opium of the intellectuals.
  11. Hmmm by Anonymous Coward · · Score: 0

    PFM always meant Pure Fucking Magic in my swabby days. Less NaCL in the new Navy?

    1. Re:Hmmm by plopez · · Score: 1

      I was about to say the same think. I think it is more universal than the Navy though as I have never served and learned it a long time ago. I suppose they had to clean it up so niave civilians didn't get the wrong idea about their clean cut a All American boy, and now gals, in uniform .

      Swearing! Smoking! Tattoos! Eeeek! ;)

      --
      putting the 'B' in LGBTQ+
  12. Re:Editing LAS files can be a big data application by SuricouRaven · · Score: 1

    Anything produced by the US government is public domain. It's written into their copyright law: The government cannot create anything with a copyright restriction. Whatever it produces is for the public good, not for profit.

    There are loopholes, though. This only applies to things directly produced by government - it doesn't apply to contractors working on behalf of the government, anything they produce is still restricted by copyright. It also doesn't require the government release things for free - there are some situations where they have 'public domain' material, but it's only available to those who pay an access fee and agree not to redistribute it to others.

  13. Re:Very nice by GateGuy · · Score: 1

    Passive sonar used on submarines is exactly how surface ships are detected.

    --
    Maryland State Motto: If you can dream it, we can tax it.
  14. Copyright for contracted work by Anonymous Coward · · Score: 0

    "Under 17 USC 105, copyright protection is not available to any work of the US government." However, copyright protection for work contracted by the US government is more nuanced. For example, my company works under FAR (Federal Acquisition Regulations) guidelines, which (as I understand it) generally exclude source code from the set of unlimited rights data (see http://acquisition.gov/far/current/html/Subpart%2027_4.html).

    1. Re:Copyright for contracted work by plopez · · Score: 1

      But it can be restricted due to National Security (TM) concerns :)

      --
      putting the 'B' in LGBTQ+
  15. Re:Editing LAS files can be a big data application by Anonymous Coward · · Score: 1

    > Anything produced by the US government is public domain.

    That is... not even wrong. If you think it has any tie to truth, go get me the addresses and salary information of all NSA personnel, and the list of the home addresses of the staff at Guantanamo Bay. It has to exist, right? Someone send them paychecks, right?

    Even NIH funded work, which is publicly available, is not "public domain". Of course it has copyrights on it to prevent editing a few wards, falsifying the document, and republishing it with fake data. And oh, yes, the "public" work done under NIH for electronics and biochemistry? A great deal is patentable, but even protective patents are subtly prohibited by NIH. Why? So that it never blocks a private patent, even if the private patent is a direct replica of the NIH funded work from a decade previously. I know, I had 3 patentable projects with NIH for which I offered to pay for the patent lawyer and patent applications out of my own salary,partly to get the patents on my resume and partly to get them in the public domain and protected from poaching, and they wouldn't let me do it.

    Sadly, one of them got poached and used against me. I had one *hell* of a time challenging a fraudulent patent when some private manufacturer tried to inflict it on my research later, NIH and former research colleagues were very reluctant to produce relevant documents, they thought I should just settle. Fortunately, I was a paranoid bastard and had kept copies of my original letters with a patent attorney, which predated their work by a decade and put several of their other patents at risk. I wanted *all* of their patents invalidated, and a big red "uses literature search to steal ideas" stamp used on every patent application from them.

    They finally dropped their fraudulent cases, and I was.... discouraged from retribution. I'd have lost my funding, under the guise of "why aren't you publishing instead of pursuing this patent nonsense"? It wasted a lot of my time and money, which I don't have much of because I do research. And it slowed down my work for a *year*, which was much more expensive than helping me get the damn defensive patents in the first place. And it happens *all the time* in long running research projects.

  16. Re:Very nice by Anonymous Coward · · Score: 0

    Great, so where were the subs in his link? And how does "passive" sonar affect whales, as in my OP?

  17. why is a American submarine shooting an Russian to by Joe_Dragon · · Score: 1

    Why is a American submarine shooting an Russian torpedo will be one the last things hear after useing this to seek out of the med.

  18. Re:Very nice by Anonymous Coward · · Score: 0

    Active sonar is when the submarine sends out a very very loud sound, which then bounces off stuff. This sound can be detected by the submarine's enemies, which is why it is rarely used. Active sonar can kill whales.

    Passive sonar is when the submarine does nothing but listen, and listening doesn't hurt any whales. Submarines use passive sonar a LOT, becuase it doesn't betray their positions to their enemies. By using passive sonar, submarines can hear ships a long long way away, and by moving the submarine (or waiting for the ship to move), the submarine can triangulate the position of the ship.

    Active sonar is used when it is more important to know where the enemy is located rather than to stay hidden. This is the case when the sub is attacking something, or it is being attacked and wants to protect itself. It is typically only used against other submarines, because those are the only things that can sneak up on a sub. If a ship tries to find a sub, then the sub will probably just hide (by becoming silent) until the enemy has moved on to another area.

  19. Re:why is a American submarine shooting an Russian by Anonymous Coward · · Score: 0

    I don't know, why are US military satellites being launched with rocket engines purchased straight from Russia (ULA) with active attempts prevent a home grown and built launch system from gaining a piece of the military launch market (SpaceX)? As with most things "follow the money".

  20. pfmabe.software vs shoals.sam.usace.mil by PFMABE · · Score: 1

    The version on pfmabe.software was updated over the weekend (v6.4.0.15) and is being actively maintained and improved. The one on the shoals website is over 3 years old and is missing a great deal of functionality. Nor is it updated/maintained, nor is it likely to be. PFMABE Software was founded to help those users, institutions, governments who wish to use the freely available software. There are other opportunities and other software packages available. The choice is yours.