Net Neutrality Comments Overtaxed FCC's System

Presto Vivace writes with news that the FCC has had trouble dealing with the sheer volume of comments submitted about net neutrality. There were millions of them, and they caused problems with the agency's 18-year-old Electronic Comment Filing System (ECFS). When the FCC attempted to dump the comments into XML format to make download and analysis easier, problems with Apache Solr meant roughly 680,000 didn't make the transfer. The agency promised to release a new set of fixed XML files in January that include all of the dropped comments. Despite many reports that the comments were "lost," they're all available using the ECFS.

Comments

I think the bigger issue

[rsilvergun]

is the number of Astroturfer comments. I'd like to see some effort made to find and eliminate them.

They only store them for us to read

[fustakrakich]

The FCC already has its orders. The 'comments' thing is just a pacification measure.

Re:They only store them for us to read

[Sir_Eptishous]

Wait, you're not insinuating that the FCC is only truly beholden to a cabal of incredibly powerful and wealthy elites who are the ones actually calling the shots via intense lobbying of spineless and paid off politicians and back room deals with utterly despicable business leaders?

Re:XML???

[Anonymous Coward]

There's nothing wrong with XML per-se and it's perfectly capable of million record exports.

The problem is stupid developers trying to load entire documents and manipulate them with DOM-like procedures when they should be using streaming parsers.