Slashdot Mirror


Making FOIA-Requested Data Public: Too Much Transparency For Journalists?

schwit1 writes: From The Washington Post's Lisa Rein comes news that the federal government is launching a six-month pilot program with seven agencies to post online documents requested under the Freedom of Information Act. That means that information requested (whether by a journalist, nonprofit group or corporation) asks for the records under FOIA, it's not the just the requester who will get to see the results, but also the public at large. What's the problem with that? For journalists whose province is the scoop, it could mean less incentive to go through the process of asking for the record in the first place. Washington Post Investigations Editor Jeff Leen says in the story that public posting could therefore "affect long-term investigations built on a number of FOIA requests over time." An excerpt offers a similar defense of documents being released only to the requesting party: "FOIA terrorist" Jason Leopold has big issues with the approach. "It would absolutely hurt journalists' ability to report on documents they obtained through a FOIA request if the government agency is going to immediately make records available to the public," writes the Vice News reporter via e-mail. Leopold has already experienced the burn of joint release, he says, after requesting information on Guantanamo Bay. The documents were posted on the U.S. Southern Command's Web site. "I lost the ability to exclusively report on the material even though I put in all of the work filing the requests," he notes. Another reason FOIA requesters might be annoyed by a general-release policy: filing FOIA requests isn't free.

34 of 139 comments (clear)

  1. Cry More by Br00se · · Score: 4, Insightful

    Once the information has been collected and vetted to make sure it's eligible to be released under the FOIA, it should absolutely be released to the public. The government has no duty to protects a requester business model.

    1. Re:Cry More by penix1 · · Score: 5, Insightful

      You evidently didn't read the last line in TFS. FOIAs aren't free to file. They cost money to prepare and turn over. Add to that the restrictions on time to produce (10 days in my state. No idea what the federal time limit is) as well as the maze that is the legal exemptions on a FOIA request and it gets quite expensive. What news agency is willing to be the first to fork over the money just to have the means to recoup the funds pulled out from under them? I think this idea is brilliant if you want to curb the FOIA requests you receive.

      --
      This is a sig. This is only a sig. Had this been an actual sig you would have been informed where to tune for more sigs.
    2. Re:Cry More by Br00se · · Score: 3, Insightful

      I did read it. And I stand by what I said. They only reason not to publish every public document held by the government is because there are some documents for a variety of reasons need to be held private, at least for a period of time. And yes, it take effort to sort out which is which. However, once that effort has been made, by someone paying to sort it out. The reason for holding it back disappears.

      I think that it is more likely, is that with greater access to these pre-vetted documents, more issues of public interest could pursued and exposed. Something missed by a few eyes could be seen by many more.

    3. Re:Cry More by HairyNevus · · Score: 5, Informative
      --
      You were critically hit for no damage. The bruise will look nice, and maybe the scars will make good party talk.
    4. Re:Cry More by DarkOx · · Score: 5, Insightful

      I having trouble feeling sorry for the journalists. Yes the scoop is important but we are not selling papers by having young boys shout "EXTRA" from the street corners anymore. Any novel facts uncovered will be repeated by 100s of blogers the moment the story drops anyway. A huge portion of the would have been in the old days readership/viewership will get that news from there anyway. So whats the big deal if the facts usually accompanied by with more chaff than most folks are willing to sort thru drop one more place?

      Where journalism is useful is analysis. They still have a leg up there. If you have been working a story you for which you had to file those requests than other facts and sources must have lead you there. You already have a bigger picture view than anyone else. You know what material you are looking for in those documents. The rest of us just have a 1000 pages of US Forestry Service reports and questions, for example.

      I don't by a paper to learn the "CIA has over 300 black sites" I buy a paper because I expect an article that will tell me not only are there 300 black sites, but what a black site is, how they are used, some reasons I should be concerned about that and may be reasons I should not be, what the broader implications for international law enforcement and political relationships are, etc. If my interested ended with a few odd facts the only news I would need are Slashdot summaries anyway.

      On the flip side this will be a nice resource to have that will make linking to original source materials be they to support a news story, scholarly paper, Internet rant, or whatever much easier. That will be a good thing, but it will mean for the issues your really do care about you'll have direct access to the evidence itself to for your own judgments. I think this could be very valuable.

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    5. Re:Cry More by McGruber · · Score: 4, Interesting

      What news agency is willing to be the first to fork over the money just to have the means to recoup the funds pulled out from under them? I think this idea is brilliant if you want to curb the FOIA requests you receive.

      The real danger to news agencies is that The Daily Show, National Public Radio's On the Media program and other media critics will be able to see all the documents that the reporters were given, but did not report on.... so, IMHO, this new FOIA policy will really help to expose the biases of many mainstream news agencies.

    6. Re:Cry More by sumdumass · · Score: 4, Interesting

      Are you willing to increase your taxes paid by 20% just to staff enough people for my "UFO" and "Anal probe" requests in 30 different ways to every single agency i can think of so i can prove all UFO sightings are government conspiracies an all alien anal probes are means to punish and discredit people who are thorns in the side of the government or some crony company they support? Or should something like the department of health and human services spend a good portion of their budget on these rather than their stated missions? I can see it now. FEMA fails to respond to some natural disaster stating their budget was already burned through fielding FOIA requests.

      I agree with you in principle, I just look at the practical application of it. Probably unlike you, I do see a need for some secrets to remain in government. I think it's mostly to national defense and comments or advice given but not adopted over political matters. For example, issues like the civil rights act or giving women the vote could have turned out differently if everything we now know was instantly available when it transpired.

    7. Re:Cry More by pepty · · Score: 5, Interesting

      This argument reminds me of a few years ago when private weather forecasters were trying to kill off the National Weather Service's websites and public forecasts so that they wouldn't have public competition when presenting NWS data and analysis.

    8. Re:Cry More by mysidia · · Score: 2

      How about giving the first person to request AND PAY A FEE, and request it a 7 day exclusive period?

      Then announce that the results are available --- for the next 30 days, anyone else can get the results, but they will have to pay the FOIA fee also, and after 30 days, the results will be published for everyone free of charge.

      Also, if a second organization requested the FOIA results during the 30 days, then the fee they pay will be half of what the first requestor paid, AND half of the fee they pay after the reduction, if more than $100, will be used to reimburse up to 49% of the first requestor's cost.

      If a third organization requested the FOIA, then their fee will be 1/3 of the first requestor's original cost, AND 2/3 of the fee the third requestor pays is used to reimburse the first two requestors, such that all 3 requestors have approximately the same share of the net cost, plus a nominal overhead per participant.

    9. Re:Cry More by Smidge204 · · Score: 2

      You evidently didn't read the last line in TFS. FOIAs aren't free to file.

      Your UserID is low enough to know that TFS is often dead wrong.

      FOIA law does not specify any fees, but it allows each agency to establish its own fee structure for filling requests.

      Generally speaking, if filling the request takes minimal effort, there's no fee. This has always been true (in my limited experience) for electronic copies of electronic records; if all someone has to do is copy a file or whatever, no problem.

      If you're going to start requesting printed copies of records, they're likely to start charging you at some point. A few pages probably isn't too bad, but the idea is to prevent some jerk from tying up the system asking for 50,000 prints from microfiche archives and not having to invest anything in such a request. Usually the fee is in line with expected costs (e.g. 10-15 cents per page or whatever, plus hourly rate for a worker to do it.)

      If your local government whatever is charging a fee simply for filing a request, let alone providing the data, you might have a case for a lawsuit.
      =Smidge=

    10. Re:Cry More by ganjadude · · Score: 2

      they want to be able to continue to put their spin and political slant on things before people have a chance to make up their own minds

      --
      have you seen my sig? there are many others like it but none that are the same
    11. Re:Cry More by lgw · · Score: 2

      It costs next to nothing to put a web front-end up for an existing DB of documents (and most FOIA requests in fact cost nothing). It costs a lot to censor and redact everyday government documents in order to prevent embarrassing politicians, senior bureaucrats, or donors - that requires painstaking detail. (SS numbers are a freaking regular expression - don't give me that BS. And with the OPM leaks, all the most personal details contained in every government record have already leaked anyway.)

      --
      Socialism: a lie told by totalitarians and believed by fools.
    12. Re:Cry More by murpup · · Score: 2

      Document stores in federal agencies contain a much richer and wider variety of information and formats than you would give them credit for. It is not only about protecting peoples' social security numbers.

      How do you automate regular expression pattern matching on documents from the 80's that were scanned into electronic form as TIF images? Or documents that are stored on microfiche? The documents could be OCR'd but that process takes a bit of time and effort.

      And while it may indeed be possible to automatically scan modern electronic documents for personal information (my agency has scripts that it runs periodically on all the files on its network drives to scan for inappropriately stored PII), what if the document happens to contain some company's proprietary data that doesn't match some pre-defined pattern? How do you automatically tell the difference between some company's proprietary cost proposal for a potential contract and an agency's internal budget document?

    13. Re:Cry More by Br00se · · Score: 2

      If you are a real journalist doing a real story, you will already have other sources that support whatever story you are writing. Getting the FOIA data may be the "smoking gun" you need to publish your story. Paying for that is the coast of doing business, and in many cases, you are just paying for actual costs of photocopies.

      Having the public information "leak" early should have minimal impact on your ability to recover the investment you have put into researching the story and interviewing people for quotes. If anything you will be in a stronger position to explain what the data means and increase audience for story.

      If you can't compete with that much of a head start, then maybe you need to try harder next time.

    14. Re:Cry More by mwvdlee · · Score: 2

      "Two month exclusive" as in "If you paid for it before I did, I can't get it for another two months"?

      --
      Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
  2. Shows where the heart is by HairyNevus · · Score: 3, Insightful

    Guess this means those those journalists didn't really care about exposing the corruption/injustice/what have you in their story as much as they like getting the credit and praise for doing the exposing. This is why i don't like Vice; they can do a really good job of reporting and exposing bad people to be sure, but they rarely bother to offer up a solution or shy away from making simple poverty porn for more page views.

    --
    You were critically hit for no damage. The bruise will look nice, and maybe the scars will make good party talk.
    1. Re:Shows where the heart is by Opportunist · · Score: 2

      They care about selling their story. Welcome to the capitalist world.

      Idealism doesn't put food on the table.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:Shows where the heart is by HairyNevus · · Score: 4, Insightful

      As an AC pointed out Snowden's raw leaks being made public didn't stop reporters from selling stories on that information. I'm just calling bullshit on this idea that FOIA requests being published publicly automatically...will somehow hurt any reporter's story. If they're worried about another reporter poaching the info and publishing before them, they need to be better at their job. Have all the background written up and ready to go by the time the FOIA is being filed, then pull an all-nighter to finish the story when it comes out. Simple.

      --
      You were critically hit for no damage. The bruise will look nice, and maybe the scars will make good party talk.
    3. Re:Shows where the heart is by fustakrakich · · Score: 2

      Idealism doesn't put food on the table.

      Oh yeah? Tell that to all the churches and mega preachers with billion dollar Swiss bank accounts! People are slaves to idealism. They'll do anything in its name. Idealism is a great motivator, one of the best there is, if not the best.

      --
      “He’s not deformed, he’s just drunk!”
  3. FOIA isn't meant to support a business model. by DG · · Score: 4, Interesting

    FOIA is about releasing information held by public agencies to the public. We all "own" it, we have a right to see it, and if we ask, we can.

    That's the public "we". Putting in a FOIA request doesn't make that information "yours" and a business model that depends on you adding an additional layer of secrecy is fundamentally flawed. The public has no interest in helping to maintain your flawed business model.

    --
    Want to learn about race cars? Read my Book
    1. Re:FOIA isn't meant to support a business model. by mysidia · · Score: 5, Insightful

      Yes.... we all own it, BUT the journalists might not request it in the first place, since they have to pay for the request, If they lose the ability to use the results in their business to get the story early.

      What I would support is a 7 day exclusivity period that can be requested for an additional fee; where the requestor will get their results of the FOIA requests, But the guaranteed public release will be temporarily delayed after the requestor receives the files and gets a 7 day headstart..

      If the journalist cannot find something to report on within their 7 day headstart, then probably there was no "scoop" to get.

    2. Re:FOIA isn't meant to support a business model. by Alan+Shutko · · Score: 4, Insightful

      If journalists stop asking because they could expend all the time, money and labor to dig up the information without being able to get any reward on the expose, then the public will be hurt. Since fewer people will be asking, less information will be released.

      A short delay before putting the information public would leave an incentive for journalists to keep investigating, while still making all of the results available to the public.

    3. Re:FOIA isn't meant to support a business model. by DG · · Score: 3

      And waste more taxpayer money forcing a public employee to go through all the work again?

      Free for one, free for all. Putting in the initial request is performing a public service, not something proprietary.

      If the process is a "maze", that suggests a process improvement to be made, not an excuse to privatize public information.

      --
      Want to learn about race cars? Read my Book
  4. Info should be Releases When Produced by rshol · · Score: 5, Interesting

    ALL information,all documents,all emails that would be subject to FOIA requests should be put on the web as they are produced. We should not have to ask for the information, it should already be there.

    1. Re:Info should be Releases When Produced by DG · · Score: 3, Insightful

      Good idea in theory, non sustainable in practice. There's just too much information generated daily; the cost of hosting would be overly high and I bet the UI for navigating it would be horrid.

      The current process is nominally OK, less the fact that only one person benefits from the work of retrieving it. Once found, it should be free for all.

      --
      Want to learn about race cars? Read my Book
  5. Re:Too complex... by ZipK · · Score: 2

    I'm not overly sympathetic toward people wanted to hoard FOIA data for themselves

    No one is hoarding - you are free to get the same information by running the FOIA maze yourself. They are asking that their work and expense in prying information out of the government be rewarded with exclusive access to the answer to their request. Others are free to request the same information separately. Given the toll gate in front of the information, there is demonstrable public value in giving journalists incentive for digging.

  6. Seems like there's a simple middle ground solution by Minupla · · Score: 4, Interesting

    Do a timed release. Once the FOIA request is completed, the requester gets X months of exclusivity to publish, and then it gets released publicly. This preserves the inventive for the journalists, while at the same time ensuring that even FOIA requests that don't produce something sexy enough to publish still become public access at the end of the exclusivity period.

    Min

    --
    On the whole, I find that I prefer Slashdot posts to twitter ones because I don't get limited to 140 chars before
  7. Dump FOIA - make it open like Wisconsin by xxxJonBoyxxx · · Score: 3, Interesting

    Take a look at Wisconsin: an attempt to make the state's laws as restrictive as the FOIA was met with huge backlash and a unanimous vote in the Republican-led Senate against it.

    http://www.jsonline.com/news/w...

    Why not just dump the FOIA and let people electronically read what they want whenever? Think of it like "body cameras for politicians."

  8. That should put an end to FOIA requests by Opportunist · · Score: 3, Insightful

    There's exactly two kinds of people who file such a thing: Idealists who strive for freedom of information and journalists hoping for a cool exclusive story.

    Idealists usually lack the money and time to pursue this interest with zeal. And Journalists will now no longer get the money and time from their superiors for something that benefits their competitions as much as themselves.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  9. There's issues, and issues by Anonymous Coward · · Score: 2, Interesting

    In a certain sense, FOIA requests only result in material that should have been public and therefore readily available in the first place. In that sense, there can be no issue with making the material public on a website. In another sense, there are costs associated with making FOIA requests and so requiring money from one member of the public then giving the same material to all subsequent comers for free is at least a little skewed. There is also that it's easy for the public at large to track what's being requested now. If everything was public already that wasn't a problem since everything is available and so there is no material that stands out because it is newly available.

    A reasonable short-term fix is to put the FOIA-answer under embargo for a while (eg. three months), and only after that release it to everyone, giving the requestor time to digest the material first. That seems like a good compromise, but really is the wrong thing, so:

    The right solution is for everything to be available all the time, so there is no need for requesting anything under FOIA.

  10. Re:Seems like there's a simple middle ground solut by thrich81 · · Score: 4, Informative

    Totally agree with you. This model is similar to scientific data acquired via federally funded research. The data belongs to the public but the researchers who proposed and did the research work get exclusive rights for a reasonable period of time in order to give them incentive to do the work in the first place.

  11. Re:Seems like there's a simple middle ground solut by SlithyMagister · · Score: 2

    Do a timed release. Once the FOIA request is completed, the requester gets X months of exclusivity to publish, and then it gets released publicly.

    Exactly this

    This gives the journalist time to get his "scoop" and gives the rest of us the ability to check his work. Under the current system journalists can (and do) leave out information that refutes their bias, while reporting only that information that supports their own opinion. The rest of us need to go to the source in order to form our own opinions.

  12. FOIA request for FOIA requests? by Vegan+Cyclist · · Score: 3, Interesting

    If the concern is 'snooping', what's to stop newspapers, etc, from simply filing monthly FOI requests each month 'for a list of all FOI requests last month'?

  13. The perfect is the enemy of the good. by JoshuaZ · · Score: 2

    The perfect is the enemy of the good. In the ideal universe all of this would be public already. But we don't live in that universe, and if we insist that all FOIA requests become available to everyone then overall fewer requests will be made. So the compromise proposed by the AC is the correct response, since it means that we'll have a small delay in the info getting public but it will actually get public.