Domain: archive.org
Stories and comments across the archive that link to archive.org.
Stories · 353
-
DOJ, MIT, JSTOR Seek Anonymity In Swartz Case
theodp writes "Responding to an earlier request by the estate of Aaron Swartz to disclose the names of those involved in the events leading to Aaron's suicide, counsel for MIT snippily told the Court, "The Swartz Estate was not a party to the criminal case, and therefore it is unclear how it has standing, or any legally cognizable interest, to petition for the modification of the Protective Order concerning others' documents." In motions filed on slow-news-day Good Friday (MIT's on spring break), the DOJ, MIT, and JSTOR all insisted on anonymity for those involved in the Swartz case, arguing that redacting of names was a must, citing threats posed by Anonymous and LulzSec, a badly-photoshopped postcard sent to Assistant U.S. Attorney Stephen Heymann and another sent to his Harvard Prof father, cake frosting, a gun hoax, and e-mail sent to MIT. From the DOJ filing: 'I also informed him [Swartz estate lawyer] that whatever additional public benefit might exist by disclosing certain names was, in this case, outweighed by the risk to those individuals of becoming targets of threats, harassment and abuse.' From the MIT filing: 'The publication of MIT's documents in unredacted form could lead to further, more targeted, and more dangerous threats and attacks...The death of Mr. Swartz has created a very volatile atmosphere.' From the JSTOR filing: 'The supercharged nature of the public debate about this case, including hacking incidents, gun hoaxes and threatening messages, gives JSTOR and its employees legitimate concern for their safety and privacy.'" -
DOJ, MIT, JSTOR Seek Anonymity In Swartz Case
theodp writes "Responding to an earlier request by the estate of Aaron Swartz to disclose the names of those involved in the events leading to Aaron's suicide, counsel for MIT snippily told the Court, "The Swartz Estate was not a party to the criminal case, and therefore it is unclear how it has standing, or any legally cognizable interest, to petition for the modification of the Protective Order concerning others' documents." In motions filed on slow-news-day Good Friday (MIT's on spring break), the DOJ, MIT, and JSTOR all insisted on anonymity for those involved in the Swartz case, arguing that redacting of names was a must, citing threats posed by Anonymous and LulzSec, a badly-photoshopped postcard sent to Assistant U.S. Attorney Stephen Heymann and another sent to his Harvard Prof father, cake frosting, a gun hoax, and e-mail sent to MIT. From the DOJ filing: 'I also informed him [Swartz estate lawyer] that whatever additional public benefit might exist by disclosing certain names was, in this case, outweighed by the risk to those individuals of becoming targets of threats, harassment and abuse.' From the MIT filing: 'The publication of MIT's documents in unredacted form could lead to further, more targeted, and more dangerous threats and attacks...The death of Mr. Swartz has created a very volatile atmosphere.' From the JSTOR filing: 'The supercharged nature of the public debate about this case, including hacking incidents, gun hoaxes and threatening messages, gives JSTOR and its employees legitimate concern for their safety and privacy.'" -
Code.org Documentary Serving Multiple Agendas?
theodp writes "'Someday, and that day may never come,' Don Corleone says famously in The Godfather, 'I'll call upon you to do a service for me.' Back in 2010, filmmaker Lesley Chilcott produced Waiting for 'Superman', a controversial documentary that analyzed the failures of the American public education system, and presented charter schools as a glimmer of hope, including the Bill & Melinda Gates Foundation-backed KIPP Los Angeles Prep. Gates himself was a 'Superman' cast member, lamenting how U.S. public schools are producing 'American Idiots' of no use to high tech firms like Microsoft, forcing them to 'go half-way around the world to recruit the engineers and programmers they needed.' So some found it strange that when Chilcott teamed up with Gates again three years later to make Code.org's documentary short What Most Schools Don't Teach, kids from KIPP Empower Academy were called upon to demonstrate that U.S. schoolchildren are still clueless about what computer programmers do. In a nice coincidence, the film went viral just as leaders of Google, Microsoft, and Facebook pressed President Obama and Congress on immigration reform, citing a dearth of U.S. programming talent. And speaking of coincidences, the lone teacher in the Code.org film (James, Teacher@Mount View Elementary), whose classroom was tapped by Code.org as a model for the nation's schools, is Seattle teacher Jamie Ewing, who took top honors in Microsoft's Partners in Learning (PiL) U.S. Forum last summer, earning him a spot on PiL's 'Team USA' and the chance to showcase his project at the Microsoft PiL Global Forum in Prague in November (82-page Conference Guide). Ironically, had Ewing stuck to teaching the kids Scratch programming, as he's shown doing in the Code.org documentary, Microsoft wouldn't have seen fit to send him to its blowout at 'absolutely amazingly beautiful' Prague Castle. Innovative teaching, at least according to Microsoft's rules, 'must include the use of one or more Microsoft technologies.' Fortunately, Ewing's project — described in his MSDN guest blog post — called for using PowerPoint and Skype. For the curious, here's Microsoft PiL's vision of what a classroom should be." -
Aaron Swartz's Estate Seeks Release of Documents
theodp writes "The Boston Globe reports that the estate of Aaron Swartz filed a motion in federal court in Boston Friday to allow the release of documents in the case that has generated national controversy over the U.S. attorney's aggressive pursuit of a stiff sentence. The Court filing (PDF) suggests that the U.S. attorney's office is still up for jerking Aaron around a little posthumously, seeking what his lawyers termed overbroad redactions, including names and titles that are already publicly known. Swartz's family also seeks the return of his seized property (PDF). Last week, Swartz's girlfriend accused MIT of dragging its feet on investigating his suicide. Meanwhile, Slate's Justin Peters asks if the Justice Department learned anything from the Aaron Swartz case, noting that Matthew Keys, who faces 25 years in prison for crimes that include aiding-and-abetting the display of humorously false content, could replace Swartz as the poster boy for prosecutorial overreach." -
Aaron Swartz's Estate Seeks Release of Documents
theodp writes "The Boston Globe reports that the estate of Aaron Swartz filed a motion in federal court in Boston Friday to allow the release of documents in the case that has generated national controversy over the U.S. attorney's aggressive pursuit of a stiff sentence. The Court filing (PDF) suggests that the U.S. attorney's office is still up for jerking Aaron around a little posthumously, seeking what his lawyers termed overbroad redactions, including names and titles that are already publicly known. Swartz's family also seeks the return of his seized property (PDF). Last week, Swartz's girlfriend accused MIT of dragging its feet on investigating his suicide. Meanwhile, Slate's Justin Peters asks if the Justice Department learned anything from the Aaron Swartz case, noting that Matthew Keys, who faces 25 years in prison for crimes that include aiding-and-abetting the display of humorously false content, could replace Swartz as the poster boy for prosecutorial overreach." -
The Accidental Betrayal of Aaron Swartz
theodp writes "The anarchist dictum when it comes to grand juries, explains Salon's Natasha Lennard, is a simple one: 'No one talks, everyone walks.' It's a lesson journalist Quinn Norton tragically learned only after federal prosecutors got her to inadvertently help incriminate Aaron Swartz, her dearest friend and then-lover. Convinced she knew nothing that could be used against Swartz, Norton at first cooperated with the prosecutors. But prosecutors are pro fishermen — they cast wide nets. And in a moment Norton describes as 'profoundly foolish,' she told the grand jury that Swartz had co-authored a blog post advocating for open data (the Guerrilla Open Access Manifesto), which prosecutors latched onto and spun into evidence that the technologist had 'malicious intent in downloading documents on a massive scale.' Norton sadly writes, 'It is important the people know that the prosecutors manipulated me and used my love against Aaron without me understanding what they were doing. This is their normal. They would do this to anyone. We should understand that any alleged crime can become life-ruining if it catches their eyes.' Consider yourself forewarned." -
The Internet Archive To Pay Salaries Partly In Bitcoin, Requests Donations
hypnosec writes "Bitcoin is gaining popularity among mainstream sites lately and the latest to adopt the digital currency as a medium of donations and payments is the Internet Archive. Ready to accept donation in the form of Bitcoin, the Internet Archive announced that it wants to do so to pay some part of employees' salaries, if they choose to, in Bitcoin. The Archive, known for its storage of digital documents (especially the previous version of webpages), is looking to start part salary payments in Bitcoin by April 2013 if everything goes well." -
JSTOR an Entitlement For US DoJ's Ortiz & Holder
theodp writes "If Aaron Swartz downloaded JSTOR documents without paying for them, it would presumably be considered a crime by the USDOJ. But if U.S. Attorney Carmen Ortiz or U.S. Attorney General Eric Holder did the same? Rather than a crime, it would be considered their entitlement, a perk of an elite education that's paid for by their alma maters. Ironically and sadly, that's the kind of inequity Aaron railed against with the Guerilla Open Access Manifesto, a document the DOJ cited as evidence (pdf) that Swartz was a menace to society. On Thursday, Ortiz insisted Swartz — who she now characterizes as 'mentally ill' — received fair and reasonable treatment from the DOJ. But that wasn't good enough for Senator John Cornyn, who on Friday asked Eric Holder to explain the DOJ prosecution of Aaron Swartz." Federal prosecutors have come under heavy criticism for their handling of the Swartz case. Legal scholar Orin Kerr provides counterpoint with two detailed, well-reasoned posts about the case. Kerr says that, as the law stands, the charges against Swartz were "pretty much legit," and that the law itself should be the target of the internet community's angst, rather than the prosecutors. "...blame the system and aim to reform the system; don’t think that this was just two or three prosecutors that were doing something unusual. It wasn’t." James Boyle, co-founder of the Center for the Study of the Public Domain, disagrees with Kerr (partly), arguing that Swartz's renown is simply drawing people together to collectively shine a light on poor legislation and poor prosecutorial practices. -
JSTOR an Entitlement For US DoJ's Ortiz & Holder
theodp writes "If Aaron Swartz downloaded JSTOR documents without paying for them, it would presumably be considered a crime by the USDOJ. But if U.S. Attorney Carmen Ortiz or U.S. Attorney General Eric Holder did the same? Rather than a crime, it would be considered their entitlement, a perk of an elite education that's paid for by their alma maters. Ironically and sadly, that's the kind of inequity Aaron railed against with the Guerilla Open Access Manifesto, a document the DOJ cited as evidence (pdf) that Swartz was a menace to society. On Thursday, Ortiz insisted Swartz — who she now characterizes as 'mentally ill' — received fair and reasonable treatment from the DOJ. But that wasn't good enough for Senator John Cornyn, who on Friday asked Eric Holder to explain the DOJ prosecution of Aaron Swartz." Federal prosecutors have come under heavy criticism for their handling of the Swartz case. Legal scholar Orin Kerr provides counterpoint with two detailed, well-reasoned posts about the case. Kerr says that, as the law stands, the charges against Swartz were "pretty much legit," and that the law itself should be the target of the internet community's angst, rather than the prosecutors. "...blame the system and aim to reform the system; don’t think that this was just two or three prosecutors that were doing something unusual. It wasn’t." James Boyle, co-founder of the Center for the Study of the Public Domain, disagrees with Kerr (partly), arguing that Swartz's renown is simply drawing people together to collectively shine a light on poor legislation and poor prosecutorial practices. -
US Attorney Chided Swartz On Day of Suicide
theodp writes "The e-mail that Defendant Swartz's supplemental memorandum (pdf) cites as paramount to his fifth motion to suppress [evidence against him] is relevant, but not nearly as important as he tries to make it out to be,' quipped United States Attorney Carmen M. Ortiz (pdf) in a court filing made on the same day Aaron Swartz committed suicide. In the 1-7-2011 e-mail Ortiz refers to, which was not produced for Swartz until Dec. 14th — almost two years after his 1-6-2011 arrest — a Secret Service agent reported to the Assistant U.S. Attorney that he was 'prepared to take custody anytime' of Swartz's laptop, although no one had yet sought a warrant to search the computer. In Prosecutor as Bully, Larry Lessig laments, 'They [JSTOR] declined to pursue their own action against Aaron, and they asked the government to drop its. MIT, to its great shame, was not as clear, and so the prosecutor had the excuse he needed to continue his war against the "criminal" who we who loved him knew as Aaron.' Swartz's family also had harsh words for MIT and prosecutors: 'Decisions made by officials in the Massachusetts U.S. Attorney's office and at MIT contributed to his death. The US Attorney's office pursued an exceptionally harsh array of charges, carrying potentially over 30 years in prison, to punish an alleged crime that had no victims. Meanwhile, unlike JSTOR, MIT refused to stand up for Aaron.' With MIT President Emeritus Charles M. Vest currently serving as a Trustee of JSTOR parent Ithaka as well as a Trustee of The MIT Corporation, one might have expected MIT to issue a statement similar to the let's-put-this-behind-us one JSTOR made on the Swartz case back in 2011." -
US Attorney Chided Swartz On Day of Suicide
theodp writes "The e-mail that Defendant Swartz's supplemental memorandum (pdf) cites as paramount to his fifth motion to suppress [evidence against him] is relevant, but not nearly as important as he tries to make it out to be,' quipped United States Attorney Carmen M. Ortiz (pdf) in a court filing made on the same day Aaron Swartz committed suicide. In the 1-7-2011 e-mail Ortiz refers to, which was not produced for Swartz until Dec. 14th — almost two years after his 1-6-2011 arrest — a Secret Service agent reported to the Assistant U.S. Attorney that he was 'prepared to take custody anytime' of Swartz's laptop, although no one had yet sought a warrant to search the computer. In Prosecutor as Bully, Larry Lessig laments, 'They [JSTOR] declined to pursue their own action against Aaron, and they asked the government to drop its. MIT, to its great shame, was not as clear, and so the prosecutor had the excuse he needed to continue his war against the "criminal" who we who loved him knew as Aaron.' Swartz's family also had harsh words for MIT and prosecutors: 'Decisions made by officials in the Massachusetts U.S. Attorney's office and at MIT contributed to his death. The US Attorney's office pursued an exceptionally harsh array of charges, carrying potentially over 30 years in prison, to punish an alleged crime that had no victims. Meanwhile, unlike JSTOR, MIT refused to stand up for Aaron.' With MIT President Emeritus Charles M. Vest currently serving as a Trustee of JSTOR parent Ithaka as well as a Trustee of The MIT Corporation, one might have expected MIT to issue a statement similar to the let's-put-this-behind-us one JSTOR made on the Swartz case back in 2011." -
Richard Stallman Answers Your Questions
A while ago you had the chance to ask founder of the GNU Project, and free software advocate, Richard Stallman, about GNU/Linux, free software, and anything else. You can read his answers to a wide range of questions below. As usual, RMS didn't pull any punches. Capitalism and You
by eldavojohn
Your monkish lifestyle would leave most people who work in software screaming for a Lear Jet and you have stated "I've always lived cheaply ... like a student, basically. And I like that, because it means that money is not telling me what to do." Growing up in the United States, I have been served the koolaid of Capitalism several times and I have been taught that the inherent competition and struggle for money in all aspects of our lives make us the greatest country ever. I've read a lot of your comments on intellectual property reform and I can't help but feel that it just isn't compatible with capitalism. Have you ever had problems rectifying your stance on intellectual property with capitalism? Do you see any problems at all with no copyright or patent laws inside a capitalistic society?
RMS: First, I need to correct an apparent misunderstanding. I do not have a "stance on intellectual property", because that would mean using the term "intellectual property" in my thinking. I take pains never to do that, because that term is an obstacle to clear thinking. Every time it is used, it misrepresents the legal reality and spreads confusion.
I judge copyright law by its practical requirements and their practical effects. I judge patent law by its practical requirements and their practical effects -- totally different requirements and totally different effects. These two laws are different on every practical point; all they have in common is a very abstract idea which is of no practical significance.
I want to encourage clear thinking about copyright law. Separately, I want to encourage clear thinking about patent law. The first step in clear thinking about these laws is not to lump them together. In particular, never use the term "intellectual property", since it lumps them together.
I must not respond directly to a question that treats copyright law and patent law as a single issue. If I did, I'd be lumping them together and spreading the confusion I want to clear up.
However, I can split it into two separate questions.
First, copyright. Copyright is a legal restriction on certain kinds of use of works of authorship. The US has always had some sort of copyright law, but it has changed tremendously. The US has always practiced capitalism, but many sorts of works were, at some time in US history, not covered by copyright. Thus, we know it is possible to have capitalism without copyright.
However, I don't advocate simple elimination of copyright as a solution.
Works that are designed for use doing practical jobs must be free; however, simply eliminating copyright on those works would not have this result. In software, it would make things worse, because copyleft is based on copyright. Without copyright, programs could still be made nonfree using EULAs, tivoization, and nonrelease of source code, but we would no longer be able to prevent this using copyleft.
If we wanted to legislate to make all these works-for-use free, we would have to go further than just eliminating copyright on them. In an ideal world, we would do this, but I don't propose doing it now.
As for works of opinion and art, I don't think they must be free. I advocate some reforms of copyright for these works but I see no reason to abolish it.
Patent law is a totally different issue. A patent is an artificial monopoly on using a specified idea. There have been successful capitalist countries that didn't have a patent system. My expertise is in computing, so I campaign to eliminate patents from computing, where I know they are harmful. However, Boldrin and Levine present good arguments that patents do mostly harm in every field and that it would be better to eliminate patents entirely.
With any or all of these changes, we would still have capitalism; only some details would be different.
I feel like you have this admirable and altruistic quality where money isn't the ultimate driving force and when you speak to people who base their entire lives around money, there's a fundamental disconnect that is overlooked.
RMS: Arguments are always based on values. The free software movement is based on values of freedom and community -- that is where it differs from open source. People who don't share those values will simply not get it, no matter what I might say. Since that's inevitable, I don't worry about it. I do my best, and I persuade some, which is better than giving up and persuading none.
Re:Do you like being worshiped ?
by capt.Hij
This brings up a good point. Let me rephrase the question. Mr Stallman, you are regarded as a founding father of the free software movement, and your opinion on free software carries a lot of weight. Because of this you are put under a harsh spot light, and every little thing you do is magnified. For example, your comments about Steve Jobs immediately after his death were broadcast quite widely. To some people the timing showed a lack of taste and were seen as disrespectful.
RMS: Those people evidently were more concerned with forms of politeness that with substantive good and evil. Someone told me I should not criticize Jobs because he could not defend himself -- while thousands were lionizing him with the indirect support of Apple's PR machine. Compared to that, I was David against Goliath.
Because of your status in the free software movement your statement was used by some to smear the larger community. How do you feel about this kind of attention?
RMS: I stand by what I said about Jobs. Apple is your enemy, and if you don't recognize this and fight, you're being a chump.
If someone tried to spin my statement as something to be ashamed of, please fight back by arguing with his spin.
Have you given it much thought, and what kind of insight can you share about the situation you are in when your private and public mannerisms are misconstrued to be part of a larger group's views and outlooks?
RMS: I hope that a lot of the community shares my views of Jobs and Apple. I ask them to stand up and be counted.
Apple's favorable public image, including public admiration of Jobs for side issues, is a crucial asset in its war against our freedom. To tarnish its image, we need to speak loud and clear about Apple's wrongs. When Steve Jobs is praised for the elegant styling of the jails he designed, we must respond that it is wrong to put users in jail. Speak up and spread the word!
Role of the FSF
by ssam
It seems to me that in the early days of the FSF the main role was writing software. A huge chunk of that code is what makes up modern day free operating systems. A lot of it is class leading software (bash, gcc, emacs, etc). In the past few years it seems that the FSF is far more involved in campaigning than coding. Is this an accurate view of the situation? Is this intentional, and if so why? Should the FSF be trying to create a class leading web browser, for example.
RMS: In the first years of developing the GNU system, before Linux completed the system, not many people worked on free software. A few staff hired by the FSF made a big difference to our progress.
Once GNU/Linux caught on, lots more people got involved, so that the few people the FSF could hire were inevitably a tiny fraction of what the community did. Meanwhile, our other jobs became bigger and more important. For instance, once the DMCA made it illegal to release free software to handle common media formats, just writing free software was no longer enough, so we launched the DefectiveByDesign.org campaign. A year ago we launched our campaign against Restricted Boot, which is the way Microsoft perverts Secure Boot into an anti-security feature.
"Success" is not our goal; we're not here to win a race, we are here to win freedom. I didn't write GCC with the idea of making a "better" C compiler. I wrote it so there would be a freedom-respecting C compiler, and while I was at it, I did the best job I knew how. We didn't develop GNU to have a "better" operating system than Unix; we developed it so we could have a freedom-respecting operating system. It's the same today.
Thus, if we could raise money to hire a few software developers, we would spend it on projects that are more than technical improvements. For instance, it would make no sense to try to develop a web browser that is "better" in a merely practical sense. There is no reason to think we could outdo the Firefox developers in what they are good at, and it would be wasteful duplication to try.
Instead we are trying to do something that Firefox does not aim to do: protect the user's privacy from surveillance by web sites, and protect the user's freedom from nonfree Javascript code. A volunteer is working on our variant of Firefox, called IceCat, with changes for these purposes. We don't have funds for this, so would you like volunteer to help?
GNU visibility and factioning
by Digana
GNU is supposed to be a free operating system as well as a group of people working towards building this OS. To a casual observer, however, GNU does not appear very active.
RMS: I've decided to post new package releases in a more visible place in gnu.org.
Development of GNU is done by volunteers, so the level of activity is up to you. If you wish GNU were more active, join in the work on some GNU package that interests you. For instance, it would be useful to have more developers for LibreJS, which detects and blocks nonfree Javascript, and for IceCat.
Some of the most prominent and supposedly GNU packages, such as Gimp, Gnome, GTK+, and R are mostly GNU in name only. The hackers working on these projects have very little interaction with other hackers working on GNU projects and they very frequently espouse views contrary to GNU's philosophical aims. Thus to an outside observer, GNU does not appear to be a cohesive group of people working towards a common goal.
RMS: The GNU project is not as cohesive as I wish it were. To some extent, this is a consequence of an approach that was necessary. The only way to develop something as large as the GNU system through the work mostly of volunteers was to divide it into projects that could be implemented mostly independently by different people. The design of Unix lent itself to this. The fact that the GNU system incorporated programs such as X and TeX, that were developed by other people or groups that regarded the GNU Project as just a user, pushed in the same direction.
There is always a centrifugal tendency when many groups work mostly independently. It is often hard to persuade the developers of one component to do what improves the system as a whole rather than what will make their own component more useful and successful.
By 1990, when we started the HURD kernel, I expected that in a couple of years it would be working and we would integrate the GNU system. However, the HURD didn't work at all until 1996, and in the mean time the community began using GNU with Linux as the kernel. By the time we started using it that way, others had integrated the GNU/Linux combination, making various GNU/Linux distros.
The initial goal of GNU, to have a free operating system, has been achieved; the initial sharp focus on completing a free Unix-like system is no longer applicable. This doesn't mean our work is over; most GNU/Linux distros today contain nonfree software, and there are more things that we expect a system to do. We still need people to seek out and do the development jobs that need doing in order to win freedom for the users of computing.
My first step to make the GNU Project more cohesive was in 1999. In the 1980s and 90s, when I appointed someone as the maintainer for a GNU package, I took for granted that he would understand that his job was to manage a part of a larger project, and what that implied. In 1999 I realized this could not be taken for granted, so I began explaining this relationship to new maintainers and asking new maintainers to agree to it. However, the relationship with a few packages had already become distant.
Many GNU mailing lists being private further the public perception that GNU is not even actively producing software anymore.
RMS: Our main packages have public discussion lists, but that's a choice for the package maintainer to make. Feel free to suggest changes to the maintainer.
What can be done to remedy this situation? How can we strengthen GNU, make it reach out again to the people it's supposed to be freeing?
RMS: For the most part, this is up to you. When you start working on a new free program, do you propose making it a GNU package? Would you like it to be part of a coherent GNU Project? If so, please write to me.
How to reverse the aggregation problem?
by concealment
A problem with software and operating systems is what I call the "aggregation problem," which is that what we have now is an aggregate of past solutions to problems that may no longer exist. The stuff piles up, increasing complexity and decreasing the uniformity and effectiveness of the interface. At what point do software projects call for a top-down redesign? How can free software do this where industry cannot?
RMS: I don't have any solution to offer for this particular problem, other than the slow methods we are using now. Partly that's because I don't think this is the most important issue -- I think our freedom is more important than technical improvement.
However, this is not the only area in which more uniformity is desirable. Around 1990, I designed a protocol for configuring and building packages from source: you type `./configure; make install'. It would be nice if all free software packages supported this uniform interface, but they don't.
To help implement that uniformity, a GNU volunteer recently made it very easy to use Autoconf in Python packages, so that they can build and install using our uniform commands. If you maintain a program in Python, how about adding this support? Every user that isn't a Python programmer will be glad he can install your program without learning a special Python build method.
What project is using the wrong license?
by gQuigs
What free software project is using a license that doesn't actually match with it's mission - or hinders free software in other ways? In other words, if you could *magically* switch the license of one project - which would you choose and why? Examples: Move Mesa to GPLv3, Move Linux from GPLv2 to v3, Make android GPLv3, GCC - from GPLv3 to Apache.
RMS: If I could magically change one program to GPLv3, it would be Linux. One of the improvements of GPLv3 is that it blocks tivoization, and Linux is very frequently tivoized. (Many Android devices contain a tivoized copy of Linux.)
While we're talking about magic, I'd change the license of LLVM also.
Another program that is important to convert is LibreCAD. This is more than a fantasy: the developers of LibreCAD are working on replacing the old GPLv2-only code that they included, so as to switch to GPLv3-or-later. Would you like to help?
What do you think of non-free, non-software works?
by Shlomi Fish
Dear Dr. Stallman, In this Slashdot feature"Stallman is quoted here saying that game engines should be free, but approves of the notion that graphics, music, and stories could all be separate and treated differently (i.e., "Non-Free.")." However, this feature does not give a citation from you for that. To add to the confusion in a post to the Creative Commons Community mailing list, Rob Myers said:
"RMS's views on culture are coherent and consistent with his views on software. But he's treating game assets as a matter of functionality (software) rather than speech (culture). There is an issue with the latter not being free.."
So I'm a little confused. Do you approve of people using non-free licenses for cultural works, including the CC-by-nc, CC-by-nc-sa, CC-by-nd, and CC-by-nc-nd licenses? If so, when?
This is especially important given the fact that in the process for formulating the latest version of the Creative Commons licenses (4.0), there has been some requests to deprecate the non-commercial (nc) and/or no-derivatives (nd) options (which I doubt will happen, but is nonetheless some thing some people feel strongly about).
RMS: After some 12 years of stating my position in all my speeches on Copyright vs Community, and publishing transcripts, I'd expect interested people to have found it. But here it is.
Those works that are made for doing practical jobs must be free. This includes software, educational works, reference works, text fonts, recipes, and 3d-printer models for objects for practical use, as well as some other things.
Works of testimony and opinion, and artistic works, don't have to be free as in the four freedoms, but their users should have more freedom than now. I think people should be free to share them (noncommercial redistribution of exact copies), and to remix them. Putting DRM or EULAs on them should be banned too. I think all the CC licenses do these things, more or less, and I use CC-ND for my statements of my views, including this one.
Two of the nonfree CC licenses, CC-NC and CC-NC-SA, have a peculiar problem: they lead to making works which are orphan before they are born.
I call this a "peculiar problem" because I don't think these licenses are bad in principle. The problem is purely a matter of practical consequences, and it seems they should be avoidable, yet I can't see a way to avoid them. I hope one is found; in the mean time, I urge not using these two licenses.
Favorite hack
by vlm
Give me your best hack. Specifically something YOU did personally not hire / grad student. Hardware, software only (yes yes the GPL is cool but I'm looking for code or schematic or at least a description of something made out of source or solder) I can't put words in your mouth but the ideal answer would be something like "I'm particularly proud of the O(n) memory garbage collection routine in emacs implemented around '89 and how it worked was very roughly ..." or "I really like my homemade fully automatic automotive relay based routing system for my OH scale model railroad sorting yard" or "I built my own legal limit ham radio amplifier" almost certainly a different topic of course, but something of this form of answer.
RMS: I can't remember all the hacks that I was proud of, so I can't pick the best. But here's something I remember fondly. The last piece of Gosmacs code that I replaced was the serial terminal scrolling optimizer, a few pages of Gosling's code which was proceeded by a comment with a skull and crossbones, meaning that it was so hard to understand that it was poison. I had to replace it, but worried that the job would be hard. I found a simpler algorithm and got it to work in a few hours, producing code that was shorter, faster, clearer, and more extensible. Then I made it use the terminal commands to insert or delete multiple lines as a single operation, which made screen updating far more efficient.
Why FDR and Churchill?
by eldavojohn
During a Q&A Session a while back you were asked about people and movements near and dear to your heart and you said "I admire Franklin D. Roosevelt and Winston Churchill, even though I criticize some of the things that they did." I love World War II history and I also find myself in a love-hate situation with Churchill. Could you go into further detail about what specifics lead you to single out these two over leaders like Lincoln, Jefferson, Benjamin Franklin or even historical figures who have enabled information itself like Turing, Shannon, etc?
RMS: I like math, and I respect good mathematicians, but I don't admire them as heroes. The people I admire are those who fight for freedom.
Why did I mention Roosevelt and Churchill in particular? I didn't make a list of all the leaders I admire and then choose the ones I admire most. That would be a big job, and my memory does not lend itself to that, so I didn't try. I mentioned the people that came to mind.
I was thinking of leaders that fought against evil tyranny. Of the five leaders you mentioned, Roosevelt and Churchill had the hardest fight against the greatest evil. King George trampled the colonists' rights, and the Confederacy fought for slavery, but Hitler's genocidal empire was much worse.
If I were judging peacetime political leadership, I would not choose Churchill; perhaps Jefferson.
Stolen bag / laptop in Argentina
by Cigarra
What ever happened with the stolen bag and laptop? Did you get something back? Did you LOSE data (that is, was something not backed up)? Are you mad with the organizers / country that hosted the event?
RMS: My friends never found any sign of what was stolen. I lost some files, those which were outside the directories that I regularly backed up, but nothing really important.
I don't blame the speech organizers or Argentina in general for this theft. The reason I will never go to Argentina again has nothing to do with the theft. I announced it before I arrived in Argentina: I object to the requirement for visitors to give their fingerprints. I refuse to go to any country which has that policy, and I hope you too will refuse to go to any country that would demand your fingerprints.
Revolution OS ...
by i.r.id10t
Interviews with you comprised a big percentage of the documentary Revolution OS. If it were to be remade today, and the financial aspects ignored, what do you think would be different? If you were producing such a documentary today, what would you focus on?
RMS: I didn't make that movie, so how to make it was not my decision, and how to make one today would not be my decision. But I see some things that would have to be different.
Much attention was paid to business leaders of the open source bubble, which popped after the interviews. The movie ended saying how some companies' stock had gone down. If the movie were made today, those people and their commercial claims would probably not be in it. Also, I would not be found at a "Linux" event; shortly after that time, I concluded it was self-defeating to legitimize events that call the GNU system "Linux".
Other advocates
by SirGarlon
Who, other than yourself and the FSF, do you consider to be effective advocates for software freedom? Please name individuals if you can.
RMS: Eben Moglen and SFLC, Bradley Kuhn and the Conservancy, Frederic Couchet and APRIL, Via Libre, Alexandre Oliva, Octavio Rossell, Quiliro Ordoñez, are the ones that occur to me. I have probably forgotten many.
Open Source and Ethics in research?
by tsquar3d
RMS, I am a PhD student in computing and I have run up against an interesting problem. I consider FOSS to be at the core of my personal philosophy.
RMS: I have to point out that there is no "FOSS" philosophy. The term "FOSS" is a way of referring to two different philosophies: free software is one, and open source is the other.
When you want to refer to both philosophies, I recommend "FLOSS" rather than "FOSS". "FLOSS", or "Free/Libre and Open Source Software", gives the two equal visibility, whereas with "FOSS", "Free and Open Source Software", "Open Source" is more prominent. But you can't possibly agree with both of these philosophies, because they disagree at the deepest level. Your views might be one, or the other, or a mixture, or something else, but it can't be both of them at once.
See here for more explanation of the difference between free software and open source. To me it is not just a pragmatic issue, but an ethical one.
RMS: It sounds like your philosophy may be closer to the free software movement. We consider this an ethical issue, whereas the usual open source philosophy presents it as a practical issue alone.
Therefore, in my research, I use all FOSS software. Now, the problem arises when trying to justify my use of FOSS to colleagues and supervisors.
RMS: Why do you need to try to justify your _own_ use of free software? I'd expect you to decide, and follow your own decision, with no need to justify it to anyone else. Is there something I have misunderstood?
The time you need to argue is to convince other teachers and researchers to move to free software.
I have tried to make the case that it is an ethical issue, and have argued the merits of freedom and academia, however, I invariably am told "that's not an academic argument".
RMS: I suggest you respond "I'm a citizen first, and an academic second, so I care about ethical arguments as well as academic arguments."
This is incredibly frustrating and annoying to me as, in academic research, we are constantly being restricted by "research ethics" (e.g. the ethical treatment of subjects, plagiarism, etc.) and I am more than willing to bet that if a researcher objected to a methodology based on "religious principles" they would be excused.
RMS: I don't understand -- "excused" from what? I am not sure now what issue the argument is about. Are they criticizing you for your decision? If so, you don't need to be "excused", you just need to stand firm and proud. Or are you asking them for permission? There, too, standing firm is best, but it is trickier.
Or are you asking them to change their practices? That is good to try, but there is no guaranteed recipe for persuading others. I suggest telling them about the malicious features commonly found in nonfree software, to bring home to them that this is an important issue. Also, raise the issue publicly so as to build consciousness of the issue and search for allies. -
Judge Grants Defendant's Motion To Explore Alleged Fraud By Prenda Law
An anonymous reader writes "Prenda Law — one of the most notorious copyright trolls — has sued hundreds of thousands of John Doe defendants, often receiving settlements of thousands of dollars from each. Prenda Law principal John Steele has reportedly made a few million dollars suing BitTorrent file-sharers. Prenda Law has been accused in federal court of creating sham offshore corporations using the identity of his gardener. In other words, it is alleged that the law firm and their client are the same entity, and that Prenda law has committed identity theft and fraud. Now, a judge in California has granted a John Doe defendant's motion to further explore the connection between the offshore entity and the law firm." -
Internet Archive Needs Donations, Has Matching Donor
The Internet Archive curates an astounding collection (actually, a collection of collections) of online resources, from historically significant to modern but obscure. Storing, serving and organizing more than 10 petabytes isn't cheap, despite their ongoing efforts to innovate on that front. An anonymous reader writes "An anonymous donor is matching $3 for every $1 given (up to $450,000) until December 31. One petabyte has been paid for so far and the archive is looking at getting three more. 'These massive servers are the backbone of the Archive, and critical to our continued growth. To all of you who've contributed to our fundraising drive, thanks from all of us here at the Internet Archive. '" -
Internet Archive Needs Donations, Has Matching Donor
The Internet Archive curates an astounding collection (actually, a collection of collections) of online resources, from historically significant to modern but obscure. Storing, serving and organizing more than 10 petabytes isn't cheap, despite their ongoing efforts to innovate on that front. An anonymous reader writes "An anonymous donor is matching $3 for every $1 given (up to $450,000) until December 31. One petabyte has been paid for so far and the archive is looking at getting three more. 'These massive servers are the backbone of the Archive, and critical to our continued growth. To all of you who've contributed to our fundraising drive, thanks from all of us here at the Internet Archive. '" -
Internet Archive Needs Donations, Has Matching Donor
The Internet Archive curates an astounding collection (actually, a collection of collections) of online resources, from historically significant to modern but obscure. Storing, serving and organizing more than 10 petabytes isn't cheap, despite their ongoing efforts to innovate on that front. An anonymous reader writes "An anonymous donor is matching $3 for every $1 given (up to $450,000) until December 31. One petabyte has been paid for so far and the archive is looking at getting three more. 'These massive servers are the backbone of the Archive, and critical to our continued growth. To all of you who've contributed to our fundraising drive, thanks from all of us here at the Internet Archive. '" -
Google Engineers Open Source Book Scanner Design
c0lo writes "Engineers from Google's Books team have released the design plans for a comparatively reasonably priced (about $1500) book scanner on Google Code. Built using a scanner, a vacuum cleaner and various other components, the Linear Book Scanner was developed by engineers during the '20 percent time' that Google allocates for personal projects. The license is highly permissive, thus it's possible the design and building costs can be improved. Any takers?" Adds reader leighklotz: "The Google Tech Talk Video starts with Jeff Breidenbach of the Google Books team, and moves on to Dany Qumsiyeh showing how simple his design is to build. Could it be that the Google Books team has had enough of destroying the library in order to save it? Or maybe the just want to up-stage the Internet Archive's Scanning Robot. Disclaimer: I worked with Jeff when we were at Xerox (where he did this awesome hack), but this is more awesome because it saves books." -
The Internet Archive Has Saved Over 10,000,000,000,000,000 Bytes of the Web
An anonymous reader writes "Last night, the Internet Archive threw a party; hundreds of Internet Archive supporters, volunteers, and staff celebrated that the site had passed the 10,000,000,000,000,000 byte mark for archiving the Internet. As the non-profit digital library, known for its Wayback Machine service, points out, the organization has thus now saved 10 petabytes of cultural material." The announcement coincided with the release of an 80-terabyte dataset for researchers and, for the first time, the complete literature of a people: the Balinese. -
The Internet Archive Has Saved Over 10,000,000,000,000,000 Bytes of the Web
An anonymous reader writes "Last night, the Internet Archive threw a party; hundreds of Internet Archive supporters, volunteers, and staff celebrated that the site had passed the 10,000,000,000,000,000 byte mark for archiving the Internet. As the non-profit digital library, known for its Wayback Machine service, points out, the organization has thus now saved 10 petabytes of cultural material." The announcement coincided with the release of an 80-terabyte dataset for researchers and, for the first time, the complete literature of a people: the Balinese. -
The Internet Archive Has Saved Over 10,000,000,000,000,000 Bytes of the Web
An anonymous reader writes "Last night, the Internet Archive threw a party; hundreds of Internet Archive supporters, volunteers, and staff celebrated that the site had passed the 10,000,000,000,000,000 byte mark for archiving the Internet. As the non-profit digital library, known for its Wayback Machine service, points out, the organization has thus now saved 10 petabytes of cultural material." The announcement coincided with the release of an 80-terabyte dataset for researchers and, for the first time, the complete literature of a people: the Balinese. -
The Greatest Battle of the Personal Computing Revolution Lies Ahead
As tablets and computer-phones flood the market, the headlines read: "The Personal Computer is Dying." But they are only half true: an artifact of the PC is dying, but the essence of the PC revolution is closer to realization than ever before, while also being closer to loss than ever before.Certainly one way to define the Personal Computer stems from the era of the IBM PC: a gray box with a monitor, mouse, and keyboard (or a laptop). But the idea of the Personal Computer dates back quite a while — back to Alan Kay's Dynabook, the Lisp Machine, etc.
The Apple Knowledge Navigator provided a vision of personal computing far more dynamic than that dull gray box. Although still a pale comparison, tablet and phone platforms are beginning to look awfully similar.
The essence of those pre-PC Personal Computers was that of the user controlling the device. You control the data, you control the software; the Personal Computer is a uniquely personal artifact that the user adapts to his own working style. One consequence of this is that creating is as easy (perhaps easier) as consuming content. Another nice side effect is that your data remains private by virtue of local storage.
In many ways, then, a tablet or phone comes significantly closer to a personal computer than that dull gray box under your desk. For example, on Android, the screen ceases to be a place to throw icons and becomes a rich canvas of widgets. Additionally, my phone fits into my pocket and is always there. Ubiquitous cellular coverage gives me access to my data from most anywhere. The touchscreen and interface conventions make direct manipulation shine in a way you just can't get from a screen two feet away on a desk.
And, those are just superficial improvements over the desktop. Albeit tied to proprietary services, Google's voice search and Siri are inching closer to the dream of personal Intelligent Agents reminding us all that our mothers called us earlier today and want us to pick up the birthday cake for the surprise party With a few taps I can search basically all of my data, not to mention the collective knowledge of mankind.
But the software running on these devices has a dark side. Want to access your music collection the go? You have to get it from Google Play. Want to have lightweight instant messaging? You have to use GTalk. Or take ebook readers (certainly personal devices): that book you just downloaded to your Kindle is DRMed and stuck there! That intelligent agent? Apple records everything you bark at her and can take her away at a moment's notice.
Furthermore, the software on these devices is geared almost exclusively toward content consumption. You can listen to music all day long, but don't try multi-track recording. That ebook reader is great for reading, but you can't scratch notes in the margins of any of your books or sit down with one and scrawl out your latest manuscript. Clearly, some of this is from the youth of these new systems, but it is distressing to see them geared first toward consumption (the Newton, for example, was geared from the start as a device for creation).
The "cloud" as implemented by Amazon, Google, Apple, et al. is a distinct threat to the personal computer. Loss of control over our own data is perhaps the worst part of the cloud. We're easily seduced by genuinely useful features like access to our contacts and music from any device without having to manually sync anything. It's certainly more convenient to purchase a digital movie on Amazon Prime than to hunt down a DVD, and Netflix is definitely nicer for most people than cable television. But when you buy a movie on Amazon, you don't really own it.
Underlying many of these cloud services (especially media-related ones) is Digital Restrictions Management. Whether it be the files themselves or the protocol used to transmit data, DRM is used to control what you can do with your data, restricting even what programs you can use to interact with seemingly neutral files. Worse, networked DRM services can and have led to lost data when it is no longer profitable for the company to run the verification servers.
The only copying that DRM discourages effectively is the sneakernet. And, given that the sneakernet has existed since recordable media has existed, it doesn't seem like the sneakernet is really much of a threat to creative business. I might lend a friend a CD (or even let her copy a few files), but just as I don't unwrap that CD and torrent it through The Pirate Bay, I'm not going to download a movie from Amazon and do the same. There's really no incentive to do so, for most people — most people pirate because that's what you have to do to get the media you want, not because you have a compulsive desire to share things with your closest 10,000 friends.
In order to prevent what is effectively sharing between actual friends, pushers of DRM-infected data want us to completely cede control of our own data!
And they have made people accept it: Steam, Netflix, and Amazon Prime are wildly popular. All of those services are great ideas, but all of them treat you as if you were a criminal.
Worse yet, the spread of Software-as-a-Service is returning us to the bad old days: that powerful PC in your pocket is quickly becoming no more than a glorified terminal. The open peer-to-peer network is being subverted from an enabler of collaboration never before seen into yet another scheme to tether users to proprietary, centralized services. And, as SaaS expands, privacy recedes. No longer is it implicit that your documents are yours alone; now you write and store things using Google Docs and have no expectation of privacy (legally), despite expecting privacy. Amazon knows what you read; Netflix knows what you watch; Google knows what you visit.
Control over the programs you run, and more importantly can write, is key to a personal computer being personal. And it seems absurd that that right might be taken away, but behold: the iPhone and soon Mac Store are these mythical walled gardens. You have to subvert your device to gain real control! And the natural path for Apple is to restrict Macs similarly to iOS devices.
And so we are all-too-near an Orwellian nightmare where vendors dictate what we can do with and how we can use our own data.
But what about the hardware itself? It could be argued that a device isn't really personal for some set of people if they can't change all of the software. Here too we see some promise, and some pitfalls.
The shift to tablet and phone hardware has meant a shift from x86 machines running PC BIOS to thousands of ARM boards, each with its own peculiar way of being programmed. Things you take for granted on x86, like being able to even boot, require custom code. And let's not even begin talking about all of the DSPs and co-processors. Vendors aren't always forthcoming with documentation for their boards, and, even worse, those that do port Linux to their hardware often blatantly violate the GPL and do not distribute kernel sources. This restricts the utility of perfectly fine hardware: often to the detriment of the user and to the benefit of the manufacturer.
Anyone who finds they can't upgrade to the latest version of Android because their vendor won't support it, and the community cannot support it because of non-free drivers, knows what losing control over their hardware is like (RIP HTC Dream).
It might seem like a minor setback ("I guess I have to buy a new phone"), but the lack of specifications or support marginalizes alternative operating systems. There's Meego, Tizen, Open webOS, Firefox OS, SHR, etc., but experimenting with them on your device is a non-starter. Imagine if the x86 were so closed (something we may not have to only imagine much longer): it is doubtful that GNU/Linux or the multitude "alternative" OSes would exist (Atheos, Haiku, L4Linux, even the Hurd). Ever more closed hardware is putting us into a position where two or three companies will dictate everything about the computing experience going forward, with no room for freethinking tinkerers to revolutionize how we interact with our devices.
We are staring at a bleak future, and living in a bleak present in some ways. But there is hope for the battle to be won by the Personal Computer instead of the Terminal.
The Internet is not yet merely glorified cable television. Hypertext, email, instant messaging, trivial file transfer, etc. have revolutionized how mankind communicates (understatement of the decade). Once upon a time the dream was that everyone would be a first-class netizen: your IP was publicly routeable and with a bit of know-how you had a server. Instead, thanks to grossly asymmetric pipes and heavy NATing, it is rare for any individual to run their own servers. Instead we turn to Google, Amazon, et al and cede control over our data.
But now broadband connections are spreading fast (I've gone from 100Kbit/s to 2Mbit/s upstream in three years just with basic service), IPv6 is really here, and software is being written to challenge the centralized "cloud" model being pushed on us from above.
We've had a few victories already: SMTP is still in use, XMPP is the dominant chat protocol (and IRC refuses to die), RSS/Atom aggregation decentralizes news, and the core network protocols are developed in the open.
But Google still controls Android, and myriad services control your data. Part of this is because they have easy client and server interfaces; sure you could run gallery2 and Wordpress on your own server, but I can just snap a photo on my phone and it's up on Facebook 40 seconds later (well, if their app worked, it would be).
Luckily, there are people working on making easy to use "cloud" services. In particular, ownCloud. ownCloud provides a framework for hosting and syncing data between your devices and sharing data with others. The important part is not so much the central server, but the clients they are writing. Eventually, it should be possible to e.g. replace the Google contact/mail/calendar sync and Google Drive, while adding these features to the desktop. Integration in KDE is already underway.
Imagine, instead of being tied to Google you could move the central server to the hosting provider of your wish (or pack up your data and move it to greener pastures if you're not running your own). And, perhaps more subtle (but the real liberation): Your data would be freely movable between all operating systems (interesting that you have to go through hoops to sync your GMail contacts with anything else, and Abandon All Hope Ye who wants to share between an Apple device and anything else). Additionally, the server is designed to respect your privacy (you can e.g. only store encrypted data server-side).
On the hardware side, projects like Firefox OS are very important: having a "mobile" Free Software OS developed in the open might be essential when the dominant open platforms are developed monolithically by corporations with no interest in protecting user control of data.
And then for developing the next generation of devices, folks like Rhombus Tech are pushing for the development of interchangeable CPU boards for embedded devices, and the FSF is expanding their focus to include open hardware.
There are two serious threats that would undermine any resistance: IPv4 exhaustion and draconian content policing. The former issue is technical and likely to solve itself: in the long run multi-level NAT would be too costly, switching hardware will be replaced as it is obsoleted, etc. The latter is political and represents the most serious threat of all. If we cannot communicate freely and the pipes are owned by the very organizations whose business interests will be harmed... we've already seen how brazen the current IP regime can be, and it will take vigilance on the part of many to prevent them from having their way.
Where will we be in ten years? If Google, Amazon, Apple, and Old Media get their way, in a new dark age of computing. Certainly, you'll have a fancy tablet and access to infinite entertainment. But you will own nothing. Sharing data will be controlled by a chosen few entities, the programs you can run or write will be limited in the name of security, and privacy will be dead.
History shows that personal computing survived despite Apple and Microsoft in the 80s and 90s. So, I'm hopeful that other forces will win: the forces of Free Culture and Free Software. If they succeed (or are at least not crushed), the future is much brighter: most content will be available DRM-free, users will control their computing environments, and the egalitarian promise of the Internet will be realized (in no small part thanks to IPv6).
-
Interviews: Ask Free Software Legal Giant Eben Moglen
At this summer's HOPE, Eben Moglen was one of the most incisive and entertaining speakers. But since only a small fraction of the Earth's population can fit into an aging hotel meeting room, you can watch his HOPE presentation via Archive.org on making the first law of robotics apply to cell phones. Besides being a professor at Columbia Law, former clerk in U.S. federal court as well as to Supreme Court Justice Thurgood Marshall, and a prolific writer, Moglen is founding director of the Software Freedom Law Center as well as the creator of the FreedomBox Foundation, and was for many years general counsel of the Free Software Foundation. Moglen has strong opinions, and a lot to say, about software licensing and freedom, copyright, patents, and (as you can see from the video linked above) about the privacy implications of always-on, always-on-us technology. Next week, I'll be meeting up with Moglen for a short interview. If you have a question for Eben, please post it below; I can't guarantee how many reader questions I'll have a chance to ask him, but the more, the merrier. -
All the TV News Since 2009, Now Available At the Internet Archive
6 writes with news that the Internet Archive has launched an online archive of TV news content. According to the NY Times, it will "include every morsel of news produced in the last three years by 20 different channels, encompassing more than 1,000 news series that have generated more than 350,000 separate programs devoted to news." In addition to preserving the works of humankind, the archive is for helping citizens "better understand the issues and candidates in the 2012 U.S. elections by allowing them to search closed captioning transcripts to borrow relevant television news programs." -
Want to Change the Slashdot Logo? For 1 Day in October, You Can
The Slashdot logo has been around for a long time now; the truth is, we're rather fond of it, and have only rarely introduced substantial changes. But for the month of October, as a way of celebrating the site's 15 years of delivering News for Nerds, we invite you to help us temporarily change it. If you have an idea of what the Slashdot logo should look like for one day in October, this is your chance to see it on the page. Starting September 15th, we'll be accepting entries, and sending limited edition anniversary T-shirts to the artists we pick to show off on the page throughout the month. (And a Nexus 7 tablet to the artist who ranks best in show.) Click through for information on what we're looking for, how to enter, and the long list of rules that the legal department has provided for your reading pleasure; we look forward to seeing and sharing your ideas. -
Joyent Drops Lifetime Account Holders
New submitter samnorsk writes "I've long been a lifetime account holder of an old textdrive (now Joyent) cloud hosting account. I remember purchasing the account back in college for a few hundred bucks when I really didn't have the money to spend. At the time, I thought that the opportunity to have a persistent lifetime shell / web hosting account would be valuable. This would be a resource I could fall back on no matter what my current situation was. Now, I just received an email stating that Joyent intends to shut down my lifetime account. Quoting: 'We appreciate and value you as one of Joyent's lifetime Shared Hosting customers. As this service is one of our earliest offerings, and has now run its course, your lifetime service will end on October 31, 2012.' They do offer a 512MB cloud machine for one year, but presumably if we don't take that, we're done. In any case, our lifetime commitment would still be dropped in one year if we take that offer. How is it fair or legal for a 'lifetime account' to end when it is no longer convenient for the company? For reference, this was the original offer. In it, they state: 'How long is it good for? As long as we exist.'" -
Project To Turn Classical Scores Into Copyright-Free Music Completed
yourlord writes "Just under two years ago Musopen launched a Kickstarter campaign covered here on Slashdot. Today that project is complete with the release of a large amount of classical recordings into the public domain. This brings an extensive collection of high quality classical music into the public domain. The project music is hosted on the Musopen site, and on archive.org." -
The Internet Archive Starts Seeding Over a Million Torrents
An anonymous reader writes with news that The Internet Archive has started seeding about 1,400,000 torrents. In addition to over a million books, the Archive is seeding thousands and thousands of films, music tracks, and live concerts. John Gilmore of the EFF said, "The Archive is helping people to understand that BitTorrent isn't just for ephemeral or dodgy items that disappear from view in a short time. BitTorrent is a great way to get and share large files that are permanently available from libraries like the Internet Archive." Brewster Kahle, founder of the Archive, told TorrentFreak, "I hope this is greeted by the BitTorrent community, as we are loving what they have built and are very glad we can populate the BitTorrent universe with library and archive materials. There is a great opportunity for symbiosis between the Libraries and Archives world and the BitTorrent communities." -
The Internet Archive Starts Seeding Over a Million Torrents
An anonymous reader writes with news that The Internet Archive has started seeding about 1,400,000 torrents. In addition to over a million books, the Archive is seeding thousands and thousands of films, music tracks, and live concerts. John Gilmore of the EFF said, "The Archive is helping people to understand that BitTorrent isn't just for ephemeral or dodgy items that disappear from view in a short time. BitTorrent is a great way to get and share large files that are permanently available from libraries like the Internet Archive." Brewster Kahle, founder of the Archive, told TorrentFreak, "I hope this is greeted by the BitTorrent community, as we are loving what they have built and are very glad we can populate the BitTorrent universe with library and archive materials. There is a great opportunity for symbiosis between the Libraries and Archives world and the BitTorrent communities." -
The Internet Archive Starts Seeding Over a Million Torrents
An anonymous reader writes with news that The Internet Archive has started seeding about 1,400,000 torrents. In addition to over a million books, the Archive is seeding thousands and thousands of films, music tracks, and live concerts. John Gilmore of the EFF said, "The Archive is helping people to understand that BitTorrent isn't just for ephemeral or dodgy items that disappear from view in a short time. BitTorrent is a great way to get and share large files that are permanently available from libraries like the Internet Archive." Brewster Kahle, founder of the Archive, told TorrentFreak, "I hope this is greeted by the BitTorrent community, as we are loving what they have built and are very glad we can populate the BitTorrent universe with library and archive materials. There is a great opportunity for symbiosis between the Libraries and Archives world and the BitTorrent communities." -
MusOpen Releases Open Source Classical Music As Pro Tools Files
VVrath writes "Following Tuesday's story about MuseScore releasing its open source recording of the Goldberg Variations, the Musopen project has released ProTools files from its open source recording project. The final edited recordings are still being worked on but it seems we're living in very interesting times regarding open source classical music." -
Apple Fires Back At DoJ Over eBook Price Fixing
An anonymous reader writes "CNN takes a look at Apple's response to the Department of Justice's investigation into eBook price fixing. The filing 'cuts the government's case to shreds' while at the same time not bothering to defend the five publishers also under investigation. Apple said, 'The Government starts from the false premise (PDF) that an eBooks "market" was characterized by "robust price competition" prior to Apple's entry. This ignores a simple and incontrovertible fact: before 2010, there was no real competition, there was only Amazon. At the time Apple entered the market, Amazon sold nearly nine out of every ten eBooks, and its power over price and product selection was nearly absolute.'" -
Patent Suit Targets Every Touch-based Apple Product
suraj.sun writes with news that a new patent suit has been filed against Apple over all of the company's touch-based products. From the article: "According to the complaint (PDF), Professor Slavoljub Milekic conceived a system that used a touchscreen that allowed children to move virtual objects around the screen, which he used to build interactive displays for the Speed Art Museum in Louisville, KY, in 1997, and filed for a patent on his design that same year. The patent in the suit, U.S. Patent #6,920,619 named 'User interface for removing an object from a display,' was issued by the U.S. Patent & Trademark Office in 2005. According to the lawsuit, Milekic formed FlatWorld Interactives in 2007 to 'promote and commercialize' his invention. Curiously, FlatWorld was incorporated on January 2007, just weeks after Apple announced the original iPhone at Macworld Expo. In July 2007, just after Apple shipped the original iPhone, FlatWorld filed a reissue request for the patent, which appears to have been done in order to modify some of the patent's dependent claims." -
Magician Suing For Copyright Over Magic Trick
Fluffeh writes "Teller, the silent half of the well-known magic duo Penn and Teller, has sued a rival magician for copying one of his most famous illusions. The case promises to test the boundaries of copyright law as it applies to magic tricks. A Dutch magician with the stage name Gerard Bakardy (real name: Gerard Dogge) saw Teller perform the trick in Las Vegas and developed his own version — then started selling a kit — including a fake rose, instructions, and a DVD — for about $3,000. Teller had Bakardy's video removed with a DMCA takedown notice, then called Bakardy to demand that the magician stop using his routine. Teller offered to buy Bakardy out, but they were unable to agree on a price. So Teller sued Bakardy last week in a Nevada federal court." -
MIT Fusion Researchers Answer Your Questions
You recently got the chance to ask a group of MIT researchers questions about fusion power, and they've now finished writing some incredibly detailed answers. They discuss the things we've learned about fusion in the past decade, how long it's likely to take for fusion to power your home, the biggest problems fusion researchers are working to solve, and why it's important to continue funding fusion projects. They also delve into the specifics of tokamak operation, like dealing with disruption events and the limitations on reactor size, and provide some insight into fusion as a career. Hit the link below for a wealth of information about fusion. 1. What have we learned?
by jank1887
Fusion is one of those technologies that is always '50 years away,’ even 50 years ago, maybe even 50 years from now. So, looking at what's actually happened recently: What do we actually know now that we didn't know 10-15 years ago that gives support to the notion that we're making progress? Or, what are the 'big' things we know now? Similarly, what are the things we still don't know that we could reasonably expect to find answers for in the next 10-15 years?
MIT Researchers: As researchers in this field, we have heard the expression "Fusion is 50 years away and always will be" more times than we would like to admit. The implication of this statement is that no real progress has been made in the field, which is simply not true! We have made a great deal of progress, even in the last 10–15 years (which have been very lean times for funding). We’ll try to summarize some of the new findings, in no particular order:
1) Internal Transport Barriers/Reversed Shear operation –
We have actually discovered a way to improve upon the performance that we get in H- mode plasmas. These improvements come in the form for so called internal transport barriers. In the past 10–15 years we have begun to understand how to modify the current flowing in tokamak plasmas so that we create effectively what is a barrier in the middle of the plasma. Like the edge barrier in H-mode plasmas, this barrier restricts particles and energy from escaping the plasma and enhancing the overall performance. 2) I-mode –
In just the last 5 years, a new operational regime has been discovered on the Alcator C-Mod tokamak at MIT. This is termed the I-mode, or “Improved L-mode” regime. When the tokamak is operated in this manner it exhibits excellent energy confinement properties, keeping the plasma hot. At the same time the plasma does an excellent job of expelling impurities which dilute the fusion fuel and reduce the number of fusion reactions which can occur. It is particularly important to us as it was first observed on Alcator C-Mod, and is now under active development at many other tokamaks around the world.
3) Development of Predictive Models –
Great advances have been made in the development of predictive computer models, such as gyrokinetic and magnetohydrodynamic (MHD) formulations. Years of experiments have revealed that plasma turbulence is often primarily responsible for the loss of particles and energy from fusion reactors. In the past 10–15 years we have developed advanced models which are thought to contain sufficient physics to simulate plasma turbulence and predict the performance of future fusion devices. At this time we are in the process of validating these models, i.e. comparing them directly with experiment to ensure they are correct, but we are approaching the ability to reliably predict the performance of fusion plasmas without the need for a fusion reactor. This can motivate engineering design and operational choices for future fusion devices.
4) Self-acceleration of the plasma (intrinsic rotation) –
Over the past decade, it has been discovered (on Alcator C-Mod and elsewhere) that plasmas can spontaneously rotate, at speeds of tens of kilometers per second. (Imagine the donut-shaped plasma spinning on its axis.) This turns out to have beneficial effects for stabilizing turbulence at the edge, as the spinning plasma causes the turbulent eddies to break up before they can carry hot plasma out of the core. This is an exciting area of research that could have big implications for the performance of a tokamak reactor.
5) Disruption mitigation –
One of the main problems with a tokamak is the ‘disruption’, when the plasma energy is suddenly lost, stopping any fusion that is occurring and requiring a restart of the reactor. (See the question below for a lot of detail about this!) In extreme cases, these disruptions can cause damage to the wall of the tokamak – which would require repairs before the machine can be restarted. Over the past decade, we have developed techniques to mitigate these disruptions, causing the plasma to come to a rapid shutdown that does not negatively affect the wall condition. Work is underway to scale these techniques up to a reactor-size device (ITER).
6) ELM control/avoidance –
Another longstanding problem with tokamaks is periodic ‘bursts’ of energy from the edge called Edge-Localized Modes (ELMs). In today’s devices, ELMs are not a problem, but in ITER and future reactors, they could carry enough energy to damage the wall in the divertor region (where most of the energy comes out). There has been rapid progress lately (past 15 years) in ways to control these ELMs by making them more rapid and smaller, such as using resonant magnetic perturbation (RMP) coils to distort the shape of the confining magnetic field, or ‘pellet pacing’ (firing small pellets of deuterium fuel into the machine 50–60 times per second, which triggers an ELM), or vertical ‘kicks’ in which the control system suddenly jogs the plasma position a few centimeters vertically, also triggering an ELM. Between these techniques and the recently discovered I-mode (which doesn’t have ELMs), this is a problem that is well on the way to being solved.
7) High-Z walls –
This is a particular point of pride for Alcator C-Mod. Running a tokamak with walls made of refractory metals has many advantages because of the extreme capacity of these materials to absorb heat loads, but there are disadvantages as well, such as how radiative these high atomic number elements are if they get into the plasma as impurities, or how metallic materials distort when they melt, rather than ablating like carbon-fiber composites. Alcator C-Mod (which has a molybdenum wall) and other tokamaks have recently shown that it is possible to reliably run a tokamak with high-Z refractory metal walls, which will almost certainly be a feature of future reactors.
2. Power Loss Scenario in Alcator C-Mod?
by eldavojohn
Not to raise any fears -- rather out of genuine curiosity -- what happens when the magnetic fields that hold the 90,000,000 degrees Celsius plasma in place fail or loser power on the Alcator C-Mod? I understand it's probably in prototype mode, but what sort of safety advantages or disadvantages do Alcator C-Mod designs offer over conventional, large-scale designs? Does the plasma come into contact with the toroidal superconducting coil? Then what?
Geoff Olynyk answers: Actually, that’s exactly what my research is on! The event you describe is called a "disruption." Holding a hot plasma stationary using magnetic fields without it ever touching material surfaces is very difficult – Richard Feynman once compared it to trying to "hold Jello with rubber bands." For any number of reasons, like a magnetic coil losing power, the control system not being able to juggle the plasma position quickly enough, or the plasma hitting a stability limit (pressure or density goes too high), it’s possible for the plasma to hit the wall. The most important thing to know, though, is that when this occurs (and it does, frequently, in today’s experiments – although it’ll have to be a very rare occurrence in a real power reactor so it produces uninterrupted electricity), it is no risk to the environment or to safety.
To understand what happens, you have to realize that the plasma is very, very light. In the Alcator C-Mod tokamak, it has a mass of only about 0.001 grams – about one- fiftieth as much as the smallest drop of water you can get from an eyedropper. (This is with a plasma volume of about a cubic meter – a fusion plasma is actually a pretty good vacuum!) So even though it’s very hot, it doesn’t actually have a lot of thermal stored energy to flow into the wall if confinement is suddenly lost. There is actually more energy stored in the current flowing in the plasma (in C-Mod, about a million amperes), which also gets deposited on the wall. In C-Mod, thermal stored energy is about 50– 150 kJ and magnetic stored energy is almost 1000 kJ. The problem is that as we go to larger machines (like ITER, or a reactor), the amount of stored energy in the plasma scales like the cube of the size, and the wall area only scales like the square of the size. So the energy deposited per square meter of wall area gets worse (larger) as we go up in machine size.
The plasma doesn’t hit the superconducting coils - it hits (really, deposits its energy on) the “first wall” of the chamber closest to the plasma. So, we do two things to make sure that the walls can survive these disruption events. The first is making them out of materials that can take a blast of heat, like tungsten, or else materials that ablate away rather than melting, like carbon fiber composites. The second is to develop “disruption mitigation” systems which can cause the plasma to radiate all its energy evenly over the entire wall surface, spreading the heat out and lessening the chance of causing localized melting. But I want to stress again - disruptions are an operational problem, meaning they might cause a power plant to be offline for a while, but they’re not a safety problem. There is no chance of a runaway reaction or meltdown in a fusion reactor.
3. Ubiquitous Fusion Power
by monsted
When will fusion power my house (or vehicle)?
MIT Researchers: This is obviously an impossible question to answer, but we can give some thoughts about when it might happen, and why. First, the current official plan is that ITER will demonstrate net fusion gain (Q = 10, that is, ten times more fusion power out than heating power put in) in about 2028 or 2029. (Construction will be done by about 2022 but there’s a six-year shakedown process of steadily increasing the power and learning how to run the machine before the full-power fusion shots.) At that point, designs can begin for a “DEMO”, which is the fusion community’s term for a demonstration power plant. That would come online around 2040 (and would putt watts on the grid, although probably at an economic loss at first), and would be followed by (profitable, economic) commercial plants around 2050.
This seems like a long time, and it is, but it’s important to understand that this is not the only possible path. You might say that we’re not a certain number of years away from a working fusion power plant, but rather about $80-billion away (in worldwide funding). We’ll get into this more in response to one of the other questions, but there are other experiments that could be done in parallel with ITER that would certainly speed up the goal of a demonstration power plant, if there were the money for it. Here is a graph based on a 1976 ERDA (predecessor to today’s DOE) fusion development plan, showing their four paths to a reactor, as well as a business-as-usual funding case that would never lead to a reactor, and in black is the actual funding amounts. (All values are adjusted to 2012 dollars.)In the U.S. at least, fusion funding hasn’t been anywhere close to what would be required for a “crash program” to get to a reactor. If it were, it would probably be possible to have a demonstration reactor in about twenty years. (This is not actually that long - given that it takes almost a decade to build a large fission reactor or hydroelectric dam!)
Fusion has a reputation of “always being thirty years away” (or fifty, or twenty). We want to address that head-on here: aside from a few over-optimistic predictions made in the very early days of magnetic fusion research (the 1950s), this reputation is undeserved. The reason it has taken so long to get to breakeven (ITER) is because since the end of the 1970s, funding for fusion research has been continually slashed, up to today, when the U.S. is proposing shuttering one of three remaining tokamak experiments, the Alcator C-Mod device at MIT that we all work on. Despite this, progress has been continuous. But if we had the money, we would be getting there quicker.
4. What are the economic numbers for a successful, commercial reactor?
by kestasjk
I know that the economics of larger reactor = more economical are well known with tokamaks. Does this mean you have a good idea of the minimum cost / generating capacity of the first commercial reactors? If so, what do those numbers look like?
7. Lower Limit on Tokamak Design
by gyepi
Are there any good guesstimates on how small a tokamak-based fusion reactor (which produces more energy than it consumes) can become? Theoretical limitations on the size of the reactor would have obvious implications for pragmatic issues.
MIT Researchers: Questions 4 and 7 are similar and we answer them together here.
The current thinking is that a tokamak fusion reactor will be about 1 gigawatt electrical, and about 2–3.5 gigawatts thermal (depending on how high-temperature the blanket is and thus how thermally efficient it can be). This is about the size of a current fission reactor or large coal-fired power plant.
Fusion researchers are working on smaller designs, though! At MIT, some students are working on a concept for a 350–500 MW (thermal) class fusion reactor, which would be cheaper to field and thus more likely to be built by private industry with limited access to capital. This is still early work, though, and the economic analysis is not done yet.
Cost estimates for a new technology like fusion cannot be terribly reliable, but several studies suggest that, with suitable developments in science and technology, the costs could be competitive with other methods of electricity generation. We recommend you read the ARIES-AT study (google it), which goes through all the factors that go into the cost of electricity (COE) for a fusion reactor, and compares their concept to other electricity generation options (fission, fossil fuels, etc.) A key advantage of fusion is in what economists call "external costs." These are costs borne by society as a whole and not by the generating industry. Environmental pollution, nuclear proliferation, and military operations to protect oil supplies are all examples of external costs for energy.
5. What Problems are Holding Back Successful Reactions?
by Bucc5062
Can you explain to a non-scientist what the biggest stumbling blocks are for an effective fusion reaction? Is it truly a matter of throwing money down an energy hole, or are there verifiable, measurable benchmarks that lead us from one step to the next? I.e. we’ve achieved X, now we need Y; when we get Y, we get Z and then achieve fusion. Is it the technology holding us back, the politics, or the science?
MIT Researchers: We know exactly what we need to do. Not everything has a solution yet – that’s why it’s still a research project! – but we generally know what the big challenges are to get to a working magnetic fusion reactor. Here is a non-exhaustive list:- 1 – Non-inductive current drive. We can’t rely on inductors to drive the plasma current since they are inherently pulsed (not steady-state). We think that lower hybrid current drive might be the solution, and are actively researching this on Alcator C-Mod.
- 2 – Confining a 'burning plasma.' This is the big question that ITER will resolve – can we really confine a plasma that is dominantly self-heated – that is, most of its energy comes from fusion reactions rather than external heating. Will new instabilities appear? Or can we confine the plasma as we expect we can.
- 3 – Confining a steady-state burning plasma while avoiding off-normal events. We have to do both of the previous points at the same time! And we can’t have disruptions too often or else the power plant won’t have a high enough duty factor. The goal is to have disruptions (which require a shutdown) occur less than once per year.
- 4 – Validated predictive capability for fusion-grade plasmas. We have made great progress in this field already (see our answer to an earlier question), but it’s not at the point yet that, say, fluid mechanics codes are, where Boeing can design an entire plane in the computer before ever building a scale model. We need our models of fusion plasma behavior to be accurate and reliable enough to design first-of-a-kind machines that we are 100% sure will work the way we think they will.
- 5 – Diagnosing a burning plasma. It’s really hard to tell any of the properties of the plasma even today, when we use pure deuterium fuel (instead of ‘live’ deuterium–tritium fuel), and our plasmas are colder than they would be in a reactor! You can’t, for example, stick a thermometer in to tell the temperature! We have to use subtle effects like bouncing a laser beam off the electrons and telling the temperature from the Doppler shift of the laser from the moving electrons (a technique known as Thomson scattering). Making these diagnostics work in the reactor environment, with higher plasma temperatures and a ferocious flux of neutrons coming out, is a great challenge.
- 6 – Better understanding of plasma–wall interactions. The plasma is confined by magnetic fields, and ideally doesn’t touch the wall at all, except in a very small area called the divertor. This means that the material challenges in the divertor are severe – we have to figure out a way to operate the plasma so that it’s hot in the center, but cold near the divertor, so that it doesn’t erode the wall too fast. This will be a limiting factor on how long you can run a fusion power plant for before you have to shut it down in order to do maintenance. Ideally, we’d want this to be every 2 years or so, like fission power plants today.
- 7 – Materials for plasma-facing components. We need to develop new materials that can withstand the high temperatures of the wall of a fusion reactor while resisting neutron damage and not becoming too activated by the neutrons that will pass through them. (There is some progress on this front with ferritic steels and silicon carbide.)
- 8 – Magnets that meet the plasma physics requirements and allow reactor maintainability at reasonable costs. (Some of us are working on demountable superconducting coil concepts that may eventually be the solution to this!)
- 9 – Design and materials for tritium fuel cycle and power extraction. Fusion reactors will breed their own tritium fuel from deuterium – this process has to be experimentally tested on a large scale (which will obviously require a burning plasma tokamak).
- 10 – Reliability, availability, maintainability, and inspectability (RAMI) of the reactor designs. We have to show that our concepts for reactors really are as good as we think they can be.
The point is that it’s not a money pit. There are unsolved challenges, but we know what they are, and with adequate support, these challenges will be overcome. This is why we are urging everyone to go to fusionfuture.org and write Congress asking them to keep supporting U.S. fusion research! (It’s very easy – there’s a link at the right on the website.)
6. NIMBY
by GeneralTurgidson
How do you explain the safety/benefits of fusion to a generation of people terrified of nuclear anything?
MIT Researchers:This is where fusion really shines. The two big problems (at least, perceived problems) of fission reactors are the risk of a meltdown, and what you do with the high-level radioactive waste. Fusion has neither of these issues!
Regarding the first, the reason why a worst-case accident in a fission reactor can be so devastating is because there is a lot of fuel in the reactor at any one time. There are well known accidents at Chernobyl (where the reaction ‘ran away’, making more power than the reactor was designed to handle) and Fukushima, where the fission chain reaction was safely shut down, but the cores melted down when the tsunami knocked out the cooling systems, due to ‘decay heat’ which is produced by the used fuel even after shutdown.
In a fusion reactor, it’s a completely different story. There will be less than a gram of fuel in a reactor at any one time—fresh deuterium–tritium fuel is continually added as it is burned—and so a runaway reaction is simply not possible. Decay heat isn’t a problem in a pure fusion system, again because there just isn’t any fuel sitting there undergoing nuclear reactions once the reactor is shut down. In general, this is one area where it’s a benefit that a fusion reaction is so hard to sustain! We have to try really hard to keep the plasma hot enough to undergo fusion in the first place, so if we just turn off the heating and fuelling systems, the fusion reaction will shut down very quickly.
As for the second benefit of fusion (waste), the reaction is completely different from that in a fission reactor. In fission, uranium (or other heavy elements like plutonium) split into pieces, producing hundreds of different isotopes, some of which are radioactive, with half-lives ranging from fractions of a second to millions of years. In fusion, the reaction is simple, deuterium + tritium helium + neutron. So there is no “waste” from the unburned fuel – any tritium that isn’t burned gets pumped out of the chamber and recirculated back in.
This is not to say that there will be no radioactive waste from a fusion plant. The reactor vessel itself will become activated because of the flux of neutrons passing through it, and will have to be treated accordingly when the plant is decommissioned (after, say, a 50-year operational period). But it’s important to note that this kind of radioactive waste is of a much lower level – it won’t have to be stored for very long before it will be “cool” enough to simply bury in the ground safely. And there is active research going on into new materials for fusion reactors that are more resistant to activation by neutrons, such as ferritic steel and silicon carbide.
Finally, fusion has great advantages for nuclear non-proliferation. Creating enough fission power plants to avoid climate change would mean that the plutonium moving around the world would be enough to create about 100,000 nuclear weapons. For fusion, it is much more difficult to use a reactor to make fuel for weapons. This is also something that we think a nuclear-skeptical public will appreciate about fusion power.
All of us are strong supporters of fission power, and we agree that at times, the nuclear power industry has not received a fair shake when compared to other sources of energy. But we think that the advantages of fusion power speak for themselves, and the public will be able to understand the risks and will support the construction of these plants. Obviously, having media that are able to explain things clearly and fairly are a necessity.
8. What do the numbers really look like?
by Erich
ITER is a hugely expensive project, and won't produce a commercially viable power generation system. In a lot of areas where research is done on things which don't work yet -- rockets, bridges, transmission systems, etc -- there's a general idea of how things might be able to "scale up" to meet the goals. Is tokamak fusion really in sight of being a commercially viable source of energy? If we need unobtanium to make a commercially viable reactor, wouldn't it make sense to wait until the materials are viable before making even larger tokamaks? Or is it still worth learning from these new, bigger, more expensive reactors?
MIT Researchers: You are exactly correct in your statement; ITER is an expensive project which will not produce electricity upon completion. However, ITER’s main purpose is not to put watts on the grid, but to demonstrate the scientific feasibility of fusion by creating a Q=10 plasma (10 times as much energy out as we put in). We do have a good idea of how to proceed with devices following ITER, namely DEMO, a full demonstration fusion power plant which will use the steam cycle to generate electricity from the fusion reactor. The basic layout of a reactor can be found here: http://www.fusionfuture.org/what-is-alcator- c-mod/c-mod-for-energy/
Although there is still plenty of research which remains, fusion is in sight of being a commercially viable energy source. We believe that we now understand the physics well enough to create the appropriate plasma conditions (this will be demonstrated on ITER) and we are working on the engineering challenges that lay between us and a commercial fusion reactor.
It is obviously impossible to predict when fusion will put power on the grid since the estimate can change drastically based on demand and overall funding levels. You are however, correct in noting that some of the biggest challenges involve the discovery/ development of materials which can resist the unique and harsh conditions associated with fusion reactors, namely, high heat and neutron fluxes. Due to its importance to the success of future devices, this is a very active and important area of research.
The international fusion community is attempting to address these issues in the following manner: Given the scope of the ITER project and the time required to build and test it, we are planning on constructing a materials testing facility named, IFMIF which stands for International Fusion Materials Irradiation Facility. This facility should be operated at the same time as ITER and will be addressing the materials issues associated with an eventual fusion power plant while ITER is demonstrated the scientific feasibility of a fusion reactor.
Given the time-scales for reactor construction, we think it would be unwise to wait for this materials testing to be complete before starting new machine construction. Addressing the remaining problems in parallel will most likely result in the quickest path to fusion energy.
9. Careers in Fusion?
by benjfowler
As practicing researchers, can you tell us about the health of the pipeline of young researchers coming into the field? Is there a glut of trained physicists at this stage, or is there still a need for trained specialists to enter the field, especially with ITER and follow-on machines coming online in the next couple of decades?
Nathan Howard answers: At this point in time fusion is actually a pretty healthy field in terms of young researchers and with emergence of the next generation devices such as ITER, there should be an influx of researchers stepping up to meet the need for trained specialists on these next gen devices. Currently in Europe and Asia, emphasis on fusion research is ramping up to support the research needs. These newly trained researchers are going to be the scientists working on ITER in 10-15 years.
Unfortunately, the US fusion program is in danger of going the opposite direction of the Asian and European programs. The current proposals made by the US are threatening the health of fusion in the US. The President’s 2013 budget proposal calls for drastic cuts to the domestic fusion budget to pay for increased funding for the ITER budget. However, if these cuts continue, there will not be a field for the young researchers to enter and the US fusion program is in danger of dissolving before ITER comes online.
This does not mean that a need for trained specialist will not remain, it just means that the young researchers in Europe and Asia will be filling these positions. Dr. Stewart Prager, the head of Princeton Plasma Physics Lab said it best, “We have a clear choice before us: The United States can either design and build fusion energy plants or we can buy them from Asia or Europe.”
As a young researcher myself, I am particularly affected by the choices that the US is currently making. Myself and other graduate students have been urging others who support fusion research to contact congress and tell them to continue to fund domestic fusion research. We put together a website, www.fusionfuture.org, which provides more information and people the ability to quickly and easily contact their congressmen to tell them to support research. Please support US fusion research and check out the site.
12. Patents?
by Anonymous Coward
Will patents get in the way of your research?
MIT Researchers: In general, we find that the tokamak labs of the world are extremely cooperative; patents have never been a problem. It does seem likely that the technologies supporting power plants will be highly patentable, but the sort of scientific knowledge we’re accumulating at present really isn’t. At some point, we expect to move from a collaborative to a competitive phase – but we’re not there yet.
11. What level of investment would get fusion going?
by Tragek
Do you think a program the size of the Apollo program could kickstart fusion to general availability? Or would a smaller program suffice?
14. What could you do with unlimited resources?
by petes_PoV
Given $1 trillion, the pick of the best brains in the world to work willingly on the project, a large enough location away from any and all governmental regulation and every facility you could ever need - when would fusion be commercially viable?
MIT Researchers: Questions 11 and 14 are similar and we have answered them together.
Any kind of question asking about a hypothetical massive increase in funding is tricky to answer. We probably couldn’t even spend a trillion dollars if we wanted to – just because it would take a long time to get enough people trained in plasma physics and fusion energy.
We can say this: an increase in funding would allow for different paths to be tried in parallel, like stellarators, tokamaks (ITER), spherical tokamaks, etc. Plus, we could build a facility in the United States to study the problem of plasma–wall interactions, which is a very important topic that has not been adequately studied up to this point (see our answer above about what steps are needed to get to a reactor).
We think that we’re roughly $80-billion away from a reactor. At current levels of funding (worldwide), that’s about 40 years. Even given access to huge amounts of money, it’s unlikely that a working reactor could be built in less than a decade – there are just too many facilities to build between current devices and a full-scale reactor in order to ensure success. But we could certainly do it faster than 40 years!
We want to note that “crash” programs like Apollo or the Manhattan Project succeeded because they took risks – they started work on building their systems before they had done all the homework. That is inherently risky, but these risks are mitigated by pursuing alternatives in parallel. Something similar could be done in fusion, given the money.
15. Your favorite books?
by eldavojohn
I'm not a physicist (software guy), but I've taken a few physics classes. At an early age I found a tattered copy of George Gamow's One Two Three . . . Infinity, which, although incorrect in some parts (I guess that's why they revised it and that's why 'speculations' was in the title), was perfectly written for my then-fifth-grade mind. It set me on a path toward science, and a few weeks ago I saw the same 1960s Viking Press edition and flipped through it, noticing what was slightly off and remembering it. I've since grown to love other obvious books by authors like Hawking, Penrose, Hofstadter, etc. So, quite simply, what are your favorite books for all minds, young and old? Also, can you annotate which are written for the layman's entry into the given field and which are written to encompass the field for the researcher? I find that some books start off with the jargon so strong and the references and footnotes so thick that you start to have to re-read every paragraph, as they're clearly condensing entire historic papers into lengthy sentences. Any fiction books worthy of influencing your work and desires?
Ian Hutchinson: My all time favorite novel is Godric by Fredrick Buechner. It's a wonderful first-person portrait of the prior life of a medieval hermit. My favorite physics teaching text is the Feynman Lectures on Physics, which comes from a remarkable effort by the most widely acclaimed american physicist of the 20th century to explain really advanced physics to undergraduates.
I really don't enjoy the genre of books that combine science popularization with metaphysical speculation. They are of course quite popular, but most are philosophically naive in a way that I find annoying.
Anne White: I like detective/adventure stories. I also enjoy reading plays, poetry and short stories – some authors I read over and over are Wolfgang Borchert, Julio Cortazar, Ray Bradbury and Samuel Beckett.
Recently, I've enjoyed reading The End of the Affair by Graham Greene, People of the Book by Geraldine Brooks, Jane Eyre by Charlotte Bronte and Her Fearful Symmetry by Audrey Niffenegger.
Influential books/stories that I remember reading when I was young : The Pearl (John Steinbeck), Catch-22 (Joseph Heller), Flatland, and Ender's Game.
Dennis Whyte:- For science non-fiction books, it’s a tie: The Selfish Gene by Richard Dawkins, and Wonderful Life by Stephen Jay Gould.
- Novel (in general subject area of science): The Baroque Cycle by Neal Stephenson
- Speculative fiction: Starship Troopers by Robert Heinlein
Geoff Olynyk: The Making of the Atomic Bomb by Richard Rhodes is the best non-fiction book I’ve ever read. It’s a bit long, but is a fascinating, well-written exploration of the project to develop the atom bomb (both in the U.S. and elsewhere).
This is not a science book, but The Rebel Sell by Joseph Heath and Andrew Potter (sold in the United States as Nation of Rebels) changed my life. I was into counterculture, "culture jamming," anti-advertising, that kind of stuff, and this book made me seriously reconsider all of it. I now understand that trying to be unique is futile in a world of seven billion, and I should just try to be a good person and do good for the world (hence working on fusion!) Potter’s follow-up The Authenticity Hoax, explores the search for authenticity in more detail, but it’s not nearly as good of a book as Rebel Sell.
Nathan Howard: I first became interested in physics by reading about astrophysics. I was specifically interested in black holes and so one of the first books I read (after some of the popular books by Hawking which are written for general audiences, e.g. A Brief History of Time) was a book by Kip S. Thorne called Black Holes and Time Warps. I really enjoyed this book. It did not require much technical background, just some basic mathematics, and it gave good explanations of black holes, relativity, and gravitational waves.
16. Why is fusion more useful than exploiting thorium?
by gestalt_n_pepper
I understand that in the long term, we would want fusion. But we face increasing energy problems over the next 50 years and severe energy problems before 2100. Wouldn't it make sense to allocate research and development resources to something that we know works?
MIT Researchers: First of all, fusion will be putting watts on the grid before 2100. It’s not going to be tomorrow, but it’s not going to be a hundred years, either.
We know how to build thorium fission reactors. It's been done. They have none of the major attractions of a fusion reactor in terms of safety, fuel resources, reduced waste, or non-proliferation. Worldwide thorium fuel resources are about the same as those of uranium. Thorium reactors might become part of the commercial fission reactor mix in the future, but they don't offer transformative possibilities for nuclear power the way fusion does.
That said, we think that the that the scale of the energy/climate problem demands that we (meaning: government and private industry where appropriate) pursue multiple lines of development into new energy sources. Obviously nobody wants to waste taxpayer money, so all proposals have to be evaluated for chance of success – but today, it’s limited by funding more than by a lack of good ideas. This shouldn’t be the case.
The key thing we want to get across is that it shouldn’t be a contest between “fund fusion” or “fund thorium research”. Fusion is extremely important for humankind and should be funded – if thorium fission also has promise, it should be funded too.
17. How is fusion power harnessed?
by circletimessquare
The talk is always about reaching break-even with fusion. What about capturing the power? Are we generating heat that will drive steam turbines? What schemes exist for capture and harnessing the power generated by fusion?
MIT Researchers: In a magnetic fusion reactor, each deuterium-tritium fusion produces a 3.5 MeV (mega- electronvolt) alpha particle (helium nucleus) which deposits its energy in the plasma (this self-heating is how you can have an ‘ignited’ plasma which doesn’t require much or any external heating), and a 14.1 MeV neutron, which deposits its energy in a thick lithium blanket surrounding the toroidal reaction chamber. But in the end, all of it comes out as heat!
For a conservative fusion reactor design, this heat would be removed by a primary cooling loop (high-pressure steam or some sort of liquid metal) which would give the heat to a secondary steam loop (Rankine cycle) in a heat exchanger (steam generator). The steam would then turn a turbine, producing electricity, just like in a fission or coal power plant.
Of course, with a thermal process like a steam cycle, one is always limited by the Carnot efficiency, which increases as the temperature of the high-temperature reservoir goes up. So there are also designs to use a very high-temperature (800–1000 C) gas cooling loop and a Brayton cycle.
But the short answer is: the alpha power is captured by the plasma, and the neutron power is captured by the blanket. It all comes out as heat, which is used to heat a working fluid, which turns a turbine, producing electricity. This is not expected to be a technological problem – the challenge is in getting a confined thermonuclear plasma to produce the fusion energy in the first place!
19. Fusion Milestone Prizes?
by Baldrson
In 1992, with the assistance of fusion technologists such as Robert W. Bussard, I developed legislative language for a series of 12 milestones, each of which would be awarded a $(1992)100M prize for the achievement of objectives toward the attainment of practical fusion energy. This legislation also provided a grace period during which scientists and technologists that had been working on the US fusion program would be provided full salaries, without obligation, during which time they could seek support for their ideas to achieve these milestones. This legislation presaged a number of other prizes including the X-Prize and BAFAR / CATS prize. In 1995, Robert W. Bussard submitted this legislation to all relevant Congressional committees, copying all US plasma physics laboratories. Needless to say, the legislation wasn't passed. Do you think the time is right?
MIT Researchers: We think that the current approach, in which government-funded labs are not in direct competition, but have to justify their funding to the agency (in our case, the DOE), is the best option for the moment. Perhaps the X-PRIZE approach might work for the alternative concepts? (see our answer below regarding Polywell/Dense Plasma Focus/ IEC etc.)
20. ITER
by MpVpRb
Is the ITER project good science? Or is it a politically-motivated, pork-laden boondoggle?
MIT Researchers: ITER is absolutely good science. Governments representing over half the population of the world are backing the project because it is the logical next step – a prototype reactor that will produce ten times more fusion energy than heating power put in, for a few minutes at a time. It is also pushing forward the development of fusion reactor technology (materials, control systems, remote handling systems, etc.). The U.S. fusion community endorsed ITER as the best option for a next-step experiment at the Snowmass II conference in 2002 (see proceedings here).
All of that said, the cost of ITER has risen substantially from the original estimates, and because overall magnetic fusion funding has remained nearly flat in the United States, the U.S. contribution to ITER is threatening to swallow up the entire domestic program. This is starting with the planned closure of Alcator C-Mod in September 2012, but unless more money is allocated to fusion research, all three U.S. tokamak facilities are at risk in the next few years.
Graduate students at Alcator C-Mod have put together a web page explaining the problem: http://www.fusionfuture.org/faq/the-fusion-budget-problem/ and we urge you to go to this website and click the link to contact your member of Congress and urge them to fully fund a strong domestic program and the U.S. contribution to ITER!
21. NIF
by Grond
Is the NIF approach even plausibly capable of generating electricity in a useful way? Or is it purely a research platform / smokescreen for nuclear weapons research?
MIT Researchers: The primary mission of the National Ignition Facility (NIF) is "stockpile stewardship." That is, to ensure that U.S. nuclear weapons continue to be a credible deterrent. This is why NIF is funded by the National Nuclear Security Agency (the agency in charge of the nation’s nuclear stockpile), not the DOE Fusion Energy Sciences program. Thus, the weapons research mission of NIF is not a smokescreen, but is actually the publicly acknowledged primary objective for the facility.
Some researchers at NIF believe that their inertial fusion approach can be used for an energy source as well. We don’t want to speculate here on the plausibility of the LIFE (Laser Inertial Fusion Energy) concept. There is a National Academy of Science review of the prospects of inertial fusion energy under way right now; the final report is expected to be published before the end of this year.
18. Dense Plasma Focus
by mbradmoody
Do you see any merit in the "dense plasma focus" approach to commercial fusion power production, specifically the work of the Lawrenceville Plasma Physics group?
22. Focus Fusion / aneutronic fusion?
by mwk88
Focus Fusion Society is posting research on their project to do aneutronic (e.g. Proton Boron (pB11)) fusion. The concept sounds great, and as an engineer, I find several parts of their design, such as direct extraction of electric power, to be elegant. Is this credible research or pie-in-the-sky? I have not seen much mention of them in mainstream fusion research.
23. Polywell Fusion
by mknewman
What do you think of the efforts at EMC2 Fusion and Polywell Fusion? They seem to be making real, measurable, and open results, but the mainstream physics community seems to ignore this progress.
24. What’s wrong with IECs / Fusor?
by claytongulick
Why aren't IEC reactors based on Farnsworth's designs taken more seriously? From what I understand, IECs have been more effective at producing fusion, and they are cheap to build. People even build them in the garage. From everything I've read, no one really takes the "fusor" seriously in the fusion science realm, and it's considered a dead line of inquiry. I've never understood why.
MIT Researchers: These four questions (18, 22–24) are answered together here.
None of us are experts on inertial electrostatic confinement, magnetized target fusion / dense plasma focus, or Polywells, and so we don’t want to say too much about the specifics of those designs. We can say the following:
1. The amount of money that is being spent, especially in the United States, on fusion is far lower than the field deserves, given its track record and potential. This sounds self-serving, but we think it’s justifiable based on the facts. The graph we posted above shows how the fusion budget is far lower today than it was thirty years ago, even as we continue to make steady progress toward a reactor and the seriousness of the coupled energy/climate problem becomes more obvious.
The alternate confinement concepts program has also seen cuts. (“Alternative” in DOE Fusion Energy Sciences parlance means, basically, anything that isn’t tokamaks, stellarators, or laser [inertial] fusion.) The Levitated Dipole Experiment, an innovative magnetic-confinement arrangement based on planetary magnetic fields, was cancelled just as they were about to add significant auxiliary heating for the first time. And these small-scale alternative confinement projects are not very expensive! Some of these alternative concepts may very well be promising and deserve taxpayer money to be developed.
2. But on the other hand, these groups need to show that they deserve funding. It’s not enough to just tease these promising results and be secretive about the methods or technologies. Public funding can only come when the details are published in the open literature, and subjected to the scrutiny of peer review and the wider community reading the papers. The (hot) fusion community is still living with the aftermath of the cold fusion scandal from a quarter century ago - so it’s very important for the proponents of these alternate concepts to push the researchers to publish their results in peer-reviewed journals. Whatever negatives the tokamak might have, one thing you can’t say about it is that the research has been too secretive, and this has allowed the funding agencies to make the judgement that the tokamak is currently the most promising route to a fusion reactor, which is why this line of research gets the most money.Special thanks to Dr. Martin Greenwald, Prof. Ian Hutchinson, Asst. Prof. Anne White, Prof. Dennis Whyte, Nathan Howard, and Geoff Olynyk for taking the time to answer our questions.
-
Delayed Outrage Over A Censored Site; What's a Better Way To Spread News?
Bennett Haselton is back with a thought provoking essay about not just an incident of Internet censorship on an American university campus, but a proposed method of propagating news, so that relevant stories aren't buried as easily by chance or time. Bennett writes: "The real scandal in the story of Arizona State University blocking students' access to the Change.org website, is not just that it happened, but that the block persisted for two months without being mentioned in the media. As a card-carrying member of the 'outrage grapevine,' I surely think we need a way to respond faster." Read on for the rest.This is a tale of censorship. From about December 7th until February 3rd, Arizona State University was blocking all users of its network from accessing the Change.org website, where users can create petitions and circulate them for other users to sign. (The lame excuse offered by the university was that a student had created a petition and was using the change.org site to "spam" other ASU accounts; of course, even if that had been the real reason, it would have easily been possible for ASU to block mail from the change.org servers, without blocking all students from accessing the website.) On February 3rd, after a furor of sudden media attention, the block was lifted.
But that's not the worst instance of censorship in this story. What's more disconcerting is that for the two months that the block was in place, the university's decision to block the website received no media coverage at all. This despite the fact that it was a political website being blocked, at a university with over 70,000 students — a publicly funded university, where a court would have almost certainly found that the blocking violated the First Amendment, had the case ever gone to trial.
I first heard about the original tumblr blog post describing the blocking situation, when someone posted the link on my Facebook wall. So as I went to my profile to read it, I was already predisposed to be pissed off, since almost every link that someone posts on my wall is either an outright scam, or a one-sided rant about an issue that is actually much more complicated than the author thinks it is. Well, it was a one-sided rant, all right, but it was about an issue where there was really only one side: ASU evidently got annoyed about a petition on change.org protesting tuition hikes, so they blocked the site. As I re-read the post, I kept thinking: How can this be true, if we haven't heard about it anywhere else? Perhaps an overzealous ASU network admin put the block in place, and it was reversed just a few hours later, but the tumblr post never got updated? I emailed the blog post's author, Eric Haywood, and the owners of change.org, asking how long the block had lasted before the site was un-blocked — I just assumed that the block couldn't possibly still be in place, two months later. But they confirmed that it was.
The link got blogged and re-blogged around tumblr a few times in December and January, and then, at about the same time as I was sending my emails, the issue suddenly "tipped" into public awareness as it was linked from a widely-read reddit post. Then the blocking received its first official "media" coverage in an article in the ASU student newspaper, the State Press. (Eric Haywood called the article "just ASU spreading it's own propaganda about this issue (they own, run and control the State Press)". I don't know about propaganda, but it did seem a little amateurish — the article says "The author of the original blog post is unknown", even though the guy's name, Eric Haywood, was listed in the post, along with his email address.) Then finally the story spilled over into the "real" media with an article in the Huffington Post, in which the author pointed out that the blocking likely violated the First Amendment. (A few hours after that article appeared, the university unblocked the site so that ASU students could access Change.org on their network again.)
None of the articles commented, however, on how the issue had remained buried for so long; the State Press article said only that the tumblr blog "began circulating the Internet Thursday." A reader could be forgiven for reading the articles and scratching their head and thinking: What is it that just happened? If the site has been blocked for two months, why is this only being written about now?
The answer, I think, is that most people don't realize how arbitrary the process is that determines what issues get news coverage and which ones don't. Before I got involved in a few issues that did receive media coverage (in my late teens, through Peacefire and in co-operative projects with others), I had just assumed that "the news" consisted of all stories that somebody in the media business considered to be "news-worthy." Some journalists just want to sell papers (or attract page-views), while other (better) journalists strive to tell the most important stories — but either way, surely their decision to cover something, or not, should depend on attributes of the story, right? Not on whatever else happened to be going on, or other random circumstances? But then, when I started to be involved in efforts to actually get media coverage for this or that issue, some issues ended up receiving far more coverage than even I thought they really deserved, and others received far less.
Sometimes reporters would frankly admit that they thought something was a good story, but they couldn't cover it because their plate was full that day, and even if they had time later, by that time the issue would be too "cold." Some years ago, I wrote in Slashdot about an experiment in which I sued some spammers in Small Claims court, and filed the court briefs with some of the pages stuck together with a sliver of paper. When the judges rejected the motions (as I expected, since Small Claims judges have been near-uniformly hostile to spam suits), I went to the courthouse to look at the files and found the pages still attached, indicating that the judges had rejected the motions without reading them. What I didn't mention in the original article, was that I had planned at first to give the exclusive story to a Seattle Times reporter, who came down to the courthouse to see the files and interviewed me afterwards. The paper must have thought there was a real story there, since they later sent a photographer to come down and take pictures of the files as well. But then something else landed on the reporter's desk and pushed the story back a few days, and days became weeks, and then the beat switched to a different reporter. When I eventually called to ask if they were still interested, they replied, essentially, that without a current "hook", they couldn't write the story, because now it would look like they weren't doing their jobs for the long intervening period when they didn't write about it, so it was better now to drop it entirely.
Traditional media seems hamstrung by two limitations here: (1) an inefficiency at finding the most important stories that most "deserve" to be written about; and (2) a convention that you can't cover something that's more than a few days old, because then the story looks "dated." The Internet doesn't seem to suffer from limitation #2, as demonstrated by the fact that the blocking of change.org at ASU on December 7th was still able to ignite a controversy on February 3rd. But it does still suffer from limitation #1, as illustrated by the Internet's near-total silence on the issue from December 7th through February 2nd.
Many other people have a pet issue that they think is being "suppressed" by the "liberal media" or the "corporate-owned media" (depending on which side they're on), but the evidence suggests that no conspiracy is necessary to keep an important story from being written about. Sometimes arbitrariness and chance is enough.
My naive earlier assumption — that stories received media coverage because of some combination of attributes of those stories — seems to be a specific instance of a cognitive fallacy, where if you observe that some group of things achieved some end result Z, and all of those things started out possessing some attribute X, then you think that attribute X caused the achievement of result Z. In this case, because we observe that most stories which receive news coverage are important and interesting (with obvious exceptions), we assume that most interesting and important news stories will receive news coverage. Thus, it's frustrating and counterintuitive when we find out about an issue that cries out to be written about, but was ignored by the media. The truth is more likely to be that for every important and interesting story that gets coverage, there are likely to be many other equally important and interesting stories that never make it into the news.
(By the way, I've been unable to find a precise name for the cognitive fallacy wherein if you observe that all things which achieve goal Z have attribute X, then you come to think that attribute X is a good predictor of achieving goal Z. It's not the same as the "post hoc fallacy" or the mistaken belief that "correlation equals causation," because both of those are about the illusion of causation. I'm talking about the correlation being an illusion in the first place — where people come to believe that attribute X is a good predictor of achieving result Z, ignoring the fact that there may be enormous numbers of cases where attribute X is true, but which never go on to achieve result Z. If you know the exact name of that fallacy, shoot me an email and submit a comment below.)
In an earlier article, I proposed a system that would eliminate the arbitrariness in determining which pieces of content are selected to be "the best" and broadcast to a larger audience. I suggested using the algorithm to determine which songs could be pushed out to listeners of a streaming music system, but it could be modified to select which news stories would be considered "important" enough to push out to readers of a news site. (The gist of the idea is that you have each piece of content rated by a random sample of users chosen from the system, and if their average rating is high enough, it gets pushed out to everyone else. If the random sample size is large enough, their average rating will be non-arbitrary, and will be determined by the attributes of the content itself.)
Maybe that algorithm is flawed or maybe someone could find a better one, but the more important thing to realize is that we don't live in that world now, where the attention given to an event is determined by attributes of that event. In the world we actually live in, it's safe to assume that many events take place every day that would have been covered by the news, if it hadn't been for a reporter's missed phone call or some other random happenstance. I have no doubt that the blocking of Change.org on ASU's network could have been a front-page story on CNN, under the right circumstances. I just think that in an ideal world, it should have ended up as a front-page story on CNN regardless of the "circumstances" — but real life, no favorable circumstances means no CNN story.
That might seem like a lot to read into a single case of media silence about a political website being censored at a state university. But while Change.org is no longer blocked at ASU, the inefficient and arbitrary means by which news "events" are discovered and distributed to a wide audience will be with us for a long time.
-
Carl Malamud Answers: Goading the Government To Make Public Data Public
You asked Carl Malamud about his experiences and hopes in the gargantuan project he's undertaken to prod the U.S. government into scanning archived documents, and to make public access (rather than availability only through special dispensation) the default for newly created, timely government data. (Malamud points out that if you have comments on what the government should be focusing on preserving, and how they should go about it, the National Archives would like to read them.) Below find answers with a mix of heartening and disheartening information about how the vast project is progressing.
LoC?
by an Anonymous Reader
So how many GB/TB is a Library of Congress? :)
Or, more seriously, how big are you estimating? Are you using raw scans or some sort of compression (JPG, PNG, etc)? What resolution are you using? Do you vary the resolution depending on the document?
What sort of meta data are you putting in?
CM: The reason John Podesta and I suggested a Federal Scanning Commission in our letter at YesWeScan.Org is we really don't know how big the holdings of the government are. I can tell you that the Library of Congress is about 32 million cataloged books (a significant increase from the 6,487 books Thomas Jefferson donated to get them started). But, this is about more than books, it is about paper records, microfilmed technical papers, video, audio, photographs, and much more.
The scale is fairly vast. The Smithsonian has 137 million objects, including about 13 million images. David Ferriero, the Archivist of the United States estimates he has over 10 billion pages of text documents, 7.2 million maps, and 40 million photographs including everything from past census records to presidential dinner menus, and that includes about 7.5 million motion pictures and sound recordings. The Government Printing Office distributes their documents to the Federal Depository Library Program, and that includes over 60 million pages of collections including the Official Journals of Government such as the Federal Register. That's just scratching the surface, and we recommended a Federal Scanning Commission to begin the process of understanding what we have (and what is worth digitizing).
As to standards? There are lots of pretty good standards on how to digitize. NARA, Library of Congress, GPO all spec out document scans at 400 dpi, for example. For photographs, moving images, and other objects, there are some pretty good and pretty detailed standards at www.digitizationguidelines.gov. I know Brewster Kahle's operation and my own tend to work off those specifications (in fact Brewster does quite a bit of scanning for the government).
As to compression? Well, I've found people tend to overcompress things. That said, sometimes the initial quality isn't that great, so a 600 dpi uncompressed scan would be silly in some cases. But, for photographs I try very hard to keep the TIFF images around and not rely on JPEG. Likewise, for audio it is really nice to keep a nice 48 khz version of your file around if you can simply because if you screw up the compression maybe somebody else can do a better job in a few years. Disk space is relatively cheap, so that isn't the barrier it used to be. For video, I rip MPEG2 at whatever it is on a DVD, when I'm actually digitizing I try to get the video bitrate up to 8-10 mbps when ripping a Betacam or Umatic. Some people think that is overkill, but I'd rather be safe than sorry.
Metadata? Well, you got to have it or you're not going to get very far when it comes to access. Many librarians have made perfect the enemy of the good when it comes to metadata and have resisted any attempt at digitization because we don't have the very best metadata we might have. I'm more in the camp of scan what you have and get as much of the metadata as you can into it. For example, we have 3,200 1000-page volumes of briefs from the 9th Circuit of the U.S. Court of Appeals. We didn't have good metadata, but we had the Internet Archive scan them anyway. Then, after we got our PDF files, I shipped those off to a double-key team in India and they broke the briefs up into individual documents and typed the metadata into a spreadsheet for me, which we hope to release soon.
My point is that sometimes you can shoehorn the metadata in after the fact or you can use a variety of techniques to pull the metadata out of the documents (e.g., smart OCR). In theory, you can use crowdsourcing to get the metadata, but so far I've not had a lot of luck persuading thousands of people to spend their time doing that kind of work. A captcha is a quick thing to do and is between you and something you want, whereas entering metadata in for videos or documents is one of those civic duty things that everybody thinks everybody else should be doing.
Total size? Brewster says a book is about 400 Mbytes (though he's very quick to point out that you could put the words in all the books in the library into a terabyte and if you're distributing PDFs, you can easily throw 130,000 full-color, searchable PDFs onto a 4 TB drive). But, you were probably asking about raw data. Here's some raw numbers:
32 million books at 400 Mbytes each is 12.8 petabytes 50 million photos at 150 Mbytes each is 7.5 petabytes 10 billion pieces of paper ("records") at 100 Kbytes each is 1 petabyte 20 years of video at 8 mbps is only 630 Tbytes.
(Somebody check my math?)
If you're talking a decade-long federal digitization initiative, we're looking at well south of 50 petabytes, which seems pretty doable in this day and age!
Can the rare books collections be digitized?
by autophile
Three closely related questions about the rare books collections at the Library of Congress:
1. I know there is some kind of effort going on to digitize the rare books collections, but can it be sped up? There are many high-quality low-cost archival book scanners out there (such as the ones developed at diybookscanner.org).
2. It gets really annoying to have to receive paper copies of books when copies are requested. Why not DVDs of high-quality images?
3. Why is there no outreach by the LoC to smaller, cheaper book scanning efforts? The Internet Archive, DIYBookscanner.org, and Decapod all come to mind.
CM: In reverse order. I don't know why we aren't distributing and decentralizing our scanning efforts. The Internet Archive is a heavy-duty production shop and they do an amazing job, as do folks like Google Books and the folks digitizing things the Mormon Church. But, there are a bunch of DIY solutions and it would be really nice if we could get more people pitching in. The biggest problem on distributing the digitization efforts is quality control. I know when it comes to ripping video, I can easily teach other people how to grab an MPEG2 off a DVD, but when it comes to things like digitizing a Betacam, that takes some training. But, we're all trainable and I wish we could all do more.
Getting back paper copies of books and papers when they're doing a copy anyway is just plain dumb. Likewise with things like FOIA results. John Podesta testified before the Senate about FOIA and said if an agency answers a FOIA request, they should also post their result online so others can see it. That seems pretty obvious.
As far as digitizing rare book collections, there are some amazing pockets throughout the government but there is no real coordination and there certainly is no effort to scan at scale or to come up with a realistic national digitization strategy. That is why we called on the White House to lead the effort. Within the Library of Congress there are some amazing collections, but if you look around to places like the National Agricultural Library or the National Library of Medicine or the libraries in the service academies you'll find lots more. Some have argued that digitizing rare books is silly because the audience is just a few academics, but I can tell you from my own experience helping host the network site for the Archimedes Palimpsest that when you make this kind of information available, there is an amazing long tail.
If you scan it, they will come. And, to answer your question, if we all scan it, they will come much sooner.
Real time legislation drafting
by kerskine
Would it be possible to implement a system that would allow real-time and continuous review of legislation while it's being drafted? Much has been made over the past three years about legislation being available for review before voting by the House or Senate. The final draft for review usually is huge PDF that makes it near impossible for citizens, interest groups, and the media to thoroughly analysis in time.
CM: You want to see the sausage being made not just buy the hot dog! I'll comment on the U.S. Congress since that's the system I know best. Thomas is a pretty good system if you happen to be stuck in 1994. It does have all the amendments and the actions and the various stages that legislation go through. But, it isn't real time, more like "pretty quick." As Van Jacobson once quipped, "Same day service in a nanosecond world." And, Thomas isn't really machine processable, it is final form, usually formatted ASCII text (shades of NROFF!). People like Josh Tauberer who built GovTrack.US have spent considerable time crawling those systems and trying to get the data into regularized formats and make it available to others to reuse via APIs, but that isn't the same as exposing the inner working of the sausage factory.
Majority Leader Cantor's staff has been pushing a system to make the raw data all available in XML from the Clerk's office and I think that is a very promising initiative which hopefully will bear fruit. (They're having a February 2 conference to discuss their plans if you are interested. I have no idea if it will be streamed for those of who aren't Inside the Beltway and I don't know their schedule for moving past conferences and into production.)
Congress is a pretty complicated beast. I know some folks like Sean McGrath have had better luck with some of the state legislatures. The problem is you need to dig deep into the inner working of a legislature. In the Congress, that means you're changing things like authoring tools that are used in the Clerk's office and by all the staff members, so you have to be careful or you get a bunch of really angry Congressman yelling at you because their staff can't crank out the flavor-of-the-week in the form of a bill or amendment.
There's also a bit of an issue of will. My work with the Congress to put hearings on-line showed that you could take the official transcripts of a hearing and use those to generate closed captions on the video. All you need is the official transcript of the hearing, but in order to get those I had to execute a special Memorandum of Understanding with the House Oversight Committee. Other committees guard their transcripts jealously and won't let them out for several when. When I started processing a bunch of historical videos we purchased from C-SPAN, I went to the Government Printing Office and found that many committees never deliver their transcripts, even a decade after the fact!
How to keep track of legislative activity about open access?
by oneiros27
Recently in the federal register, there were two calls for comments about access to data and research from federally funded research:
http://federalregister.gov/a/2011-28623 [federalregister.gov] http://federalregister.gov/a/2011-28621 [federalregister.gov]
I didn't hear about these until ~4 weeks after the original announcement, and with the holidays, it was too late to try to get the societies I'm involved with to prepare and vote on official statements. Are there any places where people can get/post notices of these sorts of things so that we can stay informed and try to help influence policies?
CM: The Federal Register is getting a lot better now that it is a much more open system. The idea of "Federal Register 2.0" was a paper I wrote for the Obama transition, so it is an issue I've tracked pretty closely and frankly, I've been amazed at how much better it is now. What they did is instead of selling the raw data feed for the Federal Register for $17,000/year, they went from SGML to XML and then released the data in bulk for free. A few guys out in San Francisco were looking for something to do to enter a contest and they took that bulk data and dreamed up GovPulse.US. That was such a better version of the Federal Register that the Office of the Federal Register switched the official site over to their open source platform. My point is the tools are there to do better notification mechanisms, and I'm sure the government would welcome somebody grabbing the GovPulse.US code out of Github and making it even better.
That's the technical answer. But, the substantive answer is that there is a huge boatload of stuff in the Federal Register and it is pretty hard to figure out what to pay attention to. I also missed that particular call for comment, and I've even missed several Requests for Information coming out of places I try and pay attention to, like the White House's Office of Science and Technology Policy. And, I do this stuff full-time! Perhaps better targeted notification mechanisms are the answer. Maybe it is a social media solution, where you pay attention to things your friends are paying attention to. I hope the answer is not that the only way to pay attention is to be employed with a beltway bandit which can afford hundreds of minions that do nothing but pay attention to Washington. Indeed, there are some very fancy for-pay services from folks like Congressional Quarterly and Bloomberg that cost an arm and a leg, but I can't help but think there has to be a better way that is also open.
What do you think of corporate partnerships?
by mhh5
I'd like to know what you think about corporate partnerships in the process to get public data released. (I'm not sure if Google Patents existed before the USPTO released its databases.) Do corporations that get involved in the process tend to make the process better without question, or are there tradeoffs in some areas because the corporations always want to help but then try to retain a proprietary version of the data for themselves?
CM: The theory is that the government gets some kind of valuable service (like digitization) that the government wouldn't get otherwise so it is a "win-win." But, the reality is all too often the government gets snookered and what we do is give some corporation exclusive access to some pot of data and the government doesn't get much of anything. The deal between Amazon and the National Archives was a good example of that kind of a private fence around the public domain. With a help from Boing Boing, I started systematically purchasing those public domain videos and re-releasing them in the wild. I have no problem with Amazon selling public domain video, I just hate it when they get a de facto or a contractual exclusive. (My testimony before Congress on this subject is here.)
There are lots of other examples of government getting snookered. For example, the Government Accountability Office let Thomson West get access to 60 million or so pages of federal legislative histories. At great cost to the government, they were all packed up and dispatched to West which digitized them all and then sent them back to the government. West now sells access to his amazing database. What did the government get for it's trouble? A few logins for GAO staffers. Even members of Congress need to pay to access the database! (We have an interesting paper trail on this issue.)
I'm glad you brought up the Google Patent system because I was personally involved in making that happen and I can tell you that this one is totally legit. Jon Orwant is the lead developer on this for Google and I played a small part in helping convince the White House and the Patent Office they ought to give Jon access to their data (the heavy lifting on that deal was by Beth Noveck who was the Deputy CTO at the time). Google makes all the data they got from the Patent Office available for bulk access with no strings attached. I can vouch for that because I did a mirror of their system. Last I heard Google was sending out anywhere from 1 to 10 terabytes of data PER DAY to external sources and even normally very critical folks who work in this arena have been really happy.
The big problem in the Patent Office is their computing infrastructure is a real catastrophe. Their power plant is over 95% capacity (e.g., plug in a computer, bring the building down!) and even though the Under Secretary knew that selling DVD subscriptions was silly, he wasn't able to switch over to an FTP service. He cut the deal with Google Patent and it worked out well for the government, for Google, and for everybody else.
What's the difference between the Google deal and the Amazon deal? In the case of the Amazon and GAO/West deals, the government lawyers did all the negotiating and they were totally outsmarted by some sharks in industry. But, when government has people like Under Secretary Kappos and Beth Noveck doing the negotiating, these things can work out just fine. The key is government should partner with people who want to do public service, not people who want to service the public.
Encouraging Governments?
by theNAM666
In a city such as Nashville, things as basic as business ownership and property records are not available online. In states such as New Jersey, public records such as basic corporate filings (officers, operating address/address for service of process) are accessible only for a fee.
What concrete actions can citizens confronting such situations, take to encourage accessibility and accountability?
CM: I find you need a carrot and a stick to make this stuff happen, especially at the local level. Folks like Everyblock.Com and CodeForAmerica.Org have done great working prying some of these databases loose, but there is still lots to do.
The first thing you should do is pick up the phone (or pick up your email client) and write/call the people who run the system. Ask them if you can have access to the data. Sometimes, it is as simple as that.
Other times, though, it isn't quite as simple since they want the money (or they want the control or they think this should be done by "private industry" by which they mean some buddy who is a contractor). The nice thing about any government system is somebody usually has oversight responsibilities. So, the next step is to find a city council member of state legislator who has oversight on the agency in question and ask them.
Again, life isn't usually that simple, but sometimes you win! If you can't get anywhere that way, what I usually end up doing is basically competing with the government system. Build a proxy system like RECAPtheLaw.Org did to recycle paid documents. Or, get a sponsor and buy a reasonable number of docs and build a web site that looks like it is going to be a real production system.
Then, go back again and ask. Maybe if you have eyeballs or at least have a nice web site, that is enough to get the government moving. But, if that doesn't do the job, you may have no choice but to compete with them for real, which of course requires a big commitment in time and energy and not everybody can do that. I know in the case of the Patent Office, I started pestering them in 1993, including several times when I spent 6-figure sums purchasing their data, and it still took until 2011 to crack that nut.
The real trick is focus/obsession. Pick one thing you really care about and just keep pestering them until you crack it open. If you're surfing from one opengov problem to another, showing up for a 1-day hackathon then moving on to something else, you're not going to get anywhere. Pick something real and make it your thing.
Privately Owned, Copyrighted Law
by AdamnSelene
I think I have read that the law itself cannot be copyrighted and it should be possible to make it available available to everyone. But as a techie who drafts standards and specifications, I was wondering about how far this goes--especially since Congress recently proposed enacting some of our standards into law. (They decided not to, but they read some parts into the committee records as they debated.) Can you still accomplish your project if a governmental body adopts (or considers adopting) a privately owned, copyrighted technical reference manual or set of safety standards as administrative law (or regulations that carry the force of law)? Or would such obstacles keep you from being able to digitize all of the government's laws (and archives of proposed laws)?
CM: The idea that the law has no copyright is a fundamental part of the American system of government. That applies to states and municipalities as well. The basic decision is Wheaton v. Peters from 1834 but that decision has been reaffirmed over and over. The law is sacred in the American system. You can't have equal protection under the law or due process under the law if there is a poll tax on access to justice.
When we get to a privately developed standards however, it turns into a very interesting issue. The basic mechanism is called Incorporation by Reference. The government will take some external document (such as a model building code) and incorporate the entire text to make it the law of the land. A guy named Peter Veeck was responsible for a landmark decision in 2002 when he published the Texas Building Code which was an incorporation of a privately-developed and very expensive model code. The court ruled that while the model code had copyright, the law of the land did not.
Based on the Veeck decision, my group went and posted many of the public safety codes enacted by the states. We started by purchasing model codes, finding the incorporating legislation, and concatenating the two pieces together and posting the resulting PDFs. More recently, we've done some extensive reworking of the California public safety codes, known as Title 24, converting the entire text into valid XHTML, recoding the graphics as SVG graphics, the formulas as MathML, and regenerating the PDF documents as nicely typeset documents instead of low-quality scans. You can see this work on the web but it is also available as Google Code project.
The federal government also uses this mechanism intensively, with over 2,000 standards incorporated into the Code of Federal Regulations. This is non-trivial stuff, things like all the OSHA safety regulations. The issue was recently considered by a federal group called the Administrative Conference of the U.S. which basically rolled over and endorsed the idea that it is ok for important parts of the law to cost money. (Read EFF's protest letter if you want a good critique of what they did.)
I'm not necessarily saying that government should be able to appropriate any privately-developed standard and make it available. And, I'm not necessarily saying you want OSHA bureaucrats drafting the standards. But, I do think the big standards establishment and the government regulators have cut a deal that results in the law not being available and the costs forked off on private citizens and small business with extortionate monopoly prices. I just paid $847 for a 48-page safety standard from Underwriters Labs and $60 for 2-page safety standard from the Society of Automotive Engineers, both of which are mandated by law in the CFR. They do need money to run their operations, but let me just point out that in 2009 the 501(c)(3) nonprofit Underwriters Labs paid their CEO $2,138,984 and the nonprofit SAE paid their CEO $412,578.
Ancestry.com
by An Anonymous Reader
What is your opinion about websites like Ancestry.com which make use of public records and charge a subscription fee for access? What is the incentive for the government to migrate old documents into digital form when services like these exist? Do you think Ancestry.com should be a 501(c)(3)?
CM: I'm not a big fan of for-profit corporations that have a business model of monetizing the public domain. I'm fine if they exist and fine if they make billions of dollars, but if they are the only game in town they've taken something that belongs to all of us and and turned it into their private property.
The government got snookered on the Ancestry.Com deal. They could have insisted that the raw data be available in bulk for anybody else to use. The folks that approach the government to cut these sweetheart deals argue that is unreasonable because they need a "return on investment" and the argue that if they don't get the return on investment they won't do the deal (and by extension nobody else will do the deal).
But, government can argue much harder! For example, instead of negotiating some exclusive thing with Ancestry.Com, how come they didn't ask the Internet Archive to grab the data? Or put together something creative with a couple of foundations that would pay for the digitization in return for the kind of payback the foundations like to see (e.g., good press, photo opportunity with the President, or other tools of the trade)?
You asked if Ancestry.Com should be a 501(c)(3)? Not all nonprofits do something that I think which should be an essential part of their mission, which is allow others to compete with them. I believe providing open access to all data ought to be a precondition to getting nonprofit status (an idea that Gil Elbaz has been pushing for quite some time). A good example of a nonprofit that builds walls is Guidestar which wants to be the place where you go for all your nonprofit information. The IRS should be making all Form 990 returns of nonprofits available in bulk for anybody to use, which would knock the bottom out of Guidestar's attempts to build walls and force them to stay innovative and provide value.
Pacer Problems
by onyxruby
How much difficulty do you anticipate in getting and publishing records in Pacer? If there's one system that should be free it the decisions that our courts make and yet you are charged by the page just to view the results. Are you concerned about a court taking an unkind view on your archiving what is in Pacer?
CM: PACER is an abomination. Do they take a dim view of our efforts? Well, the Administrative Office of the U.S. Courts reacted so strongly to our efforts to make their data available that they called the FBI on Aaron Swartz and cancelled the only meaningful public access system they had, which consisted of one terminal in each of 17 public libraries around the country. In this era of rapidly decreasing costs, they just boosted their access charges from 8 cents a page to 10 cents a page, arguing that this is a bargain compared to 25 cents a page for a copy machine.
What I find so disturbing about PACER is that when we did get 20 million pages of docs, we were able to conduct a comprehensive analysis of privacy violations in the courts, an analysis that led to a nice thank-you letter from the Judicial Conference and changes in their privacy rules. In other words, only when public interest groups got access to the data did we begin to address privacy issues. Public access is not just about pro se prisoners defending themselves from a jail cell, which is the view of many in the Administrative Office of the Courts. Public access is about attempts like ours (and many other folks) to make our system of justice function better. When we say we are "an empire of laws not a nation of men" that means we write down what we are doing in our courts so that it is no longer the arbitrary decisions of individuals. The paper trail is there so we can make sure the system is functioning properly. When you limit that access to those that only have a Gold Card, you pervert democracy and you pervert justice.
This principle that access to justice shouldn't hide behind a cash register goes back to the Greeks. Theseus in Euripedes' Suppliants said "when there are no public laws, one man holds power by keeping the law all for himself, and there is no more equality. But when the laws are written, the weak man and the rich man have equal justice." The PACER system is justice for the rich man.
Steve Schultze and the team at Princeton did a lot of the heavy lifting on this issue, including the very nice RECAPtheLaw.Org system they built. They've also done a lot of financial analysis that shows that the courts are not only recovering their costs for operating the expensive PACER system, they're making a huge profit (to the tune of $100 million/year) and using their excess profits to do things like buy big-screen TVs in direct violation of the E-Government act.
The basic problem on PACER is the Judicial Conference has delegated the issue to a few techie judges who think what they've built is something great. But, PACER is a hairball of bad PERL code and the result has not served the judges, the bar, or the American people very well. My only hope is that eventually, the Judicial Conference will see that their information technology is 30 years behind the rest of the Internet and feel ashamed at the travesty they have wrought. Until then, we have RECAP.
If you're interested in the issue, a couple of resources to look at are the PACER paper trail and a bit of a rant that I delivered at the Gov 2.0 summit.
How to visualize opened data?
by hardwarejunkie9
The amount of information you're trying to free is entirely staggering and consists, largely, of tables of numbers. These numbers are incredibly significant, but people generally can't see them.
After you free all of this information and make it available to the public (as it should be), then what? What do you expect for the public to do with these numbers? Tables of information are not nearly as useful as graphs. This data needs to be seen, but, more importantly, it needs to be understood.
Do you have any ideas for how to disseminate this information? Perhaps a team-up with someone like gapminder.org's Hans Rosling might be particularly valuable for all of us.
CM: Actually, most of the data I'm looking at is not tables of numbers, it is video, images, textual documents, technical papers, maps, and books.
But, I definitely get what you're saying and there are a lot of numbers. For example, the IRS Form 990s should be structured data instead of PDF documents, so extracting the data from the mass of paper is the initial challenge. There are lots of other examples of this kind of initial extraction, getting what were printed paper docs into structured data. There are some interesting tools, such as OCRopus which does layout analysis, but there needs to be much more. One of the reason we called for a Federal Scanning Commission is that we think there is a lot of directed R&D that could not only scale up mass digitization but could also work on the important value-added of extraction of structured data and handling some of the tricky issues like detecting the presence of Social Security Numbers.
Once you have the data, as you say, then what? I'm a big fan of the idea that the government starts by providing bulk data, then they provide an API, and then maybe they also build web sites and apps and other things along with everybody else out there. That's a 3-part hierarchy that Ed Felten and some of his students developed and it should be a law that applies to all government information systems that are externally facing.
The issue here is that all too often people look at a problem like "digitize all government information" and they want to see the whole stack of the solution from one place. But, I think you can do a layered approach and count on the fact that there is always somebody smarter out there and our job is to reduce the barriers to entry. So, how would I visualize the data? I have no idea, but I'd make damned sure that folks like Martin Wattenberg at Many Eyes and Hans Rosling at Gapminder knew the data was out there and then I'd sit back and be amazed at whatever they come up with. How's that for pushing the problem downstream?
Why is data access so hard?
by CanHasDIY
Can you provide any explanation as to why it is so difficult and cost-prohibitive to obtain records from the government, especially considering the abundance of laws requiring government compliance with requests for information (AKA "Sunshine Laws")?
Is it simply a matter of government employee ineptitude, or have you found evidence of a more nefarious rationale?
CM: I get that question a lot. Why would a member of Congress take deliberate steps to stop public hearings from being available? Why would a court administrator deliberately restrict access to public court documents? Usually the answer is, as Heinlein said, "you have attributed conditions to villainy that simply result from stupidity." When I'm explaining why something is so broken on a big government system, my usual answer is that there are a lot of people still stuck in the 1970s and 1980s, when information dissemination was really, really hard and it took men in white lab coats and computers the size of freight trains to process data. In other words, the problem with a lot of folks who are government gatekeepers is they just don't get the Internet and they don't get computers. In fact, usually when some senior bureaucrat is throwing stones at me, you can find younger staffers working for them rolling their eyes.
That's an optimistic view, and if I'm right things will get better. But, I'm often wrong on my predictions of the future. (I was the guy who saw TimBL demo the web in 1992 and thought to myself "interesting, but it won't scale.")
But, there is also some more nefarious stuff happening, often the accumulation of power by being able to cut exclusive deals with contractor buddies. If your life in government consists of receiving emissaries from Lockheed Martin, maybe you think you're making everybody happy by letting them build you a $1 billion computer system. Often, you think your problems are so unique that the $1 billion solution is the only answer.
And, in some cases, as we've seen from numerous GAO reports, Inspector General reports, Congressional hearings, and newspaper articles, there are some really evil people out there who think the public domain and the government is their personal business opportunity. Looting the federal government is the kind of civic crime that ranks right up there in my book with stealing cookies from Girl Scouts and selling fake medicines to sick people.
Who is the worst?
by TheBrez
Which government agency is the worst to get information from?
CM: I don't know who the worst are (there's a lot of competition for that slot), but the ones that piss me off the most are the ones that should know better.
Public.Resource.Org is a really small operation. I'm the only staff member. My part-time sysadmin is @mdkail who is pretty busy with his day job as CIO at NetFlix. My ISP is Jim Martin and his team at ISC who are kind of busy running the F-Root. My office net is supported by the amazing systems team at O'Reilly which rents me office space at below-market rates.
I'll grant you government would have a tough time getting that kind of help. But, I'm a one-man shop and we run the 4th most popular U.S. government video channel on YouTube, we're the source for a lot of the on-line presence of the U.S. Court of Appeals, and we've supported efforts for the U.S. Congress, the White House, and the National Archives. If we can do this out of Northern California, couldn't the vast resources of the federal government in Washington, D.C. do a whole lot better than they're doing now?
For me, my current bete noir is the U.S. Congress. We got half-way through processing their archives of video from congressional hearings, publishing about 31 terabytes of data. Then, a couple of staffers decided this was a bad idea and pulled the rug out from under us. They actually decided it was a bad idea to publish video from public congressional hearings.
Like any agency, Congress is a mixed bag. We had tons of support from Darrell Issa, for example, and ran a very successful pilot project for him for a year. We talked to all sorts of people on committees and in the various agencies that support the Congress. But, at the end of the day, a couple of staff members were able to decide that the public archive shouldn't be public and they terminated our project. (If you have some time, you might like to read our rather surreal paper trail.)
So, rather than the worst, I think we need to look for the most shameful, the ones that have the privilege and the power and could easily do better. I know it is in vogue to throw stones at government in general and Washington in particular, but there are times when government can be so useful and so awe inspiring it takes your breath away. Government can be that shining city on the hill but we all have to take an active part in our government to keep those lights shining bright. -
Google Deal Allegedly Lets UMG Wipe YouTube Videos It Doesn't Own
Sockatume writes "Ars Technica is reporting that Google has given music conglomerate UMG the right to arbitrarily eliminate YouTube videos. When UMG had Megaupload's 'Mega Song' removed from the site, it was assumed that they had made a DMCA claim, and that YouTube was responding under its 'safe harbor' obligations. Megaupload's legal response argues that UMG has no grounds to request a DMCA takedown. However in court filings (PDF), UMG claims that its licensing agreement with Google gives it the power and authority to unilaterally wipe videos from the site, bypassing the DMCA entirely. If true, that means that your activities on YouTube are not just curtailed by the law, but by the terms of their secret agreements with media conglomerates." -
IP Addresses Not Enough To ID Users
phaedrus5001, with his first accepted story, points out an article at Ars Technica from which he's excerpted a chunk relevant to nearly anyone with an internet connection: "A file-sharing lawyer admitted this week that IP addresses don't by themselves identify someone accused of sharing copyrighted material online. To figure out who actually shared the pornographic movie at the center of the case, lawyer Brett Gibbs of Steele Hansmeier LLC told the judge (PDF) he would need to search every computer in the subscriber's household." -
Judge Nixes Warrantless Cell Phone Location Data
Front page first-timer poena.dare writes "The government sought warrantless access to 113 days of location data for a Verizon Wireless customer. On Monday, a judge refused the request (PDF), ruling that cell phone users have an expectation of privacy in location information. 'There is no meaningful Fourth Amendment distinction between content and other forms of information, the disclosure of which to the Government would be equally intrusive and reveal information society values as private,' said Judge Nicholas Garaufis. Privacy advocates in DC will be cheering as soon as they climb out from under their desks!" -
Does Creative Commons Work With Pseudonymity?
kale77in writes "I was going to direct this question to the Australian Arts Law Centre, and probably still will, but I'm sure they're very busy and I'm sure that someone here must have bumped up against this issue already. I have not found it addressed in the CC FAQ. I have a website which is oriented around the study of Ancient Greek. Much material relevant to this study (texts, lexica, etc) was published in the 1800s; it is now out of copyright and readily available from archive.org and similar sources; but much of this material could use an upgrade and users will have up-to-date contributions of their own to make. I'm writing a system that allows user entry, correcting, searching, commentary, tagging, redistribution and so on, of such material." Read on for the questions this raises about licensing, attribution, and copyright. Kale77in continues: "Here's my issue: I would like everything to be under Creative Commons BY-SA — I can say 'same as Wikipedia' and this will encourage participation and confidence. The question is who should own the copyright of user-created data. I'd like the copyright to be held by the submitter. But I've no interest in enforcing anything more than pseudonymity for the users. Now I understand that copyrights can be held pseudonymously; but how does this allow attribution as required by CC-BY-SA? Is it enough for an author of a derivative work to reference the page on my site where the pseudonymous copyright holder grants the license? Does the end user need to be able to contact the copyright holder for additional rights? Is this a road through a minefield, so that I should just bite the bullet and, like Wikipedia, make a foundation to hold and license the copyright for collaborative works? But that costs money to administer; for a small non-profit venture is it best to just chill and take resort in persuading the users to make everything public domain? Or does a special User Agreement allow some way to gain the benefits of CC licensing (= endless reuse, and no hassle) without losing pseudonymity? But then, won't a complex upfront agreement hinder participation?" -
The End of Paper Books
Hugh Pickens writes "Books are on their way to extinction, writes Kevin Kelly, adding that we are in a special moment when paper books are plentiful and cheap that will not last beyond the end of this century. 'It seems hard to believe now, but within a few generations, seeing an actual paper book will be as rare for most people as seeing an actual lion.' But a prudent society keeps at least one specimen of all it makes, so Brewster Kahle, the founder of the Internet Archive, has decided that we should keep a copy of every book that Google and Amazon scan so that somewhere in the world there was at least one physical copy to represent the millions of digital copies. That way, if anyone ever wondered if the digital book's text had become corrupted or altered, they could refer back to the physical book that was archived somewhere safe. The books are being stored in cardboard boxes, stacked five high on a pallet wrapped in plastic, stored 40,000 strong in a shipping container, inside a metal warehouse on a dead-end industrial street near the railroad tracks in Richmond California. In this nondescript and 'nothing valuable here' building, Kahle hopes to house 10 million books — about the contents of a world-class university library. 'It still amazes me that after 20 years the only publicly available back up of the internet is the privately funded Internet Archive. The only broad archive of television and radio broadcasts is the same organization,' writes Kelly. 'They are now backing up the backups of books. Someday we'll realize the precocious wisdom of it all and Brewster Kahle will be seen as a hero.'" -
eBook Lending Library Launched
An anonymous reader writes "The Open Library has launched an eBook lending program. Patrons of this Internet Archive-led group of libraries may borrow up to five books at a time, for up to two weeks. Like print books, the eBooks may be on loan only to one patron at a time. The organization perceives this model providing more bang for the libraries' bucks. The books are mostly 20th-century titles. Some librarians have books that are too fragile or rare for lending and will scan them for eBook lending." -
USPTO Lets Amazon Patent the "Social Networking System"
theodp writes "After shelling out a reported $90 million to buy PlanetAll in 1998, Amazon shuttered the site in 2000, explaining that 'it seemed really superfluous to have it running beside Friends and Favorites.' But years later in a 2008 patent filing, Amazon described the acquired PlanetAll technology to the USPTO in very Facebook-like terms. And on Tuesday, the USPTO issued US Patent No. 7,739,139 to Amazon for its invention, the Social Networking System, which Amazon describes thusly: 'A networked computer system provides various services for assisting users in locating, and establishing contact relationships with, other users. For example, in one embodiment, users can identify other users based on their affiliations with particular schools or other organizations. The system also provides a mechanism for a user to selectively establish contact relationships or connections with other users, and to grant permissions for such other users to view personal information of the user. The system may also include features for enabling users to identify contacts of their respective contacts. In addition, the system may automatically notify users of personal information updates made by their respective contacts.' So, should Facebook CEO Mark Zuckerberg worry about Amazon opening a can of patent whup-ass?" -
USPTO Lets Amazon Patent the "Social Networking System"
theodp writes "After shelling out a reported $90 million to buy PlanetAll in 1998, Amazon shuttered the site in 2000, explaining that 'it seemed really superfluous to have it running beside Friends and Favorites.' But years later in a 2008 patent filing, Amazon described the acquired PlanetAll technology to the USPTO in very Facebook-like terms. And on Tuesday, the USPTO issued US Patent No. 7,739,139 to Amazon for its invention, the Social Networking System, which Amazon describes thusly: 'A networked computer system provides various services for assisting users in locating, and establishing contact relationships with, other users. For example, in one embodiment, users can identify other users based on their affiliations with particular schools or other organizations. The system also provides a mechanism for a user to selectively establish contact relationships or connections with other users, and to grant permissions for such other users to view personal information of the user. The system may also include features for enabling users to identify contacts of their respective contacts. In addition, the system may automatically notify users of personal information updates made by their respective contacts.' So, should Facebook CEO Mark Zuckerberg worry about Amazon opening a can of patent whup-ass?" -
Gene Therapy Restores Sight To Blind
An anonymous reader writes "Looks like we have found a cure for genetic blindness (clinical trial — abstract — paper [PDF] — ABC News video). This gene therapy treatment increases both cone and rod photoreceptor-based vision. These engineered viruses are implanted to do our bidding to restore vision. Clinical trials on 6 children and young people proved the therapy and didn't find any notable side effects." Any blind person, especially any adapted and competent one, who wants to gain the sense of sight would be well advised to study Oliver Sachs's classic piece "To See and Not See." -
Amazon Scores Gift-Delivery Patent
theodp writes "In May, the USPTO rejected Amazon.com's patent claims (PDF) for its Method and System for Placing a Purchase Order Via a Communications Network (a 1-Click spin-off). At the time, a USPTO Examiner cited Bilski, explaining that elements of CEO Jeff Bezos' gift-delivery invention 'may be performed largely within the human mind,' coming to essentially the same conclusion a NY Post reporter arrived at in 2002. But Amazon's attorneys have worked their legal wordsmithing magic (PDF), convincing the USPTO that 'obtaining delivery information for a gift from one or more information sources other than the gift giver and recipient' is indeed novel and patentable. A Notice of Allowance for the patent was mailed to Amazon on November 17th, just in time for Holiday Season injunction-giving!" -
Revisiting DIY HERF Guns
An anonymous reader writes "HERF guns have previously been regarded as nothing more than an interesting project with uses ranging from at-home experiments to malicious pranks. But the deployment of 'morally gray' forms of high-tech crowd control, such as the recent use of a sound cannon against domestic protesters, along with the likely future unleashing of the pain gun on more than just 'foreign terrorists,' creates a new purpose for these relatively easily assembled devices. Could HERF guns become a new method to counter the silencing of protesters via these sophisticated attacks, or is there any other way to prevent such efficient, convenient crowd dispersal?" -
Revisiting DIY HERF Guns
An anonymous reader writes "HERF guns have previously been regarded as nothing more than an interesting project with uses ranging from at-home experiments to malicious pranks. But the deployment of 'morally gray' forms of high-tech crowd control, such as the recent use of a sound cannon against domestic protesters, along with the likely future unleashing of the pain gun on more than just 'foreign terrorists,' creates a new purpose for these relatively easily assembled devices. Could HERF guns become a new method to counter the silencing of protesters via these sophisticated attacks, or is there any other way to prevent such efficient, convenient crowd dispersal?" -
Revisiting DIY HERF Guns
An anonymous reader writes "HERF guns have previously been regarded as nothing more than an interesting project with uses ranging from at-home experiments to malicious pranks. But the deployment of 'morally gray' forms of high-tech crowd control, such as the recent use of a sound cannon against domestic protesters, along with the likely future unleashing of the pain gun on more than just 'foreign terrorists,' creates a new purpose for these relatively easily assembled devices. Could HERF guns become a new method to counter the silencing of protesters via these sophisticated attacks, or is there any other way to prevent such efficient, convenient crowd dispersal?" -
BetOnSports Founder Pleads Guilty To Racketeering
Hugh Pickens writes "The founder of Internet- and telephone-based gambling operation BetOnSports has entered guilty pleas to three US charges, including a racketeering charge, and will forfeit $43.7 million to the US government as part of a plea agreement. Beginning in the mid- to late-1990s, Gary Kaplan set up businesses in Antigua and later Costa Rica to provide sports betting services to US residents through web sites and toll-free telephone numbers. Those numbers terminated in Houston or Miami, and were then forwarded to Costa Rica by satellite transmitter or fiber-optic cable. Some of Kaplan's web servers were located in Miami and were remotely controlled from Costa Rica. People became customers by depositing money in a BetOnSports account. By 2004, the BetOnSports organization's principal base of operations in Costa Rica employed about 1,700 people, had nearly one million registered customers and accepted more than 10 million sports bets. Now bankrupt, BetOnSports took in $1.25 billion in 2004, with 98 percent of that revenue coming from bets made through its web site by clients in the United States. 'Gary Kaplan made millions of dollars by making it too easy for people to gamble away their hard-earned money without having to leave their homes,' said FBI agent John Gillies. 'Today's guilty plea should have a lasting effect because Kaplan was not only the founder of BetOnSports, he was also one of the pioneers of illegal online gambling.'"