Yahoo Competes with Google in Book Scanning
UltimaGuy writes "A consortium backed by Yahoo has launched an ambitious effort to digitize classic books and technical papers and make them freely available on the Web. The company is partnering with the newly formed Open Content Alliance, which aims to offer PDF documents of books to the public at no charge. Consumers will be able to search the contents of the Open Content Alliance's database and download the entire content of any work, such as a scanned copy of a book."
Someone start up a "Open Content Alliance" for music... then we can digitize and share it all we want.
I can't wait to read the whole book on one page.
I find it interesting that in all the articles I've looked at today about this that only one has mentioned Project Gutenberg. Naturally, I can't recall which source it was...
I'll turn into a supernova and burn up everything. Well I'll turn into a black little hole and you'll turn into string.
I liked the idea the first time I heard it - back when it was called Project Gutenburg. :P
...that we don't?
It seems to me that they're throwing money at an unnecessary application. Does Yahoo know something that we don't? I'd venture that they're starting with PD books to shake the bugs out of their platform so the app works well in round 2.
Round 2 (current commercial books) won't occur without a massive copyright law change or support of the Author's Guild.
Hmm.
16k ebooks to choose from today, more to come, no Google, no Yahoo.
http://www.gutenberg.org/
I almost panicked after seeing we had gone so long without a Google-related article.
The opt-in rather than opt-out strategy is really what Google probably should have done, but it'll be interesting to see who comes out as a winner, Yahoo or Google, in all of this.
In the US, books published after 1922 can still be public domain if the author was American, it was originally published in the US, and the copyright was not extended at the end of the original copyright period. Google Library does not seem to be making an exception for this, will OCA? Project Gutenberg does.
Actually this won't "Upstage" google in any way.
FTA:
all the content will be made available so it can be indexed by all the other major search engines, including Google's
Yahoo is just going to scan, scan and scan. We all already prefer google's indexing and searching and cleaner interfaces, so the only thing Yahoo! will accomplish by this is help google print along, sheilding all (other) copyright law suits. Once the stuff is online, we all know that Google-bots will be all over it "like a fly on a pile of very seductive manure (Zapp)"
Excellent.
I just hope publishers realise that in this case neither google or yahoo is trying to be their best friend.
Will Yahoo provide sorted or unsorted lists of books that China's Internet uses view to the thugs that run China?
Seems like the crucial difference between Google's efforts and the OCA(Open Content Alliance) is that Google has a "opt-out" policy for copyrighted material, while OCA specifically requires the copyright holder to contact them and essentially allow them to use the material.
The OCA likely won't be sued by the Writer's Guild like Google, however, for searching material Google will likely be better being that Google's search will likely include a massive plethora of copyrighted material, legal or not. Also, it seems that Google themselves will be allowed to use all the material from the OCA into their project as well.
Why can't companies come up with some cooler ideas? Why ape each other? First Google and hten Yahoo, Sure MS will also want to play.
Scott McNealy to Michael: "Suck my Sun!" Michael Dell to Scott : "Lick my Dell!"
There's a slight difference between an 'Internet-based library' and 'searching inside books'.
Man is a slave because freedom is difficult, whereas slavery is easy.
The fact that it's an open, documented format?
Adobe has made their money the old-fashioned way, by making tools that work well, rather than by locking people into a format. GhostScript, among others, will read those PDF's with or without Adobe.
This next song is very sad. Please clap along. -- Robin Zander
Google Print's goal is to allow people to search book content, WITHOUT giving them the content of the book.
For example, searching "Zoroastrianism" would return a list of book titles on the subject, and links to purchase the books in question. You CANNOT download the content of the book!
The OCA (The group Yahoo just joined) is an opt-in, full content hosting project.
Searching "Zoroastrianism" would return a (much smaller) list of books, with the *full* content of the book available for download with the explicit consent of the publisher/author!
You will be reading the content to Moby Dick on Yahoo and in the top right it will say, "content provided by Google."
Click here or here.
I hate to see a University pander to commercial interests, while at the same time, welcome commercial interests such as Yahoo. Money talks, and I'm sure UC is being paid a lot, but libraries are supposed to be public resources too, not exclusive profit-centers :-(.
I am getting tired of the big internet companies straight up copying each other.
Should we turn to you to tell us which provider of each major online activity is the one we should all use? Even if the differences are incremental and subtle, I'm glad when I get to choose between Yahoo's and Google's take on a particular app/service. I'm also glad that Audi and Toyota and GM and Honda all have different ideas on cars... even though someone else built one once already. Come on - not every service offered is going to be wholly unique, and shouldn't be. It's competition - for eyeballs, brand loyalty, etc. Same reason there are a zillion Linux distros, even though may overlap. Everyone's got their own idea of what would make it just a little bit better.
Don't disappoint your bird dog. Go to the range.
You must not be a true /.er because you know that if you were you would read up on every bit of documentation about anything that we do....Like how we alway RTFA...errr....wait, scratch that
Does anyone else find there is no way to read a PDF with the scroll buttons (mouse wheel, etc.) without the viewer constantly breaking your flow by jumping to the next page?
This goes along with the concept that for an electronic format, I do NOT need a sentence (or even worse, hyphenated word) broken up by two inches of top and bottom margin filled with page numbers, miscellaneous watermarks, repetitive titles, etc.
PS. This being flamebait does not make it false.
Google maintains its scanning represents "fair use" allowed under the law because it only allows Web surfers to view excerpts from copyrighted books.
Soon after Google Mail was introduced, somebody created a SourceForge project that lets you use Google Mail as a database. How long until somebody releases a "Bookripper" app that assembles a whole book from search extracts? As I understand it Google displays two pages at a time (or wait, that's Amazon, but I bet they're similar). All you would need to know is a quote from a book's first page as a seed, and you should be able to grab the whole book by doing a series of searches using text from the second page returned by each search. The trick would be to knit the pieces together and eliminate the overlapping text. Seems almost trivial. Another possibility would be to search for random words and look for overlaps between the results, assembling them like a linear jigsaw puzzle until there are no gaps.
Now this is a right step towards making book contents searcheable online. I will hate to see one company like Google copying and caching all books in its massive cluster of servers. I know that Google kool-aid that "we are about general good" is running deeply in the veins of slashdot types.
Since when was scanning books from libraries and making them available to public for a profit was considered "fair use"? This kind of stuff is done by pirates. Go to the major cities in China and India and you will see piles of copied book in the streets all sold for 1/10th the original price without giving anything back to the authors. The pirates can say that they are doing a favor to the authors by driving them out of obscurity.
The message the alliance is sending out to the authors is
- we are not for profit
- we will scan your book only if you want us to do so
- your book will be indexed based on your approval and copyright agreement with you and the publishers
Compare this to what Google is telling the authors- we will scan your book, fill a form and tell us if you don't want us to do so
- we will take sale comissions from amazon, buy.com, bn.com, etc. without sharing anything with you
- if we show ads, we will share the profits with you
- we will show excerpts of your book, so if a researcher is researching on a topic he can find what you have written about a topic without ever having to buy your book, too bad, heh heh, write a fiction book dude
- we will cache your book in our servers and only we will reserve the right to profit from your scanned book
So much for do no evil. Kudos to yahoo for bringing the open content alliance, gutenberg, and other similar projects to limelight - these are some really nice collections that were hidden by the noise created by 'google print'.I've read through the first few posts, and people really don't have a clue about what this is all about. "Open Content Alliance"... It means what it says. Open f'ing content. Let there be content available to the masses... Is it more important that I can get a snippet from some copyrighted text, or that millions of children can read Alice in Wonderland with all it's wonderful illustrations.
This is beyond PDF or anything like that. Some people want PDF, so Adobe will make them. Some people want decent OCR versions, perhaps to go into Distrubuted Proof readers or into someone's text-only PDA. It's ALL possible. This is NOT an exclusive club, it's an INCLUSIVE community that is dedicated to Open f'ing Content.
Why don't you people get it. By allowing people to have full texts of some of humanities greatest works we are doing more than a few snippets of the latest Ken Follet novel... a lot more.
It's bigger than Yahoo or Google. Yahoo is NOT an also-ran.... The Internet Archive has been scanning books and hosting Milloins Books project texts as well as Project Gutenberg texts for a long time... long before Yahoo or even Google were in the picture. Ignorant comments made here suggest somehow Yahoo is following.
I say Yahoo is leading by embracing a project that by definition is bigger than themselves. Good for them.
PDFs of "public domain" or donated works will always be available. Amazon has gotten enough sh*t about the excerpts that they publish to entice the reader to buy the book. Google "e-book" and you'll see Yahoo! is nowhere near the only source. There is even an open-source e-book idea at Open eBook - http://www.openebook.org/ -- Information on the publication specification for electronic books that will allow compatibility between different e-book devices.
I just wonder how Yahoo! will make $$$ of this very small market of public domain works, or if they DO get repro rights to other books what the price model is to download them, or will you just see advertisements in your e-books? The authors are not going to give up their $$$ nor is Yahoo so somebody is going to have to pay for this content.
"Does anyone else find there is no way to read a PDF with the scroll buttons..."
... regardless of the application and platform used to create it." Blame the creators of that particular pdf file if you don't like the headers, footers and margin size. When I make pdf books to read on the train...I just finished Dream Quest of Unknown Kadath by Lovecraft...I open the original ascii text file in Word, make the top & bottom margins tiny, change the font to something tolerable and export it.
No. I just set it to Continuous. See those four icons in the lower right corner? (assuming you've got a recent version) Play with those. You want the second button from the left
"This goes along with the concept that for an electronic format, I do NOT need a sentence (or even worse, hyphenated word) broken up by two inches of top and bottom margin filled with page numbers, miscellaneous watermarks, repetitive titles, etc."
Well, the whole purpose of PDF is to "preserve the look and integrity of your original documents
When U.S. works pass into the Public Domain is a good summary of the U.S. issues.
Me, I just want 14+14 back.
Hey, wow, that is completely original. Nobody else could have possibly thought of this idea before.
Actually, I prefer plain txt to pdf if I'm reading from a computer (assuming the book is not illustrated), since I have more control over fonts and colors (and I have read quite a few gutenberg books that way). However, I think the best native format (despite its general user-unfriendliness) would be latex, from which txt, pdf, and html could be generated. On the other hand, I suppose it's much easier to generate txt or pdf from scanned pages than latex.
"very few new features come out"
Have you seen Google Earth?
How about the disaster wiki that went together in about 20 minutes, where people were posting status reports of New Orleans properties?
I think you're damning with faint praise. Google, at least, consistently builds superb offerings, and the price is right. Not quite sure what you're grousing about...
Why yes, I AM a rocket scientist!
Yes, it is.
If you don't know where you are going, you will wind up somewhere else.
do you have a source for this? do you mean that a UC library tried to stop someone from checking out books and scanning them? or do you mean that they didn't allow the gutenberg folks to setup a scanning shop inside a library? there's a huge difference between those two.
i work at a UC library, and i've certainly never heard of any policies about project gutenberg. i'm not sure what kind of arrangements yahoo made, where the scanning is going to happen, etc. but i would imagine that yahoo agreed to (at least) cover the expense and hassle of any library facilities they're going to be using. project gutenberg might not have that kind of funding.
this is all assuming that this was involving public domain books, where the only leverage that UC libraries would have would be their facilities and lending policies. if you're talking about stuff that UC owns the copyright to, then that would be another kettle of fish. it would not surprise me to learn that a campus counsel or some such wouldn't let a library give away rights to content that UC held the rights to (like a library's special collections holdings).
-esme
I do see your points as well, and definitely there will be demand for commercially produced books for some time to come.
However, what I described does not require any folding and binding takes all of about 10 seconds. I've done this more than a few times and it does work out well.
I have a Brother laser printer that cost about US$300. I bought this printer for other reasons, but it is a great book printer too. (Has a duplexer, supports both PCL6 and PS3, built-in standard 10/100 LAN port. Basically it will work on any OS that supports PS or PCL6.)
Anyway, it prints duplexed pages at about 16ppm and the toner is cheap. The Windows driver also lets me easily (one click) print two pages onto one side of a sheet. The result of all this is that I can print a 300 page book perfectly in under 5 minutes using only 75 sheets of A4 paper. I then apply two of those triangular binding clips (the ones with the fold in handles), and it's done!
Total cost of around US$1 including the clips, and total time of about 5 minutes. It's not as pretty as a bound paperback but I'm willing to trade that off for the instant availability and the ability to reprint again any time if needed.
(The fact that I live in Japan definitely plays some role in my choice. English books here are very expensive and only available from major downtown bookstores -- and even then selection is pretty limited. Ordering from Amazon Japan (or US/UK) is possible, but the shipping increases the prices and takes time. A $1 five minute book is a dream!)
Some people are like slinkies--basically useless but they bring a smile to your face when pushed down the stairs.
Here's something Michael Hart wrote about this today. He's
the founder of Project Gutenberg, and inventor of eBooks.
-- Greg
Yet another consortium of multi-billion dollar institutions
has thrown its hat into the eBook/eLibrary ring today, just
9 months before the 35th Anniversary of Project Gutenberg's
placement on the Internet of the first eLibrary element, on
July 4th, 1971.
Last December 14th Google used a multi-million dollar blitz
of television, radio and print media to announce the Google
Print revolution: "Today is the day the world changes," but
so far it has been difficult to get even a handful of books
from their project, some 10 months later.
I am wondering of the news media will give the same kind of
coverage to a second such announcement, which will also put
up an alliance of an Internet search engine giant with some
multi-billion dollar libraries. I will be watching all the
news programs tonight in eager anticipation, as I was doing
last December, but I fear that "once burned/twice cautious"
might take some of the wind out of their sails/sales.
However, this effort has one huge advantage: "The Internet
Archive," run by my friend Brewster Kahle. Brewster is one
person who has a proven ability to put an enormous resource
on the Internet for the whole wide world to use.
This different is such that I am willing to bet that Yahoo!
gets off to a better start in the next 10 months than did a
rather completely false start by Google.
Of course, the real test will be to see how long it takes a
project such as this to reach a million eBooks, since there
are already well over 100,000 eBooks already available free
for the taking on various Internet sites, perhaps 50,000 of
them from the various Project Gutenberg sites.
Here's a hope that a few years from now anyone can have the
advantage of a million book home library, and in even a few
years more to ten million books sitting on one inch of your
own bookshelf next to your computer.
Michael S. Hart
Founder
Project Gutenberg
Huh? Where are you from? I worked at a research library at a large state university, and I have no idea what you're talking about. True, libraries pay extortionate rates for journal subscriptions, but when they purchase monographs, they frequently get them off the used book market, just like you or I would. It costs them extra to get it bound in a durable fashion, and to enter it into their Byzantine catalog system, but I've never, ever heard of libraries having to pay extra for books simply because they were libraries.
Also, ongoing royalties? What country does that happen in? I've never heard of such a thing.
Laws do not persuade just because they threaten. --Seneca
Indeed. It's bothered me for some time now that it takes a good deal of doing to make a nice LaTeX edition of the book, so that it's nontrivial to go from the eBook to a really high-quality printed page.
Luckily, someone's decided to do something about it. See PGTEI, a very verbose and flexible method for marking up literary works. The full TEI spec is gargantuan, so PGTEI is actually a dialect of a subset called TEI Lite. It's an XML markup scheme which has output filters (it uses XSLT, it seems) for plain vanilla TXT (for longetivity, and on general principle), HTML and PDF. (Probably some others as well.)
You can try it out yourself. Grab some examples, and run them through the online tools.
Post-processors are very set in their ways, but as I've recently joined their ranks, I hope to use PGTEI for my first post-production job. It certainly seems more elegant than generating and tweaking multiple formats by hand.
Laws do not persuade just because they threaten. --Seneca
I remember seeing some of Dudeney's puzzles referred to before, but I couldn't remember where. Then the book popped up on my RSS feed (it was released within the last month, I think), and indeed, it was full of fun math puzzles. Man, that was nice.
But they don't just have HTML; see various examples of files released with filetype "TEI", including PDF (through LaTeX), TXT (in a variety of encodings, i.e. Latin-1, US-ASCII and UTF-8) and HTML.
Laws do not persuade just because they threaten. --Seneca
The library can require a legal agreement to view or scan the book, and that is where a lawsuit can occur. Of course, the legal agreement doesn't apply to 3rd parties that haven't signed. It's another example of the erosion of the public domain--it's not just Disney and the music industry that's doing it folks--it's the University of California and other libraries.
would not surprise me to learn that a campus counsel or some such wouldn't let a library give away rights to content that UC held the rights to (like a library's special collections holdings)
So in other words, the public domain is locked away. The PD consists of OLD books, which are largely in special collections.
Here's some policies I digged up. It's worse than the policy though. They say write a letter explaining your needs and they ignore you.