Slashdot Mirror


Texas Court Blocks Screen-Scraper

An anonymous reader writes "A Texas court has granted American Airlines an injunction against Farechaser to stop them from using a screen-scraper to copy airfare information from their website in violation of the terms and conditions. In a stunning display of hypocrisy, Farechase.com's own terms and conditions prohibit users from doing to them exactly what they are doing to AA.com. The EFF is involved, but it's unclear whether they're supporting the enforceability of a website's terms and conditions or Farechase's right to violate them."

364 comments

  1. they put it on the web... too bad by Anonymous Coward · · Score: 1, Insightful

    They put their info up on the web.. anyone can do anything they want to with it. Losers.

    1. Re:they put it on the web... too bad by cayenne8 · · Score: 0, Redundant

      I agree. If you put it on the web, it is public domain then...and open to anyone's use! If they don't want people to access it, link to it, or use it for anything...don't put it on the web!!! The web was invented for free distribution of information....it should remain that way.....

      --
      Light travels faster than sound. This is why some people appear bright until you hear them speak.........
    2. Re:they put it on the web... too bad by unitron · · Score: 1

      But if the only way you can get to that page is to click on a button on another page where it says that by clicking on this button to get to any of the rest of our site you agree to our terms and conditions, can you legally or morally click on that button and then violate those terms and conditions?

      --

      I see even classic Slashdot is now pretty much unusable on dial up anymore.

    3. Re:they put it on the web... too bad by someone247356 · · Score: 1

      So I take it you are for bans on "deep-linking"?

      I take you are also pro-EULA.

      That's all that "button" is, the WWW equivalent of an EULA.

      Personally I'm in the pro-deep-linking, anti-EULA camp myself. If they put info out on a publicly accessible website, then within the limits of our ridiculously contorted copyright laws, it's fair game.

      If you check the little blurb on the EFF's site, it appears that the EFF is against it. They said:
      "... relying on trespass to chattels and breach of a browsewrap license." (http://www.eff.org/Cases/AA_v_Farechase/)

      If you look here (http://www.eff.org/Cases/Intel_v_Hamidi/20030311_ eff_pr.php) the EFF writes:
      "The Electronic Frontier Foundation (EFF) filed an amicus brief in the Intel v. Hamidi case, arguing that the lower court distorted the "trespass to chattels" doctrine when applying it to the Internet."

      Apparently AA is also relying on a misappropriation of the "trespass to chattels" doctrine, in this case with regard to the web as opposed to email. If either of these cases succeeds and becomes controlling, then most of the internet as we know it goes down the drain. Websites, email servers, etc. will be regarded as property that you will need to get permission to send to, or link to.

      If you link to a website without permission, such as in the FORD vs. 2600 case (http://www.2600.com/news/display.shtml?id=297) could be found guilty of trespassing. Sending email without getting permission would also become illegal. Heck I can't get the postal service to stop sending me real honest-to-God paper mail, but I could go to jail because I sent you email? That's just nuts.

      --
      Just my $0.02 (Canadian, before taxes)
    4. Re:they put it on the web... too bad by unitron · · Score: 1

      You've made quite an assumption or two about me based on my having just asked a question.

      --

      I see even classic Slashdot is now pretty much unusable on dial up anymore.

  2. It's a sad time by asramchusak · · Score: 2, Interesting

    Legislations, counter-legislations.

    Did the web die suddenly or did it just wither away without anyone noticing?

    --
    Yes, I am a Muslim. No, I am not a Terrorist.
    1. Re:It's a sad time by Anonymous Coward · · Score: 0

      Actually what we are talking about here is more suit, countersuit than legislation, counter-legislations. But either one is better than shot, countershot and bomb, counterbomb. Just ask any school teacher in Baghdad.

      It is a sad, sad time indeed. Especially to be a citizen of the United Empire of America.

  3. Dude, it's their own damn fault... by Eese · · Score: 4, Insightful

    If you are making information available to the public, what right do you have to be angry when someone, *gasp* uses that information?

    1. Re:Dude, it's their own damn fault... by neurostar · · Score: 5, Insightful

      what right do you have to be angry when someone, *gasp* uses that information?

      Well, it's one thing if the people 'using' the information aren't charging for it. I'm not familiar with the circumstances of this particular case. If you are charging for the information you're grabbing then it gets into the grey area...

      neurostar
    2. Re:Dude, it's their own damn fault... by GlassHeart · · Score: 4, Informative
      what right do you have to be angry

      Copyright, that's what.

      Imagine if you write excellent articles, which indirectly pays for your website, and another (probably bigger) website just copies your stuff without paying you or even crediting you.

      The circumstances are not exactly the same, but the law is basically the same. Past fair use (such as quoting a paragraph in a review), you need permission to republish.

    3. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 2, Flamebait

      Such as when I make a book available to the public and someone posts a pdf of it, in entirety? Your statement is so profoundly fallacious that I want to throttle you.

      The question is whether this material can be copyrighted in the first place. The Supreme Court has previously stated that unoriginal composition, such as the numbers in a phone book, can not be copyrighted. Similarly, merely copying the information contained on the airline's website should be permissable, so long as they don't copy the site's design or original texts.

      It's about time that a case like this goes to SCOTUS, so that there is direct precedence for any future cases. Then again, they may end up screwing everything up by ruling for the airline. Especially if any court positions become filled by Baby Bush's nominations.

    4. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 5, Informative

      You cannot copyright figures, numbers, prices, etc.

      Remember Walmart trying to sue over the Black Friday?

    5. Re:Dude, it's their own damn fault... by saddino · · Score: 1

      If you are making information available to the public, what right do you have to be angry when someone, *gasp* uses that information?

      What right do you have? Dude, ever heard of "copy" right?

    6. Re:Dude, it's their own damn fault... by aiken_d · · Score: 1

      It's one thing to make information available to potential customers; it's another to be expected to provide free bandwidth to third parties who aren't potential customers at all.

      You know those free local newspapers? Do you think it would be legit for a company to go take tons of them from free newspaper stands and then pass them out to their customers from another location? It's the same thing.

      Just because I give *you* something for free doesn't mean that I'm obligated to provide it to you in bulk for further redistribution.

      Cheers
      -b

      --
      If I wanted a sig I would have filled in that stupid box.
    7. Re:Dude, it's their own damn fault... by m4g02 · · Score: 1

      If you are making information available to the public, what right do you have to be angry when someone, *gasp* uses that information?

      When you are spending a lot of money and resources to make information available to your vistors, what right do anyone has to steal that information (along with your visitors)?

      Seriously, i like free speach and all but if stealing where legal there wouldn't be anything to steal at all.

      --
      Sigs are for morons... Wait a minute...
    8. Re:Dude, it's their own damn fault... by Breakfast+Pants · · Score: 5, Informative

      Facts are not copyrightable. Airfares are facts. There was a big case between the bells and 3rd party phonebook makers where this was determined to be the case.

      --

      --

      WHO ATE MY BREAKFAST PANTS?
    9. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0
      You know those free local newspapers? Do you think it would be legit for a company to go take tons of them from free newspaper stands and then pass them out to their customers from another location? It's the same thing.

      That's a stupid analogy. Those local free newspapers would love it! As long as they get handed out.

      A better analogy, would be if you pasted over the advertisments first. But analogies are a stupid way to argue anything. Try logic and legal case law next time.

    10. Re:Dude, it's their own damn fault... by Sloppy · · Score: 4, Funny
      Yeah, without copyright protection, what incentive does American Airlines have to ... um .. have prices? (Recycled joke, got me a 5 funny once, I think.)

      What you wrote actually makes sense, since you're talking about the creative act of writing articles. But this story is about prices.

      Pricing information isn't copyrightable. And it shouldn't be, either. It's totally outside the scope of copyright's purpose. Using copyright to inhibit the market's knowledge of prices, is just that: an attempt to subvert the market. It shouldn't be tolerated, except IN SOVIET RUSSIA.

      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
    11. Re:Dude, it's their own damn fault... by Spectre · · Score: 2, Informative

      True, but compilations of facts have been determined to be copyrightable (such as each individual phonebook).

      It is a weird and not entirely logical batch of case law.

      --
      "Flame away, I wear asbestos underwear"
    12. Re:Dude, it's their own damn fault... by GlassHeart · · Score: 4, Interesting
      Facts are not copyrightable.

      The "Copyright Basics" page of the US Copyright Office lists the following as not copyrightable:

      • Titles, names, short phrases, and slogans; familiar symbols or designs; mere variations of typographic ornamentation, lettering, or coloring; mere listings of ingredients or contents
      • Ideas, procedures, methods, systems, processes, concepts, principles, discoveries, or devices, as distinguished from a description, explanation, or illustration
      • Works consisting entirely of information that is common property and containing no original authorship (for example: standard calendars, height and weight charts, tape measures and rulers, and lists or tables taken from public documents or other common sources)
      I don't see how "prices" or "facts" immediately fit in, and I don't have the ability to interpret the actual law, so I'll stop right here.

      In any case, I don't feel too much sympathy for somebody who plucks airfares from airline sites. The accuracy is questionable (unlike a real travel agent site, who can in fact realize the price for you), to say the least.

      If what you say is true, can I just rip off the numbers from, say, Tom's Hardware, and republish benchmarks with my own text?

    13. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0
      It's totally outside the scope of copyright's purpose.

      At least is outside the scope of what the Constitution says is the purpose of copyright. The courts seem to say it's up to congress instead. Congress seems to think the purpose is to increase profits.

      Yes I'm still bitter about Eldred vs. Ashcroft.

    14. Re:Dude, it's their own damn fault... by Jerf · · Score: 1

      I think you've misinterpreted that ruling. Collections of fact can be copyrighted if it passes a creativity criterion. To my knowlege, the phone book is the only thing to fail that criterion to date. That's the really key thing to take away from the case... the creativity criterion is low, low, low. Airline fares require considerably more creativity then setting phone numbers. I'd expect the collection to be copyrightable, especially in the current environment, where I'd bet even the phone book decision could be overturned.

    15. Re:Dude, it's their own damn fault... by Planesdragon · · Score: 1

      Facts are not copyrightable. Airfares are facts. There was a big case between the bells and 3rd party phonebook makers where this was determined to be the case.

      Apparantly, that's the FEIST case from 1996.

      See this document from the LOC and scroll down to section C.

      If a chineese restaurant listing can be copyrightable, so can airfares on a website.

      Of course, to be pendantic, the more important (IMO) aspect of this case is EULAs for web sites.

      IANAL,YMMV,BYOLA.

    16. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0
      Just because I give *you* something for free doesn't mean that I'm obligated to provide it to you in bulk for further redistribution.

      It doesn't mean you can sue me for redistributing it either!

    17. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 1, Interesting

      FYI, the phone book example happened in the Netherlands. The most successful phone book site was sued by the biggest telco (effectively the sole telco for home connections, ex-government) for listing the phone numbers of their customers.
      The telco won, the site had to remove the numbers.

    18. Re:Dude, it's their own damn fault... by smylie · · Score: 1

      In order to enforce this, I understand its standard practise for telephone companies to insert bogus entries into their phone books so that they can catch (and prove) that someone has simply copied their compilation, rather than going out and making their own.

      Map makers do much the same thing by inserting non-existant side-roads onto their maps.

    19. Re:Dude, it's their own damn fault... by Eric+Damron · · Score: 1

      I'll take your word for a compilation of facts being copyrightable.

      So, what I would do if I wanted to be an asshole (which is almost always) is to take the list of all fares, find the average price then post it and the dollar amount above or below the average price for each airline.

      --
      The race isn't always to the swift... but that's the way to bet!
    20. Re:Dude, it's their own damn fault... by Samrobb · · Score: 4, Insightful
      Works consisting entirely of information that is common property and containing no original authorship (for example: standard calendars, height and weight charts, tape measures and rulers, and lists or tables taken from public documents or other common sources)

      Emphasis added. I think you could reasonably argue that the website fell into the category of "public document or other common sources". If they tabulate their data and make it available on the webite - which I'm willing to bet is the case - then it would seem that the US Copyright Office would not conisder the information to be copyrightable[1], unless they're using "public documents" in some twisted legal sense...

      "Your Honor, these documents were available to the public, but they were not 'public documents' as specified in section 10, paragraph 3, subparagraph 6a of Title 3 of the Maleficient Goombah code."

      [1] Is that really a word?

      --
      "Great men are not always wise: neither do the aged understand judgement." Job 32:9
    21. Re:Dude, it's their own damn fault... by Eese · · Score: 1

      I'd probably say that that's all fine and dandy, as long as you have a reference to the source of the numbers.

    22. Re:Dude, it's their own damn fault... by geekee · · Score: 1

      If I recorded and rebroadcasted NBC's transmission available to the public, I think they'd be rightfully angry and sue me, and win. Not that I'm saying you're wrong. I'm just saying you need to make a better case for your arguement.

      --
      Vote for Pedro
    23. Re:Dude, it's their own damn fault... by jedidiah · · Score: 1

      It's not "stealing". It wouldn't even be "stealing" if this information was worthy of copyright. HOWEVER, the fact remains that this information is NOT worthy of copright protection.

      The fact that other people are "stealing" the information is quite irrelevant. It is not property, artificial or otherwise. AA simply has no standing to try and prevent this "screen-scraping".

      Nor should they.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    24. Re:Dude, it's their own damn fault... by carbon+68k · · Score: 1

      It would seem to me that "public document" means things like city, county, state, and federal government documents: titles, public notices, restaurant licenses, land zoning lists, reports, laws, etc.

    25. Re:Dude, it's their own damn fault... by Eese · · Score: 1

      Umm, your book example falls apart... If you made the book available to the public, why should you go care if someone makes a PDF of it, unless you are selling copies of it. You didn't have to pay to see the airfares. If my buddy drives out to the airport, writes down some flight prices, then comes back and tells me the prices, what has he done wrong?

    26. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      Actually, I suspect it would fall under "mere listings of ingredients or contents"

      At least in spirit, anyway.
      Listing prices for people doesn't seem much different from listing ingredients.

      And as for Farechaser's charging for this, they are charging to have assembled the lists of fares from various agencies.

      Now of course, Farechase.com has no right to prevent other people from doing the same.

    27. Re:Dude, it's their own damn fault... by Mawbid · · Score: 5, Informative
      Is that really a word?

      Yes, and its antonym, "uncopyrightable", is the longest word in the English language without repeated letters.

      --
      Fuck the system? Nah, you might catch something.
    28. Re:Dude, it's their own damn fault... by TuballoyThunder · · Score: 4, Interesting
      Not entirely true. Under 17 USC 102(b) facts are not protected by copyright (the EU does protect collections of facts ref). Under 17 USC 103&101 works "formed by the collection and assembling of preexisting materials or of data that are selected, coordinated, or arranged in such a way that the resulting work as a whole constitutes an original work of authorship." White pages are not protected because there is no creativity.

      This is where I go out on a limb because I could not find the citation. I remember reading that the Supreme Court ruled in a case where a map publisher sued another publisher for copyright infringement. The defendant used the plaintiffs map to create a new map. The plaintiff had introduced small errors into the maps in order detect such copying. The court ruled in favor of the defendant on the basis that since it was a new representation, it did not copy the creative aspect of the map. The introduction of errors is not a basis for copyright protection because nobody would ever be able to copy facts.

    29. Re:Dude, it's their own damn fault... by harlows_monkeys · · Score: 2, Informative
      True, but compilations of facts have been determined to be copyrightable (such as each individual phonebook)

      What kind of phone books? The white pages, for example, are NOT copyrightable. This was decided by the Supreme Court, in Fiest vs. Rural Telephone.

      The court agreed with the lower courts that putting together a phone book was a lot of work, but decided that the Constitution requires that there be some creativity, and "take the names of everyone with a phone and put them in alphabetical order" doesn't count.

    30. Re:Dude, it's their own damn fault... by Mitreya · · Score: 1
      You cannot copyright figures, numbers, prices, etc. Remember Walmart trying to sue over the Black Friday?

      My memory is a bit hazy, but I remember that Walmart was able to scare a lot of people into removing the listings (or all of them even). That lasted until the Black Friday was over. What I don't remember is Walmart being slammed for a frivolous lawsuit. So this seems like a good method of delaying and scaring people...

    31. Re:Dude, it's their own damn fault... by rusty+spoon · · Score: 1

      If the terms and conditions that AA has granted prohibit the Farechaser "use" then what is there to discuss.

      It's not even a complex idea. You can view the AA web site so long as you don't take any of the information (using a screen scraper) to republish elsewhere. That's the deal. Don't like it? Go elsewhere, your freedom of choice hasn't been affected.

      Seems pretty open and shut to me.

    32. Re:Dude, it's their own damn fault... by dracocat · · Score: 1

      Facts are not copyrightable --parent's parent

      I don't see how "prices" or "facts" immediately fit in --parent

      Copyright protects the particular way an author has expressed himself; it does not extend to any ideas, systems, or factual information conveyed in the work. --FL102

      You cannot copyright facts. It would be like copyrighting the temperature today. The first one to publish it could then claim the rights to it.

      Instead, the argument will be that the EULA that they automatically agreed to, and never saw forbids screenscraping.

      I for one would like to see an end to contracts that don't even require me to click on an 'I Agree' button. I can't see how I am bound to a contract because I loaded a webpage. Logging in and clicking agree... maybee. But doing a GET to an HTTP Server can't be the same as Agreeing to something.

    33. Re:Dude, it's their own damn fault... by webmaestro · · Score: 2, Interesting

      I have seen many times, for instance on BestBuy.com and Amazon.com, where the manufacturer has restricted the posting of prices for their merchandise. If Amazon or BestBuy sets a price for a companies product that is below the minimum advertisible price, then they can't show it to the public. They can only tell you the price once you show intent to purchase, such as placing it in your shopping cart.

      The point is manufacturers do have control over what happens with their pricing. I'm not sure if this is entirely applicable to this case, but it is something to look at.

    34. Re:Dude, it's their own damn fault... by seanadams.com · · Score: 2, Funny

      copyrightable[1]
      [1] Is that really a word?


      Perfectly cromulant in my book.

    35. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      If my buddy drives out to the airport, writes down some flight prices, then comes back and tells me the prices, what has he done wrong?

      Well, nothing. Even if the prices were copyrightable, that would be a fair use.

    36. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      Your pop-culture reference embiggens my penis.

    37. Re:Dude, it's their own damn fault... by BollocksToThis · · Score: 1

      I for one would like to see an end to contracts that don't even require me to click on an 'I Agree' button.

      I would like to see an end to all contracts that don't involve my signature before paying. Clicking a button on a screen indicates nothing - a two month old baby could do that merely via muscle spasms; there is no guarantee of WHO clicked that button.

      I'm pissed off that I can pay $50-$1000 for a boxed piece of software, open it up, and find out the publishers want to try and make further demands, now that they have my money.

      And of course, we all know how every store and publisher treats the idea of opened software returns. It's a racket, and there's NO REASON a click-license should be upheld, in any situation.

      --
      This sig is part of your complete breakfast.
    38. Re:Dude, it's their own damn fault... by 0x0d0a · · Score: 1

      Very well said.

      Our economic models of free markets that show free markets always working for the consumer depend very much on the assumption that the consumer has perfect information about the product. The more you diverge from that, the less free markets tend to produce better products and services.

    39. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 1, Insightful

      Facts ARE copyrightable when they are time-sensitive in nature.

    40. Re:Dude, it's their own damn fault... by 1u3hr · · Score: 1
      The point is manufacturers do have control over what happens with their pricing.

      They certainly want that, and in cases where they have contracts with their distributors they may be able to enforce that; but in general they have no legal right to do so, much less prevent people from distributing such information.

    41. Re:Dude, it's their own damn fault... by 1u3hr · · Score: 1
      . If you made the book available to the public, why should you go care if someone makes a PDF of it, unless you are selling copies of it.

      Making something freely available is not the same as putting it in the public domain or relinquishing copyright (after all, variations on this are what the GPL is all about).

      Copyright is not solely about money.

    42. Re:Dude, it's their own damn fault... by Zork+the+Almighty · · Score: 1

      If you are charging for the information you're grabbing then it gets into the grey area...

      I don't think so. You're charging for a service, really. The service of going and getting that information, possibly from many sources. If it weren't for the bandwidth costs, I doubt anyone would even care.

      --

      In Soviet America the banks rob you!
    43. Re:Dude, it's their own damn fault... by neurostar · · Score: 1

      I don't think so. You're charging for a service, really. The service of going and getting that information, possibly from many sources. If it weren't for the bandwidth costs, I doubt anyone would even care.

      It's ethically ok, as long as you have permission to charge for information 'scraped' from other websites, and as long as you're giving credit.

      I'd be unhappy if someone was getting news stories off my site, charging for them and not giving me credit. Because I'm going to all the hard work and not recieving any credit.

      I'll give you the benefit of the doubt as to this specific incident because I'm not exactly sure of the circumstances, or the copyright issues (there were some posts indicating that the airfaires aren't covered under copyright law).

      neurostar
    44. Re:Dude, it's their own damn fault... by MrFredBloggs · · Score: 1

      "I'd be unhappy if someone was getting news stories off my site, charging for them and not giving me credit. Because I'm going to all the hard work and not recieving any credit."

      Your happiness is irrelevant. What's important is whether or not it's legal. Seems like it's fair game to me. If sites want to stop this, they should force the user into a contract which obliges them to keep it to themselves. No contract, no deal.

    45. Re:Dude, it's their own damn fault... by walt-sjc · · Score: 1

      Dude, if someone is violating his copyright, he can sue. However, that's not what's going on in the current case. "Fair Use" normally allows for screen scraping, but ADDITIONAL terms and conditions were imposed on users that took away this right. "By clicking, you agree to..."

      The problem I have with this case is that these terms and conditions are too much like shrink wrap licenses where you don't really have the option of negotiation. There is nothing stopping you and asking the company for permission however, and you DO have the ability to see the full terms and conditions before you crawl the site, so it's not quite as bad as a shrink wrap license.

      In this case, I have to side with the judge.

    46. Re:Dude, it's their own damn fault... by TheMidget · · Score: 1
      The introduction of errors is not a basis for copyright protection because nobody would ever be able to copy facts.

      The errors are not facts, and thus actually an expression of the creativity. So, if the defendant had been more careful, he would not only not have been caught, but also compliant to the law (because he would only have copied facts, rather than creative expression).

    47. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      I think you could reasonably argue that the website fell into the category of "public document or other common sources".

      If so, aren't books in a public library also public documents? Nope. Just because the public has access to documents doesn't make them public documents. To be a public document, the document has to be owned by the public (a.k.a., public domain, a.k.a. not copyrighted)--either by expiration, by legislation or by original owner's waiver of rights.

    48. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      Facts are not copyrightable. Airfares are facts. There was a big case between the bells and 3rd party phonebook makers where this was determined to be the case.

      Sports scores are facts. Stock prices are facts. Yet, in similarly big cases, courts ruled that sports scores and stock prices are proprietary information protected as intellectual property for a certain period of time.

      Fascist codswallop, IMHO, but Microsoft proves that billions can be made from fascist codswallop.

    49. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      Pricing information isn't copyrightable.

      Try reporting stock prices in real time without a license. You'll have the SEC, FBI, FCC, and every other TLA breathing down your neck in a matter of nanoseconds.

      In this case, the real problem might be the method used to report the information. For some reason, a human being reading a fact and entering it into a new information system is somehow different than one information system automatically mining another information system. Derives from the difference between sketching something you witness and tracing a sketch made by another witness.

    50. Re:Dude, it's their own damn fault... by Samrobb · · Score: 1
      To be a public document, the document has to be owned by the public (a.k.a., public domain, a.k.a. not copyrighted)--either by expiration, by legislation or by original owner's waiver of rights.

      So... one of the tests to determine if something can be copyrighted is if it is copyrighted? Well, sure...

      In any case - the passage in question refered to lists and tables contained in public documents and other sources, not to any available public document. So that's one place your library analogy breaks down. Another place it breaks down is that the works in a library are already under copyright - there's no need to determine whether or not they are copyrightable, yes? The intent of the rule seems to imply that if you make a list or table of data available to the public - and that list or table of data is the entirety of the work - then it is not something that can be covered by copyright. The organization and presentation of such a list, yes, but not the data itself (as others comments here have pointed out.)

      --
      "Great men are not always wise: neither do the aged understand judgement." Job 32:9
    51. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      What about antidisestablishment?

    52. Re:Dude, it's their own damn fault... by Sloppy · · Score: 1

      That isn't due to copyright. It's due to the stock market being a very special-case highly-regulated market.

      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
    53. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      They can subscribe to the same data sources as American Airliens subscribes to. It all costs money. AA is right that they should not have their data ripped off. Its the same with a sporting event. Just because its broadcast on TV (the airwaves are free, right?) doesn't mean you have the right to do whatever you wish with the telecast.

    54. Re:Dude, it's their own damn fault... by cHiphead · · Score: 1

      the errors are PRESENTED as facts to whomever was viewing the map, they are not presented as a creative element. the defendant had no reason to be careful, they were simply recreating something presented as a fact.

      --

      This is my sig. There are many like it, but this one is mine.
    55. Re:Dude, it's their own damn fault... by Anonymous Coward · · Score: 0

      antidisestablishment has two e's so it doesn't count.

      "uncopyrightable", is the longest word in the English language without repeated letters
    56. Re:Dude, it's their own damn fault... by cHiphead · · Score: 1

      What right do you have? Dude, ever heard of "copy" right?

      For the redunant, 200th time, its meant for creative, original works, NOT facts. In geek terms, you can copyright 'information' but not 'data'.

      --

      This is my sig. There are many like it, but this one is mine.
    57. Re:Dude, it's their own damn fault... by TheMidget · · Score: 1
      When swimming in shark-infested waters, you should always be careful... Intellectual property law is a tricky business, and "submarine" patents are a bitter reality. Just ask Rambus.

      The present case would be a case of submarine copyrights ;-) And besides: the fattest wallet always wins, regardless of any other considerations...

    58. Re:Dude, it's their own damn fault... by cHiphead · · Score: 1

      they arent screenshotting the site, they are parsing data out of it. like watching NBC, writing down the facts of the news yourself, and rebroadcasting it using your own newscast.

      --

      This is my sig. There are many like it, but this one is mine.
    59. Re:Dude, it's their own damn fault... by cHiphead · · Score: 1

      And besides: the fattest wallet always wins, regardless of any other considerations...

      Yep. Whoever can pay their lawyer the most wins. Unless defendants lawyer sees the case as a real certainty to get fees from the plaintiff. Its disturbing to know just what goes on behind the scenes with attorneys.

      --

      This is my sig. There are many like it, but this one is mine.
    60. Re:Dude, it's their own damn fault... by someone247356 · · Score: 1

      The broadcast would be copyrightable, but they couldn't stop someone from using the score of the game they are broadcasting anyway they wanted, just because a television station broadcast it.

      The broadcast of the sporting event was a creative work. The fact that team A played team B at arena X on a certain day, and team A lost to team B by Y points are facts and therefore are fair game.

      --
      Just my $0.02 (Canadian, before taxes)
    61. Re:Dude, it's their own damn fault... by ernietheattorney · · Score: 1

      The "phonebook" case from the US Supreme court was called Feist and it's available here http://caselaw.lp.findlaw.com/scripts/getcase.pl?c ourt=us&vol=499&invol=340 And it did recognize that "facts" are not copyrightable

  4. Texas court decision? by Hayzeus · · Score: 4, Funny
    A Texas court has granted American Airlines an injunction against Farechaser

    The article also fails to mention that Farechaser was sentenced to death by lethal injection in the same decision...

    1. Re:Texas court decision? by Anonymous Coward · · Score: 0

      pls take an html clas thx

    2. Re:Texas court decision? by Anonymous Coward · · Score: 0
      pls take an html clas thx

      I did - regrettably, it was held at the same place that taught you to spell...

    3. Re:Texas court decision? by Anonymous Coward · · Score: 0

      pls dont make fun of spelin thx

    4. Re:Texas court decision? by merlin_jim · · Score: 3, Funny

      Wouldn't that more appropriately be:

      The article also fails to mention that Farechaser was sentenced to death by legal injunction in the same decision...

      --
      I am disrespectful to dirt! Can you see that I am serious?!
    5. Re:Texas court decision? by Anonymous Coward · · Score: 0

      Doh! How could I have missed that one?

    6. Re:Texas court decision? by Anonymous Coward · · Score: 0

      Doh! How could I have missed that one?

      You made a lethal induction?

    7. Re:Texas court decision? by Darth · · Score: 3, Funny

      > The article also fails to mention that Farechaser was sentenced to death by lethal injection in the same decision...

      they fell victim to a rarely used section of the "he needed killin" clause.

      in Texas, it's ok to pop somebody as long as "he needed killin"

      --
      Darth --
      Nil Mortifi, Sine Lucre
    8. Re:Texas court decision? by commodoresloat · · Score: 1

      The coolest thing about Texas death row is that the last meals of all the condemned are published on the web. It's amazing how much junk food is on that list too....

    9. Re:Texas court decision? by Ryan+Amos · · Score: 1

      Hah, this is more true than you realize.. In Texas, it is legal to shoot a man in the back as he flees from robbing your house. Also, supposedly (this is probably just a stupid urban legend) people hunt "border jumpers." In other words, shoot them in Mexico from Texas. Like I said, it's probably an urban legend, but I wouldn't put it past Texas (and I live there :P)

    10. Re:Texas court decision? by tgma · · Score: 1

      Why is it amazing? Surely this is the one meal in your life where you needn't worry about the health consequences? Myself, I would choose an immortality pill for my last meal, but there's probably a rule against that.

    11. Re:Texas court decision? by Darth · · Score: 1

      i live in Austin, actually.

      The border jumpers thing is probably an urban legend. I've lived in texas since i was 6mo old and i dont recall ever hearing about that from a reputable source.

      --
      Darth --
      Nil Mortifi, Sine Lucre
    12. Re:Texas court decision? by beowulfcluster · · Score: 1

      I wonder if Barnes, Jr. Odell, who requested "Justice, Equality, World Peace" was served the meal he requested.

      Damn, I felt uncomfortable reading that list :(

    13. Re:Texas court decision? by stanmann · · Score: 1

      The border jumpers thing is half an urban legend. It falls under the same "he needed killin" law as shooting a fleeing robber. Basically, as I understand it, If you shoot someone who is trespassing on your property, you cannot(typically) be found guilty of anything.

      --
      Food not Bombs is a nice platitude but it breaks down when you notice that the Bombees are usually well fed
  5. EFF by fredistheking · · Score: 1

    I would hope they would be supporting our right to copy information that is made public. Is their position really that ambiguous?

    ---

    1. Re:EFF by atta1 · · Score: 1

      From looking at the link to their website, I'd say they aren't taking a position.

      --
      "The avalanche has already started. It is too late for the pebbles to vote" -- Kosh
    2. Re:EFF by www.sorehands.com · · Score: 1
      I would hope they would be supporting our right to copy information that is made public.

      They should not be any information made publicto be freely copied. Are you saying because a book that has been made public, one you can copy the book and then sell the copies.


      This is not the first case of its kind, the first circuit court of appeals have upheld similar on another case EF CULTURAL TRAVEL v. EXPLORICA, INC

    3. Re:EFF by Sloppy · · Score: 1
      Is their position really that ambiguous?
      I'll never forget their position on Microsoft "Smart Tags." That's when I realized I didn't understand EFF anymore. The very idea that a web browser displaying a page "incorrectly" could possibly be copyright infringement... *sigh*
      --
      As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
    4. Re:EFF by tomhudson · · Score: 1

      A novel, or a reference work is more than just a collection of prices. The book can be copyrighted. But just a price list? Nope!

    5. Re:EFF by prowley · · Score: 1

      I think you will find that that has more to do with creating derivative works.

    6. Re:EFF by sfe_software · · Score: 3, Interesting

      I'll never forget their position on Microsoft "Smart Tags." That's when I realized I didn't understand EFF anymore. The very idea that a web browser displaying a page "incorrectly" could possibly be copyright infringement... *sigh*

      This was no simple case of "incorrectly" displaying a web page. This was a case of intentionally modifying the text of a potentially copyrighted work, providing links to some external site.

      In my opinion, and obviously many others (since it seems to have gone away on its own anyway), what they did was sneaky and wrong, not unlike many similar spyware programs.

      As for this case, hm, I'm not sure exactly where I stand on this. I kinda want to say that, copyright aside, just the fact that they took the time to compile the list, and are making it available *to their visitors*, makes it wrong to just copy the data and post it on your own site. But, then again, I'm not sure. It's a tough one...

      --
      NGWave - Fast Sound Editor for Windows
    7. Re:EFF by Anonymous Coward · · Score: 0
      Price lists, in and of themselves, cannot be copyrighted. However, there presentation can. For instance, you ever go to a diner that has those "In the year 1912, you could buy":
      • A 2 bedroom house for $500
      • 1 dozen eggs for $.02
      • 1 gallon of milk for $.05


      sections? That list is not copyrightable. However, the context of the list (ie: this post) is, and the presentation is (12 point comic font with frilly laced border, for example).
    8. Re:EFF by tomhudson · · Score: 2, Interesting

      Wanna see something stupid up in Canuckistan? Our post office is suing a company that makes StrongPost, claiming that the post office owns the word "Post". So much for Post cereals, Post-It Notes, etc. Now THAT's stupid

    9. Re:EFF by unitron · · Score: 2, Funny
      Well if the Canadian Post Office owns the word "Post" then they must own the word "Office" as well. With the right lawyers they could wind up owning Microsoft :-)

      Oh yeah, from now on, they get a nickel every time you buy Canadian bacon, too.

      --

      I see even classic Slashdot is now pretty much unusable on dial up anymore.

  6. Legal implications? by grammaticaster · · Score: 4, Insightful

    Fortunately, American isn't basing their case on the idea that their prices are their "intellectual property," but instead are claiming that Farechase was trespassing on their chattel. I wonder if the decision on this could effect cases involving DoS attacks?

    1. Re:Legal implications? by He+Was+Gamecubed · · Score: 1

      I wonder if the decision on this could effect cases involving DoS attacks? Maybe it's time to change your handle :)

    2. Re:Legal implications? by grammaticaster · · Score: 1
      Ah, geez ... I always get that one wrong. I knew I should have looked it up.



      However, that only reinforces the propriety of my alias. OED defines grammaticaster as:

      A petty or inferior grammarian. (Used in contempt.)

      So we're both wrong.
    3. Re:Legal implications? by Anonymous Coward · · Score: 0

      I would think the argument that what Farechase did was trespass would be pretty weak (especially since chattel typically refers to the physical abode or dwelling place). Since the site itself is public, pending agreement to AA's Terms of Service, the argument is that Farechase implicity agreed to the TOS by making use of the site, putting this in the realm of contract law.

      Since accessing the site itself is permitted, there should be no validity to a claim of trespass.

      As for the laws governing DOS attacks, you are right that were this governed by trespass, there would be liability for "vandalism to computer hardware or software" (_Smith & Roberson's Business Law_). However, that liability is already quite well established, and needs no further precident. Additionally, there are a few Federal criminal statutes specifically geared towards this (notability the Counterfeit Access Device and Computer Fraud and Abuse Act).

      So in sum, it is unlikely that this would affect, or effect, cases involving DOS attacks, and I don't really understand why AA would bring suit under trespass rather than violation of contract (though the contractual agreement is implicit in the use of the site rather than explicit, I suppose). Alas, I am a bit too busy to actually read that boring injunction plea, so I have to take your word on that being what AA did.

      And, is grammaticaster really in the OED? Sheesh.

      N407ER

  7. Screenscrapers and the Law by aridhol · · Score: 5, Interesting
    OK, Was going to Ask Slashdot this, but since it's already sorta on topic...

    My employer has "requested" that I write a screen scraper to grab information from a competitor's site. The data will then be put into our databases, and sold as our own. This is in violation of the competitor's terms of agreement, and I have thus far not done this.

    I am unable to find anything on Google relating to the legality of this, but I believe that it is probably not legal. However, I was told to "do it and let the lawyers deal with it".

    Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

    Does anybody know where I can read any case law on screen scraping? Aside from the current article, that is.

    --
    I can't say that I don't give a fuck. I've just run out of fuck to give.
    1. Re:Screenscrapers and the Law by antis0c · · Score: 2, Informative

      If its criminal law, which it might be under the DMCA, an employer can't force you to do it. It's a basic employment right. Just like your employer can't fire you because you refuse to dump toxic chemicals.

      Civil though, I have no idea...

      --

      ..There's a-dooin's a-transpirin'
    2. Re:Screenscrapers and the Law by Griffin518 · · Score: 1

      I'm guessing this is completely illegal... based soley on the fact that your company is (as described) a direct competitor of theirs. It's like on band taking a song from another, changing the pitch of one note, and re-selling it. IMHO I think it matters greatly whether or not the company "using" the information is profiting off of it. While the company above may profit slightly from it (ads/etc), they aren't in direct competition with AA.

    3. Re:Screenscrapers and the Law by Telastyn · · Score: 5, Informative

      ianal; Court cases have held in the past that if the information is held on a public site, it is public, despite any agreement to the contrary. That information if under copyright, still is held by those restrictions (and rights).

      If the information is in a restricted site, (must register to access) Then it is not public, and the agreements are generally held in more cases. If anything courts have been leaning against screen scraping, even on 'public' sites.

      findlaw or the cornell law site likely has information regarding this. There's also been past /. articles.

      It's of questionable ethics, but I also don't see how you're company will be able to sell something that people can get for free elsewhere. (And if it is not free, the courts are much less likely to side in your company's favor)

    4. Re:Screenscrapers and the Law by jazman_777 · · Score: 5, Funny
      Does anybody know where I can read any case law on screen scraping? Aside from the current article, that is.

      You've come to the right place, pardner. While none of us really _is_ a lawyer, each of us is more than willing to pretend.

      --
      Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
    5. Re:Screenscrapers and the Law by geekoid · · Score: 4, Insightful

      if it is un-ethical to you, then why does the legality matter?

      You could send an anonymous letter to your companies lawyers, boards of directors, and CEO.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    6. Re:Screenscrapers and the Law by DonkeyJimmy · · Score: 4, Interesting

      Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

      well, if you like your job, don't leave the company, just refuse to do it (make it clear that you are not doing it no matter what). They may not fire you just to avoid the embarassment, and if they do, you may have grounds to sue if you want (assuming it turns out to be illegal). My guess is they'll hire someone else to do that and you'll not have to touch it, but keep you on for everything else.

      I was in a similar situation once, except they were just demanding that I work 60+ hrs a week. I refused and they gave me a severance package I wouldn't have gotten had I quit.

      --
      "Probably the toughest time in anyone's life is when you have to murder a loved one because they're the devil." -Philips
    7. Re:Screenscrapers and the Law by CommieLib · · Score: 4, Insightful

      It sounds like you already know everything you need to know. Now you simply need to summon the courage of your beliefs.

      You may be fired because of your beliefs. At that point, you just have to decide which is more valuable: your beliefs or your jobs (hint: your beliefs are). On the other hand, your boss may simply be having a weak moment in his own beliefs. You ought to try to talk to him about this, and not in a self-righteous way. Try to make the case that you can't build a successful company or a successful life without character. Your company and your own bank account might prosper in the short run, but eventually the way the universe works catches up to you...even if it's not before you die.

      At any rate, it sounds like you've got the right tickets to begin with. Good luck.

      --
      If your bitterest enemies are people who hack the heads off civilians, then I would say you're doing something right.
    8. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      talk to the lawyers at your company's legal department. They have lawyers, right ?

    9. Re:Screenscrapers and the Law by Hal_9000@!!!@ · · Score: 4, Interesting

      IANAL!

      It sounds like your company wants to break not just the terms of service, but possibly copyright laws.

      As a rule, your employer is barred from forcing you to break the law. If they fire you from refusing in good will to break the law, you can sue them for not only back wages but punitive damages. A great article on this subject by Eben Morgan in Linux Journal called "My Boss Made Me Install Warez" should help with the specific details, some of what I said is probably wrong.

      Obviously, you should seek counsel or at least tell your employer you intend to. They may decide to back down.

      Once again, I am not a lawyer.

      --
      My email is real.
    10. Re:Screenscrapers and the Law by no+soup+for+you · · Score: 2, Interesting
      If its criminal law, which it might be under the DMCA
      Only if it's encrypted, so be sure to download the html on port 80 and not 443.
      --
      If you blog it...
    11. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      hi gandalf.

    12. Re:Screenscrapers and the Law by AndroidCat · · Score: 0, Redundant
      Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

      If you do leave, could you email me the name of the company, thanks! :^P

      --
      One line blog. I hear that they're called Twitters now.
    13. Re:Screenscrapers and the Law by anonymous+loser · · Score: 1
      Forget the TOS dude! If your company resells it as their own, their violating that content's copyright.

      Not if it is factual information, as supported by the classic supreme court decision of Feist Publishing vs. Rural Telephone Service Company, which held that facutal information cannot be copyrighted.

    14. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      You can't copyright data. It was only a recent law/ruling that allows databases to be copyrighted. And even then, all you have to do is add some more "value" to the data and it's yours.

    15. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0
      also don't see how you're company will be able to sell something that people can get for free elsewhere.


      So, you agree with the RIAA, then?

    16. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      RSS.

      Stands for Really Simple Syndication, it allows sites no nab headlines off of each other and such. It's a bit complex to set up _but_ the websites that could use it legitimately are either a) proper corporate sites or b) nerd blogs, so that doesn't matter. My view is that if a site wants information to be publicly disseminated it puts it up in RSS format; if it doesn't it makes it register-to-view only.

      Thus, the RSS content is free to be screen-scraped (as RSS takes account of the source of the data, crediting isn't a problem) and the stuff that you want private is kept so.

      £0.02...

    17. Re:Screenscrapers and the Law by coopaq · · Score: 0, Redundant
      Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

      Mind if I submit my resume to your company?

      Sincerely, The Hungry, Unemployed and Ethically Empty at this Point

    18. Re:Screenscrapers and the Law by NineNine · · Score: 1, Insightful

      At that point, you just have to decide which is more valuable: your beliefs or your jobs (hint: your beliefs are).

      You beliefs are only more important if you are wealthy enough to be able to be jobless. Only wealthy people can afford to be idealistic.

    19. Re:Screenscrapers and the Law by callipygian-showsyst · · Score: 1
      You can't be an EMPLOYEE of a company, doing engineering work, and be expected to worry about legal situations, too.

      Unless they want you to do something criminal (i.e., lie, cook the books, cause harm), it's not your job to worry about Patent, Copyright, Trademark, or Licencing issues. Just do what they asked you to do, and let your Legal Department worry about the legal problems. (You may want to take the time to VERBALLY give legal a heads-up so they can look into it. After that, you're done.)

    20. Re:Screenscrapers and the Law by CommieLib · · Score: 3, Insightful

      Nope, but that's what I used to believe. The truth is that one's principles require sacrifices sometimes. What you're saying is that there are no beliefs worth sacrifices, vis a vis, wealthy people are not required to make sacrifices for their beliefs. QED.

      I think upon consideration you'll discover that's not what you believe either.

      --
      If your bitterest enemies are people who hack the heads off civilians, then I would say you're doing something right.
    21. Re:Screenscrapers and the Law by Shadow+Wrought · · Score: 2, Interesting
      Maybe the easiest thing to do is ask your boss to detail in writing (and then sign) a directive that would implement your screen scraping work.

      I am guessing that so far he has asked you to do this out of the corner of his mouth so he is not responsible. If you force him to commit a paper trail to the endeavor, he might suddenly grow similar ethics;-) Never underestimate the power of a signature in the business world.

      --
      If brevity is the soul of wit, then how does one explain Twitter?
    22. Re:Screenscrapers and the Law by tomhudson · · Score: 4, Funny

      just write a screen-scraper program to go out there and search for the case law :-)

    23. Re:Screenscrapers and the Law by zmooc · · Score: 1

      So then how does a websites' terms of agreement differ in any way from the license of GPL software for which you don't have to register? They're both human-readable information that is publicly downloadable with a browser without disclosing your identity. If one can legally republish information from a website whose terms of agreement specifically state that's not allowed, then one can also republish GPL code downloaded from a website and republish it under another license. It's exactly the same.

      --
      0x or or snor perron?!
    24. Re:Screenscrapers and the Law by MadCow42 · · Score: 1

      I'd add that you should refuse to do it, and make it ABUNDANTLY CLEAR why IN WRITING. Make sure that a copy of that is available in some official form if you're fired for it. The HR manager can be your friend too, it's not a bad idea to bcc them on the email to make sure everyone knows that you have "legitimate" reasons for not doing as you're told.

      Their options at that point would be to drop it, provide some "real" backing that it really is legal, or fire you for not doing your job.

      In that case, you have a good document to back you up if it comes to a legal fight for unlawful dismissal (or constructive dismissal if they just choose to make your life hell until you quit).

      MadCow.

      --
      I used to have a sig, but I set it free and it never came back.
    25. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      After a few minutes of googling I couldn't find that article. I think you're totally full of crap.

    26. Re:Screenscrapers and the Law by PyromanFO · · Score: 1

      No its not, GPL code is held under copyright, the redistribution of that code is the only thing the GPL applies to. Copyright doesn't apply to public data, therefore you can't hold someone in violation of copyright for redistributing public data. However, with GPL code, you can say someone is violating your copyright if they violate the GPL, because if they violate the GPL then they have no right to redistribute the material.

    27. Re:Screenscrapers and the Law by intermodal · · Score: 1

      "You beliefs are only more important if you are wealthy enough to be able to be jobless. Only wealthy people can afford to be idealistic."

      As a counterpoint, however, some of the most important things of the past thousand years were done by people who took risks for their ideals. i.e. the American and French revolutions, the boston tea party, and countless others that I probably have never even heard of but are just as influential in parts of the world.

      --
      In SOVIET RUSSIA... erm...NSA AMERICA, the Internet logs onto YOU!
    28. Re:Screenscrapers and the Law by Planesdragon · · Score: 1

      Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

      Talk to the company lawyers, your own lawyer, and your boss's boss. Don't Ask Slashdot.

    29. Re:Screenscrapers and the Law by arkanes · · Score: 2, Informative

      This comes up alot. It's because the GPL does not restrict any of your normal rights under copyright law, but rather grants you additional rights if you agree to it. You can choose to not agree to the GPL and yet still retain the use of any GPL code or program. This is not the case with your typical EULA (which is presented to you as a pre-condition of usage), or of website terms of service (which couldn't have any signifigant legal weight, since theres not even the token agreement of an EULA).

    30. Re:Screenscrapers and the Law by Telastyn · · Score: 2, Interesting

      The GPL specifically forbids republication. Basically this is where the "if under copyright, copyright restrictions (and rights) still hold"

      The code is copyrighten, and the owners of said copyright (even GPL'd code) can hold others liable for it's republication. The GPL [in non-legal terms] waives this restriction as long as certain conditions are met, among which is inclusion of the GPL in the republication. Hence trying to republish the code under a different license does not meet the conditions, and is a breach of copyright, even though the code is public.

      If the website had copyright over the public information, they could also restrict its use (except for legally defined 'fair use').

    31. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      Heh, I read this as "Screensavers and the Law". I thought your boss just wanted to see your competitor's data on his screen when his PC was idle...

      I think you should take a stand. I think you should leave the company if pushed. I think you should hand your boss a resignation. And my resume maybe? I can whip this up using Perl in a few minutes I'm sure...

      Er, I mean, fight the man! And so on.

    32. Re:Screenscrapers and the Law by Hal_9000@!!!@ · · Score: 1

      I was partially mistaken, the cover had the "Help! My Boss Made Me Install..." The article (and the cover picture) are online at Lj's site

      To quote The Actual Article:
      An employee who is asked to perform an illegal act and refuses to do so is protected from retaliation in many states. An employee who reports illegal acts to more senior management or to an appropriate government agency is often protected by ``whistle-blower'' laws. A company can be ordered to pay substantial damages, including back pay, for retaliating against whistle-blowers.

      And the author wasn't Eben Morgan, it was Lawrence Rosen in his IAAL column.

      --
      My email is real.
    33. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      Actually, some of us are lawyers, but we know better than to answer any questions like this without getting paid.

    34. Re:Screenscrapers and the Law by Tony-A · · Score: 1

      Methinks it could tend to be very dangerous.
      It should be very easy to plant bogus information or other "bad stuff" so that screen scrapers will pick it up and normal viewers will not. This is similar to deliberate errors on maps, but unless your system is extremely secure, it probably could be taken out and you wouldn't even be able to find any sympathy.

    35. Re:Screenscrapers and the Law by NFNNMIDATA · · Score: 1

      Unless you have another job lined up, you really can't afford to get yourself fired over this. If you have "at will" employment, you can be terminated for any reason or no reason whatsoever, so your potential lawsuit would not be certain to succeed. Make sure the company is an LLC or whatever (so you can't personally be sued) and just do the (probable) crime. Companies wrong their competitors all the time, working on the assumption it will be worth it when they get big enough to stomp them/pay them off a la micros~1.

    36. Re:Screenscrapers and the Law by gl4ss · · Score: 1

      so, how far are exactly straight copyright violation and tax fraud from each other, or just fraud and fraud apart?

      he could possibly get shit on him PERSONALLY for breaking the law (even if he manages to convince them that he was doing it in good faith that it was perfectly all right, which might be hard). you are expected to not break the law in any case, even if you don't even know you're breaking it you still can get shit because of it. not knowing safety regulations is a bad excuse to not have followed them.

      it would be best for him to try to convince his boss that such action(copying others information) is not necessary, and if caught would very possible lead to charges on both of them of fraud(copying others work and presenting it as yours), big fines, compensations and yadda yadda. in short saying that it's not worth it.

      companies have other responsibilities too than just making the $$$, among those are staying legal and honest.

      --
      world was created 5 seconds before this post as it is.
    37. Re:Screenscrapers and the Law by aridhol · · Score: 2, Insightful

      Mostly, legality is important so I can show it to my boss. I want to convince them not to do it, not just to farm it off to someone else with different ethical guidelines.

      --
      I can't say that I don't give a fuck. I've just run out of fuck to give.
    38. Re:Screenscrapers and the Law by callipygian-showsyst · · Score: 1
      You shouldn't commit tax fraud.

      But, while doing Engineering work, there are a lot of tangential legal issues. You may be violating patents (unknowingly). The names/terminology you use may be trademarked.

      These issues aren't for engineers to worry about; they're for your company's legal department. Engineer's can't be expected to be patent, copyright, and trademark lawyers.

    39. Re:Screenscrapers and the Law by aridhol · · Score: 1

      I am not wealthy. Yet I still will not do this task that has been assigned to me.

      --
      I can't say that I don't give a fuck. I've just run out of fuck to give.
    40. Re:Screenscrapers and the Law by Unregistered · · Score: 1

      You're ok. Do your job. It's not legal, especially since you're selling it, but it's the company's problem, not your own.

    41. Re:Screenscrapers and the Law by CelloJake · · Score: 1

      I agree to a point. What I will add is that it seems that a website which is publicly accessible is not always a public area. The concept of having terms of use on a website implies that by not following the terms they are trespassing.

      I'm not sure if its correct but I will compare it to the recent case of people being kicked out of a mall for wearing war protest t-shirts which mall officials found offensive. The basic idea being that even though the anyone can enter the mall without a membership card, by doing so they automatically submit themselves to the rules which are set down by the property owners. If they refuse to cooperate with those rules they may be removed from the premises or, if they resist, charged with trespassing.

      If it is found that a website can enforce similar rules, then copyright is not the major issue. The website itself could be considered a private area even though the "public" can go there and they are obligated to follow the rules laid out.

      As someone who builds as many sites as I visit, I would hope that this is the case. As far as copyrights are concerned, I think that the airline should be able to control the publication of its schedules and prices as well, but the broader implications of website terms of use seams more important to me.

    42. Re:Screenscrapers and the Law by CelloJake · · Score: 2, Interesting

      I agree with the RIAA in that it should not be legal to redistribute copyrighted content. I do disagree on whether the medium of distribution is liable though. The USPS would be forced to inspect every package for burn't cds if this philosophy was really put into practice. -Jacob

    43. Re:Screenscrapers and the Law by aridhol · · Score: 1
      You may be violating patents (unknowingly)
      And there's the crux of the issue. Unknowingly violating patents is one thing. I know that what I am being asked to do is probably illegal. Therefore, I cannot honestly say that I have done it unknowingly. My boss knows that I know it's probably illegal, as I told him. He told me to do it anyway and let the lawyers handle it.

      I am looking for something to show my boss and the lawyers to show why we shouldn't do it. Period.

      --
      I can't say that I don't give a fuck. I've just run out of fuck to give.
    44. Re:Screenscrapers and the Law by shking · · Score: 1
      You can't be an EMPLOYEE of a company, doing engineering work, and be expected to worry about legal situations, too

      ....unless you're named "Dmitry Sklyarov"

      --
      -- "At Microsoft, quality is job 1.1" -- PC Magazine, Nov. 1994
    45. Re:Screenscrapers and the Law by Ayandia · · Score: 1

      Write it, and demand a raise.

      "My current compensation covers weekdays, overtime, pointy-haired bosses, emergency weekends, lack of sex life, and repetitive motion injuries resulting from the lack of sex life. My integrity will you cost more."

    46. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      In that case, you have a good document to back you up if it comes to a legal fight for unlawful dismissal (or constructive dismissal if they just choose to make your life hell until you quit).

      Haven't worked in the "real world" much have you?

      You can quit most companies at will as well as they can use it against you. Got "fired" for missing a deadline? Bye Bye. Oh you will sue to get your job back? Hmmm how's your last performance review? Had a few problems? Well lets just say that most companies have the resources to hire/fire at will and if you sue to get your job back then expect to spend the rest of your job looking over your shoulder to make sure that every i is dotted and every t is crossed.
      It is not worth it suing to get a job back you have a much higher "burden of proof" to prove that the company acted irresponsibly in firing you or the next time you are 10 seconds late getting back from lunch then they will actually have a valid reason for termination.

    47. Re:Screenscrapers and the Law by jbolden · · Score: 1

      IANAL so YMMV.
      What it sounds like you would be doing is violating a copyright which is civil. OTOH if you then release the work as "your property" you company would have committed a felony, claiming copyright on something they know they don't own. You would have been the individual who committed the felony so at least conspiracy and problem the whole shabang.

      I would definitely talk to a lawyer. I agree with the other posters you don't have to quit just refuse on the record.

    48. Re:Screenscrapers and the Law by glwtta · · Score: 3, Funny
      except they were just demanding that I work 60+ hrs a week. I refused

      Holy shit! You can do that??

      ;) just kidding - I love my job, wouldn't go home if they made me.

      --
      sic transit gloria mundi
    49. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      Maybe you should ask the lawyers what their opinion of it is? Get them to sign off on it as a CYA move.

    50. Re:Screenscrapers and the Law by AndroidCat · · Score: 1
      You may want to take the time to VERBALLY give legal a heads-up

      In writing (or email)! Always in writing! (And make sure you've got a copy.) Of course, it should be complete abject and non-trouble-making in tone, but you need to CYA if it ever hits the fan. (Blame can never be destroyed, only routed downwards.)

      --
      One line blog. I hear that they're called Twitters now.
    51. Re:Screenscrapers and the Law by aridhol · · Score: 1

      That's about where I sit, too. I don't see anything inherently wrong with screen-scraping for personal use. My problem is trying to make money off someone elses work, without their permission.

      --
      I can't say that I don't give a fuck. I've just run out of fuck to give.
    52. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      Partially mistaken? You got the title wrong and weren't even CLOSE on the author. I wouldn't be surprised if you just made up your fr1st ps0t and then went and found something that looked vaguely familiar...

    53. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      not sure about US law, (nor UK law really despite a law degree!!) but in the UK you usually sue for compensation, not to get you job back - for the very reason you mention.

    54. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      You could send an anonymous letter to your companies lawyers, boards of directors, and CEO.

      Ha!

      "Hi, I am an anonymous programmer who has been asked to write a program to do , which I feel is illegal..."

      [Board Chairman] OK, so who was asked to write that program?
      [Board Critter] Um, programmer J Longhair, sir.
      [Board Chairman] Right, so much for his anonymous letter... what shall we do to him?

    55. Re:Screenscrapers and the Law by callipygian-showsyst · · Score: 1
      No! Never in writing. The last thing you want when you're trying to beat claims of intentional patent violation is an email that says "does this violate any patents?"

    56. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0
      Are you retarted or just plain stupid?

      If you're ever DEPOSED for a PATENT VIOLATION TRIAL, you'll be in a lot LESS trouble if there's no email from you asking "Does this violate a patent."

      Why don't you ask a lawyer instead of making up legal advice?

    57. Re:Screenscrapers and the Law by AndroidCat · · Score: 1
      Funny how you and the previous poster mentioned patents. (You wouldn't be a sock-puppet, would you?) I certainly didn't mention patents, and I don't believe screen-scraping involves patents. (Although Amazon is sure to try patenting it some day. :^)

      My advice wasn't legal advice, it was advice about office politics. Bozo.

      --
      One line blog. I hear that they're called Twitters now.
    58. Re:Screenscrapers and the Law by Weirsbaski · · Score: 1

      ianal; Court cases have held in the past that if the information is held on a public site, it is public, despite any agreement to the contrary.

      The information might be public, but that doesn't mean you can automatically copy it from their web site. If they "just happened" to have a few typos in their data, and you copy the typos letter for letter, it's pretty easy to figure out where you got the data from. (I hear mapmakers are known for putting typos in, for this purpose.)

      I think if it's public info, you still have to research and compile the data yourself, or there could be trouble.

      --

      I am not a sig.
    59. Re:Screenscrapers and the Law by t0ny · · Score: 2, Insightful
      I am unable to find anything on Google relating to the legality of this, but I believe that it is probably not legal. However, I was told to "do it and let the lawyers deal with it".

      Well, he is not wrong in asking you to do this. There is a difference between doing something that is 'not legal'- ie something the business can get sued for, and something that is 'illegal', ie he cannot ask you to rob a liquor store.

      First, you need to get some CYA. Tell him you will do it, but he has to make his boss aware you were asked to do this, and you need it in an email, etc. That way you cant get fired and used as a scapegoat.

      Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

      Well, since he is not requesting your legal/ethics advice, you should pretty much do what he says. Of course, quitting is the ultimate form of protest (barring suicide), but he will probably just hire somebody else and have them do it.

      And of course, you couldnt pick a better time to leave your job! There are tons of jobs out there, hanging on trees like ripe fruit waiting to be picked.

      --

      Manipulate the moderator system! Mod someone as "overrated" today.

    60. Re:Screenscrapers and the Law by MadCow42 · · Score: 1

      Gee, why would someone be so stupid to sue to get their job BACK? Usually, the case would be to sue for compensation, or even punative damages for wrongful dismissal. Sorry, THAT's how the "real world" works.

      Having something on record that shows that they could have dismissed you for refusing to do something illegal (even if they create another plausable excuse to fire you) WILL get you extra severance, and lots of it.

      Companies will pay a lot to keep ugly lawsuit cases from happening.

      MadCow.

      --
      I used to have a sig, but I set it free and it never came back.
    61. Re:Screenscrapers and the Law by JimDabell · · Score: 1

      if the information is held on a public site, it is public

      That is right, it is public information. However, the data as a whole can, and probably is, copyrighted - and reproducing it could well be copyright violation.

      As far as I am aware, the law is very clear on this - individual pieces of information are not copyrightable, but a collection of that information is copyrightable. The difference between a phone number and the phone book.

    62. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      http://www.cll.com/articles/article.cfm?articleid= 126

      http://appraiserscafe.com/article.php?sid=2615

      Look up cases like ticketmaster vs. ticktets.com, and ebay vs. bidders edge.

    63. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      "Obviously, you should seek counsel or at least tell your employer you intend to. They may decide to back down."

      Never bluff. If you are 'called' and have to show your cards ... well, you'd better have some.

      It is okay not to mention that you already have legal counsel but not okay to say you have when you really don't.

    64. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      It all comes down to this:

      Which do you value more ... your ethics or your paycheck?

      I have left, and would leave again, over matters of ethics. I missed the paycheck but I slept just fine.

    65. Re:Screenscrapers and the Law by ardiri · · Score: 1

      they were just demanding that I work 60+ hrs a week
      jebus, what planet are you on? do you only expect to work 40 hours a week? some of us put out 100+ hours a week in our jobs - thats part of the IT business. if you work less than this, your considered lazy and a threat to the company's existance.

    66. Re:Screenscrapers and the Law by TheMidget · · Score: 1
      just write a screen-scraper program to get out of there

      Is that a screenscraper pointed to monster.com?

    67. Re:Screenscrapers and the Law by ColaMan · · Score: 1

      It's all very well and good to be willing to lose your job over your principles, until you have a wife and two kids to support.

      "Honey I was fired today because my principles interfered with my job. I believe that my postion was unethical, I made a fuss about it and was sacked."

      "You stupid sack of shit! What are we going to eat now? grass? How the hell are we going to pay our mortgage? You Idiot!"

      --

      You are in a twisty maze of processor lines, all alike.
      There is a lot of hype here.
    68. Re:Screenscrapers and the Law by Pofy · · Score: 1

      >As far as I am aware, the law is very clear on
      >this - individual pieces of information are not
      >copyrightable, but a collection of that
      >information is copyrightable. The difference
      >between a phone number and the phone book.

      Yes, so you can't copy the phone book. The facts in the phone book are still not under copyright protection and can thus be copied. You just must make your own compilation and presentation of them. It is that, the compilation and presentation that is protected, not the individual facts.

    69. Re:Screenscrapers and the Law by Pofy · · Score: 1

      >My employer has "requested" that I write a screen
      >scraper to grab information from a competitor's
      >site. The data will then be put into our
      >databases, and sold as our own.

      If what is grabed is protected under copyright laws, it is of course not legal. If it is just facts, it would be OK as long as you don't also grab and resell the actual compilation and presentation of the facts.

      >This is in violation of the competitor's terms of
      >agreement, and I have thus far not done this.

      Not clear here. What terms of agreement? Are the information going to be taken from an open web page? Or is it information only available to your company (and anyone else) after having made some sort of agreement?

      If the Terms of Agreement is simply some page on their webpage, just don't agree to it :) After all, you do not in any way need some special permission or agreement to read a web page.

    70. Re:Screenscrapers and the Law by unitron · · Score: 1
      Go ahead and write it but be sure that you have documentation that proves you were nowhere near the property or any device connnected to the internet when the program is actually tested.

      But seriously, you need to immediately consult a good lawyer with no connection to your employer and to make sure your employer puts this request into notarized written form.

      I have no doubt that you work for someone that will not hesitate to throw you to the wolves if any trouble arises out of their use of their competitor's data.

      --

      I see even classic Slashdot is now pretty much unusable on dial up anymore.

    71. Re:Screenscrapers and the Law by unitron · · Score: 1

      The kicker to that mall story is that they had just had the t-shirts made up at a store there in the mall, but nobody's talking about making the store leave.

      --

      I see even classic Slashdot is now pretty much unusable on dial up anymore.

    72. Re:Screenscrapers and the Law by PhilHibbs · · Score: 1
      I'm not sure if its correct but I will compare it to the recent case of people being kicked out of a mall ...
      The owner of private property, including shopping malls (in some states), can enforce a dress code. The owner of a web site cannot enforce what I do with the results of http get commands that I send to their web server, unless copyright law grants them exclusive reproduction rights over that data. It seems that price lists and timetables aren't subject to copyright, so the analogy is not valid. The internet isn't a place, and someone's web site isn't private land.
    73. Re:Screenscrapers and the Law by aridhol · · Score: 1

      The ToS is a click-thru to the script that has the info. No click-thru, no data access.

      --
      I can't say that I don't give a fuck. I've just run out of fuck to give.
    74. Re:Screenscrapers and the Law by Telastyn · · Score: 1

      Like I said, the courts lean towards said terms of use rather than towards public arena. (wrong, and technically unenforcable imo)

      Offtopic: that mall issue is also horridly illegal, and I'd be very suprised if the security guys weren't fired already. Hello? Freedom of Speech? Anyone? Given that he bought the tshirt *at the damned mall* and the merchant wasn't also thrown out is also curious.

    75. Re:Screenscrapers and the Law by Telastyn · · Score: 1

      Actually, it does mean you can automatically copy it from their web site unless copyright restricts such acts.

    76. Re:Screenscrapers and the Law by Telastyn · · Score: 1

      and if you note that in the VERY NEXT SENTANCE I say that the information if under copyright is still held by its restrictions (and rights)

    77. Re:Screenscrapers and the Law by Omnifarious · · Score: 1

      I've written non-anymous letters sharply critical of company policy to the CEO of our (at the time) 70-80 person international company. The CEO anonymized it, and read it to all of the senior staff. My writing style and tone were immediately recognized by several of them.

      Nothing bad came of it, and I was highly amused. The Unabomber was caught via similar techniques. I wonder sometimes whether anonymous mail systems like mixmaster and mixminion are worth it. :-)

    78. Re:Screenscrapers and the Law by Anonymous Coward · · Score: 0

      but I also don't see how you're[sic] company will be able to sell something that people can get for free elsewhere.

      Ummm...Oxygen bars. Bottled water. Prostitutes. Early cable TV. etc. etc.

    79. Re:Screenscrapers and the Law by deblau · · Score: 1
      It's of questionable ethics, but I also don't see how you're company will be able to sell something that people can get for free elsewhere.

      Oh, really?

      --
      This post expresses my opinion, not that of my employer. And yes, IAAL.
    80. Re:Screenscrapers and the Law by Telastyn · · Score: 1

      Eh? Support and media can't be gotten free elsewhere (which is really all RedHat sells). Information strictly from a website has little to no oppertunity for such 'value addition'

    81. Re:Screenscrapers and the Law by stanmann · · Score: 1

      If you are married to someone who doesn't substantially share your moral and ethical beliefs, then you are likely not going to be married for very long.

      --
      Food not Bombs is a nice platitude but it breaks down when you notice that the Bombees are usually well fed
    82. Re:Screenscrapers and the Law by Dave2+Wickham · · Score: 1

      In an e-mail? IANALOW [IANAL or "worker"... can't think of any better term] but I'd get it in writing. ..

    83. Re:Screenscrapers and the Law by zmooc · · Score: 1

      The GPL takes away your right to distribute in binary form only or to distribute without the GPL-license. So I ask my question again: if GPL-software is downloaded from a website and agreements about anything publicly available on a website don't matter (as seems to be the case), then why would this all of the sudden matter if the agreement is called "GPL" and the data is .tgz?!

      --
      0x or or snor perron?!
    84. Re:Screenscrapers and the Law by arkanes · · Score: 1

      You have no such right, under normal copyright law. So the GPL isn't related at all to terms and conditions like these.

  8. Oh no! by Nurlman · · Score: 0

    Now all their monitors will get burn-in!

    Wait-- I misread that, didn't I?

  9. Like open sores software by Anonymous Coward · · Score: 0, Insightful

    GPL be damned!

  10. Oh, the EFF... by BSDevil · · Score: 2, Funny

    As much as I love them, this is is one of those cases where they can't tell if they're coming or going. Maybe they'll write an Amicus Curae for both sides, and confuse the shit out of the judge.

    And for the record, I sent in my annual EFF cheque last month :P

    --
    Cue The Sun...
    1. Re:Oh, the EFF... by petronivs · · Score: 3, Funny

      "Your honor, since we support the right of Farechaser to repackage the information that American Airlines publicly distributes on their site, we respectfully request that you lay upon American Airlines the full smackdown of the law."

      "Your honor, since we cannot support the practices of Farechaser in refusing the right to repackage information on their site, we respectfully request that you lay upon Farechaser the full smackdown of the law."

      --
      This is the real signature
      (Beats those shadows on the cave wall, don't it?)
    2. Re:Oh, the EFF... by tomhudson · · Score: 1

      Uhh ... it's FareChase, not FareChaser.

  11. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  12. A fundamental distinction by DohDamit · · Score: 5, Insightful

    There is a fundamental distinction between programmatically scraping someone else's site and posting it as your own and an individual drawing down the website via a browser: fair use.

    Provided fair use conditions are posted, I don't see where the scraper has a leg to stand on. If you are a competitor, you have different rules, as your intention and the actions that follow your intentions separate you from a normal consumer. To illustrate, it is fair use for me to go to the library and photocopy an article out of a journal and use it as source material for a paper. It is NOT fair use for me to photocopy the article and put it in my own magazine, publishing it as if it was mine, copyright and all.

    That being said, I would be very interested in an informed reply from a lawyer that specializes in these matters.

    1. Re:A fundamental distinction by fgb · · Score: 5, Insightful

      But are things like airfares copyrightable? I could understand it if they took the whole web page and posted it as their own, then there is definite copyright infringement. But just taking raw numbers off the page? What if a person went to the page, wrote down all the fares and then created a page using those fares. Would that still be infringement? What's the difference if a piece of software does the web surfing?

    2. Re:A fundamental distinction by mikeplokta · · Score: 1

      Not directly relevant to this case, but in the UK there exists a compilation copyright in a database, so that a complete database (or substantial part thereof) can be copyrighted even if all the individual items contained in the database are in the public domain. So regular web browsing is perfectly legitimate, but scraping the entire database into your own database is not.

    3. Re:A fundamental distinction by DohDamit · · Score: 1

      Where I work, we have simple confidentiality policy. Large things are more valuable, and thus should be treated more carefully. A single user's order history? Confidential. Every user's order history? HIGHLY Confidential-don't print this, and don't store it on the network! This is a similar situation.

      Having given it some thought, I just have to wonder why the airline just didn't block the scraper when they came to the site.

    4. Re:A fundamental distinction by poot_rootbeer · · Score: 2, Informative

      Provided fair use conditions are posted, I don't see where the scraper has a leg to stand on.

      Fair use conditions don't have to be posted. They are implicitly granted to the user by copyright law, not explicitly by the copyright holder.

      IANAL, but common sense tells me that quoting one airfare from a website falls under fare use, but taking an entire table of data and republishing it with your own copyright statement on it does not.

    5. Re:A fundamental distinction by Sarcazmo · · Score: 1

      Fair Use?

      Wow, that term gets thrown around a lot. It's really a very specific legal exception to copyright.

      Sec. 107. Limitations on exclusive rights: Fair use

      Notwithstanding the provisions of sections 106 and 106A, the fair use of a copyrighted work, including such use by reproduction in copies or phonorecords or by any other means specified by that section, for purposes such as criticism, comment, news reporting, teaching (including multiple copies for classroom use), scholarship, or research, is not an infringement of copyright. In determining whether the use made of a work in any particular case is a fair use the factors to be considered shall include -

      (1) the purpose and character of the use, including whether such use is of a commercial nature or is for nonprofit educational purposes;

      (2) the nature of the copyrighted work;

      (3) the amount and substantiality of the portion used in relation to the copyrighted work as a whole; and

      (4) the effect of the use upon the potential market for or value of the copyrighted work. The fact that a work is unpublished shall not itself bar a finding of fair use if such finding is made upon consideration of all the above factors.

      ----

      So is this really a question involving fair use? Probably not. Your example is valid, and does involve fair use, but the example is clearly involving research and scholarship. You can't extend that example to the general case.

    6. Re:A fundamental distinction by Sarcazmo · · Score: 4, Interesting

      You have indeed touched upon an important point. Fair use isn't really the issue here. It can easily be argued that airline fares are facts. Facts can't be copyrighted.

      Feist Publications, INC. v. Rural Tel. Service Co., 499 US 340 (1991)

    7. Re:A fundamental distinction by Sarcazmo · · Score: 1

      The way our compilation statutes are written, the copyright only extends to the original parts contributed by the editor of the compilation. Obvious arrangements are not copyrightable (such as arranging facts into database records, an obvious and noncreative use of the facts).

    8. Re:A fundamental distinction by Electrum · · Score: 1

      Having given it some thought, I just have to wonder why the airline just didn't block the scraper when they came to the site.

      Given the nature of the HTTP, doing that would be very difficult. It is not hard to "fake" HTTP requests so that they look like they are coming from a browser. Blocking by IP address could work, but there are many ways around that too.

    9. Re:A fundamental distinction by pi_rules · · Score: 1

      What's the difference if a piece of software does the web surfing?

      Because software is evil. Where have you been? Stand back as I release munitions from my brain to my fingers and into vi, which then goes into gcc and reveals great desctructive powers! Behold the bits that are evil! In short time I shall destroy commerce and freedom! I am the ultimate terrorist -- I can code!

      Errr... or at least that's how some people see it. It's all human nature really; which then turns into political biases and then turn into laws. When the majority doesn't understand something, and that something is used negatively once in a while harsh opinions are formed before the whole picture is understood and the ramifications of the situation. This isn't the first time.

      A recent example... firearms laws. It's a big topic for me; I know... but I find wonderful lines of parellel between the tech laws of today and the firearms laws of today and yesteryear. We have a Constitutional right to "keep and bear arms". Go read the 2nd ammendment once, it's really short. To me it's pretty clear... especially when you read up on what the Founding Fathers opionions were outside of that little blurb. It's a very cut and dry issue to me. I have this right, guaranteed by my government... but that's not the case. I'm restricted in what I can do, some things are "too bad" for me to do.

      You really think software is ever going to get any better? The Pro-Gun people have an ammendment on their side! Software's fucked. I'm sorry, but it's fucked. When an ammendment can be trampled over it's game over, and we software people dont' have a leg to stand on. Perhaps the 1st can be used in some way, shape, or form, but DeCSS sorta proved that when it comes to software the public doesn't consider it free speach. It can be used for evil, so it's bad, through and through.

      Do yourselves a favor. Take some of that good cash you earn with a professional job and buy a cheap AK-47 or an AR-15, then read up on what you can and can't put on it. You'll realize how fruitless this "software is free speach" thing really is.

      We're hosed.

    10. Re:A fundamental distinction by Sarcazmo · · Score: 1

      quoting one airfare from a website falls under fare use,

      Indeed. :)

    11. Re:A fundamental distinction by glwtta · · Score: 1
      There is a fundamental distinction between programmatically scraping someone else's site and posting it as your own and an individual drawing down the website via a browser: fair use.

      Here's my problem with this - for some reason when this distinction is made, "programmatically scraping someone else's site for your own legitimate use" gets lumped in with the former, while it clearly belongs with the latter.

      It's bad enough that so many companies out there can't seem to wrap their collective heads around the concept of functional web design, but now they are trying to stop me from improving on it? That's a little much.

      --
      sic transit gloria mundi
    12. Re:A fundamental distinction by Phroggy · · Score: 1

      Because software is evil. Where have you been? Stand back as I release munitions from my brain to my fingers and into vi, which then goes into gcc and reveals great desctructive powers! Behold the bits that are evil! In short time I shall destroy commerce and freedom! I am the ultimate terrorist -- I can code!

      If you're lazy, you can illegally export munitions simply by clicking the submit button on this page.

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
    13. Re:A fundamental distinction by SubliminalLove · · Score: 0

      There must be a line, though. Or else I'm creating www.SubliminalSlashdot.org, the contents of which will read:

      It is a fact that the following was posted to Slashdot today: {copy and paste Slashdot's contents}.
      (c)2003 Subliminal Love.

      ~SL

    14. Re:A fundamental distinction by Sarcazmo · · Score: 1

      Yeah there is a line. Without going into legal details, basically a scientific discovery is a fact, a compilation of data like phone numbers or addresses or names are facts. Stock quotes are likely also not copyrightable.

      Anything that has some creative process associated with it, is generally protected. The contents of Slashdot are protected, because (in theory) it took some creative sweat to create it. The supreme court actually talks about this "sweat test". :)

      Simply compiling facts in an obvious format is not protected.

      There are other tests involved, but that is the main one. Of course, since Slashdot mostly just posts other people's comments, unless there is some enforcable agreement for story posters to assign copyright to Slashdot, the actual story submission remains the property of the submitter. So in theory you could contact all the story submitters and ask permission to post the same stories on your site, and largely mirror Slashdot's content.

  13. Wouldn't this be considered a database by TedTschopp · · Score: 1

    And therefore protectible?

    --
    Fantasy remains a human right; we make in our measure and in our derivative mode... -- JRR Tolkien
    1. Re:Wouldn't this be considered a database by Anonymous Coward · · Score: 0
      Databases are (recently) copyrightable, but the data is not. If you add value to the data, you can use the entire database to make your own and copyright the result.

      You could take copyrighted databases from all the airlines and merge them into a new database, provide some kind of search routine and copyright the result.

      This case is about the terms of use for the site. There's no copyright issue here.

  14. It�s nice to see Texas finally doing something by Anonymous Coward · · Score: 0

    I didn't realize those damn squeegee guys were still around. Ours seem to have died off on their own. Guess Texas winters aren't cold enough.

  15. Track the IP? by digital_milo · · Score: 1

    Can't they just track the IP address of the scraper program and either feed it bogus information or block it all together?

    1. Re:Track the IP? by Anonymous Coward · · Score: 0

      Just redirect it to goatse.cx

    2. Re:Track the IP? by Anonymous Coward · · Score: 0

      you heard of those things called proxies?

    3. Re:Track the IP? by Anonymous Coward · · Score: 0

      Yes. but they probably want money out of it.

      Like.. Hang the pinata so it won't run away, then smash it to get the goodies.

      This injunction is just part of the ??? before PROFIT!!!

  16. In ANOTHER stunning display of hypocrisy... by Anonymous Coward · · Score: 0
    ...thieves don't like it when you steal from them.


    Of course they don't allow others to do it to them; nobody likes a dose of their own medicine.

  17. Re:Ambiguity by Anonymous Coward · · Score: 0

    They aren't supposed to have a morality. They are supposed to have views on the law, and the two are quite different. The ACLU supports freedom of speech, even when it's for hate groups like the KKK. At the same time, they support the rights of all people to have equal access to education and the like. It's not a question of morality, it's a question of law.

  18. Consider an earlier precedent... by techstar25 · · Score: 1

    It's obviously not legal to steal content(articles) from other sites due to copyrights, but do fares/prices fall into the category of copyrightable material?

    If you recall an article about Fatwallet getting in trouble for posting prices obtained from other sources, it was determined that prices were copyrightable. AA has a good arguement based on that precedent.

    1. Re:Consider an earlier precedent... by taustin · · Score: 5, Informative

      Er, dude, that wasn't precendent. That was what Walmart claimed. They then proceeded to back down when their victim pointed out that they'd claimed that under penalty of perjury.

      At least try to pay attention.

    2. Re:Consider an earlier precedent... by Anonymous Coward · · Score: 0

      Er, dude, that wasn't precendent.

      No, because nothing is precendent. It's not a word!

      At least try to pay attention.

      Ironically appropriate.

    3. Re:Consider an earlier precedent... by Anonymous Coward · · Score: 0

      And yet ... you're still a jerk.

    4. Re:Consider an earlier precedent... by Anonymous Coward · · Score: 0

      Yeah... I'm a jerk for pointing out when someone is being a jerk.

      Hey, guess what that makes you?

  19. It's free information, for a price. by Dukeofshadows · · Score: 2, Insightful

    Regardless, Farechaser should not tell its customers one thing then turn right around and do it themselves. Especially when they stand to make money doing so. Sure, it's legal, but that doesn't make it right. Personally I think they ought to nationalize most of the airlines given the current economic situation but that's not likely given the stockholders interests and the current administration.

    --
    As long as there is a Second Amendment, there will always be a First Amendment.
    1. Re:It's free information, for a price. by geekee · · Score: 1

      "Personally I think they ought to nationalize most of the airlines given the current economic situation"

      Are you insane? That's the worst thing the govt. can do. They should instead let the free market decide who lives and dies, and stay out of it.

      --
      Vote for Pedro
    2. Re:It's free information, for a price. by lamber45 · · Score: 1
      I like writing screenscrapers and running 'ping' with the rest of them, but I'd probably say AA is in the right on this one. I get the idea reading the brief that they played fair for a while and had a fun old time trying to outsmart the outsmarter, but finally gave up and called their lawyer when real harm was done. Hey, I've bought tickets from AA and had to struggle with their slow servers; could I sue Farechaser for unjust enrichment against me, an AA customer?

      Incidentally, I did a search on Lexis-Nexis for "screen AND scraper OR automatic AND database". Notes from one interesting hit I came up with are on my website, but I didn't find any case law on the subject at hand.

  20. Case law -- eBay v. Bidder's Edge by BenLev · · Score: 5, Informative
    I suggest you read eBay v. Bidder's Edge (Court citation: 100 F.Supp.2d 1058).

    In Bidder's Edge, the federal court granted eBay an injunction preventing Bidder's Edge from harvesting information from eBay's website for the purpose of using it on the Bidder's Edge site.

    IANAL (but I will be in a couple years), so don't expect legal advice from me.

    I think the Bidder's Edge case was decided on a weird basis (eBay has a right to protect its servers from harm), rather than the reasons you'd expect (eBay's data shouldn't be jacked by competitors and used to hurt eBay's business). Nonetheless, I expect other courts would rule the same way on a similar case.

    Note: in this case, eBay has specifically told Bidder's Edge not to take the data.

    1. Re:Case law -- eBay v. Bidder's Edge by Anonymous Coward · · Score: 0

      On the other hand, there's Ticketmaster v. Tickets.com, another screen scraping case which came to the opposite conclusion. Of course, Ticketmaster claimed copyright infringement, while eBay claimed some flavor of tresspass, so the cases did differ.

  21. Where does a search engine end... by Anonymous Coward · · Score: 1, Interesting

    And a screen-scraper begins?

  22. I am surprised at some of Slashdot's response by brkello · · Score: 1

    I understand the need and want for internet resources to be free, so maybe that sways some people to say that it is ok to scrape an airline's website...but it just isn't the case. To make an (imperfect) analogy, this is just like spam. A lot of bandwidth and effort is used to try to filter out the unwanted hits while allowing the full bandwidth to go to legitimate customers. If more people begin to scrape AA, service degrades abd they can lose customers (a good argument against this point is that they are still selling the tickets and making a profit, just that this other site is making money off of their efforts).

    That being said, I think their are simple technical solutions to this like just using some sort of random number letter generator that creates a blurry human readable (but not computer readable) representation and make the users enter that in to get airfare.

    Just for fun, click on farechase's link a few times and see if they enjoy losing bandwidth. It has a sort of simple irony to it.

    --
    Support a great indie game: http://www.abaddon360.com
    1. Re:I am surprised at some of Slashdot's response by mfrank · · Score: 1

      Why don't they just list their *airfares* as blurry human readable numbers?

    2. Re:I am surprised at some of Slashdot's response by brkello · · Score: 1

      There you go...problem solved...man, they should pay us for this.

      --
      Support a great indie game: http://www.abaddon360.com
    3. Re:I am surprised at some of Slashdot's response by Anonymous Coward · · Score: 0

      Then they get sued by blind users who need screen-scraper-like technology in order to use the web at all.

    4. Re:I am surprised at some of Slashdot's response by jedidiah · · Score: 2, Insightful

      This logic is BACKWARDS.

      If people scrape you and mirror your data, the load on your server should go DOWN. If this is not actually the case, then you can't really claim any sort of harm.

      This would be better described as "involuntary mirroring" than "screen-scraping".

      --
      A Pirate and a Puritan look the same on a balance sheet.
    5. Re:I am surprised at some of Slashdot's response by brkello · · Score: 1

      No, it isn't backwards. They don't scrape it once a day or something...airfares change quickly, I bet you the scrape it every few seconds so they have an up to date page.

      --
      Support a great indie game: http://www.abaddon360.com
    6. Re:I am surprised at some of Slashdot's response by TheLink · · Score: 1

      If load is your concern, then I'd think you'd ENCOURAGE people to scrape AND REPUBLISH the info, then throttle bandwidth based on IP or something.

      Then those who scrape will get scraped.

      --
    7. Re:I am surprised at some of Slashdot's response by Corydon76 · · Score: 1
      Yes, and then X Large Company who is sitting behind a NAT (for security reasons) goes to my site and it's really slow. Of course, they immediately go to a competitor (who isn't screen-scraped constantly, and whose site is thus much faster).

      Thank you. I've just lost the business of X Large Company. Got any more bright ideas?

      And no, I don't know the IPs of all my customers (considering that we're constantly getting new customers all the time).

    8. Re:I am surprised at some of Slashdot's response by TheLink · · Score: 1

      Large company? Say 100K employees. How many would be surfing your website at the same time? All?

      The only ones you have to watch out for are ISPs like AOL, so you can weight them accordingly. And there's a limit to how many users they can put behind one IP - for one they'll run out of TCP ports, and out of 65535 possible connections how many of those who would be interested in your site at the same time? 10K? That'll be very flattering in mindshare terms. 1K would be pretty good. If you throttle to 50-100 pages/sec per IP max the 1K have to wait 20-10 secs each per page. Slowish maybe, but if they go to another competitor I think you're doing something else wrong. You can always add spin and say your site is very popular (x hits a day), please bear with us etc etc.

      Also, large companies and ISPs which make their users share external IPs will typically have caching proxies. Help them help you.

      So I still don't see why it'll have to be really slow. Will only be slow for your customers if they're sharing the same IP with the resource hogger.

      --
    9. Re:I am surprised at some of Slashdot's response by Corydon76 · · Score: 1
      If you throttle to 50-100 pages/sec per IP, you've made absolutely no dent in the problems that the screenscraper is causing. Remember, we're talking about the website interfacing with an internal database with contention from other sources (i.e. travel agents). Try 20 pages/minute per IP to downgrade the screenscraper.

      For the sake of images, we'll move those to a separate web server which isn't throttled, so normal users loading pages aren't slowed down. The screen scraper, by contrast, isn't interested in the images, only in the textual information.

      If that company containing real users threw just 21 users at my site, they're going to have a slow experience. That's a problem.

      Threatening and/or filing a lawsuit against the screenscrapers is both less complicated and cheaper than engaging in an arms race.

    10. Re:I am surprised at some of Slashdot's response by jedidiah · · Score: 1

      If that is indeed the case, then AA is totally incompetent and completely undeserving of any sympathy. There is simply no excuse for any external website to have unfiltered access to a database used for other production purposes.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    11. Re:I am surprised at some of Slashdot's response by TheLink · · Score: 1

      The 50-100 pages/sec/IP is assuming you have a very popular site where it's not unexpected to have 1000 _concurrent_ connections from a shared IP to your website, to be served in 10-20 secs.

      Remember: if users actually view the pages you can support more than 1000 users/IP with that.

      If you are running such a popular site, your apps and hardware etc should be able to deal with what I'm talking about.

      If your site is less popular, scale down accordingly. e.g. 10 sec download, 10 sec view, 200 users/shared IP = 100 concurrent connections/ shared IP = 10 pages/sec.

      Maybe lawsuits are less complicated and cheaper for you, but lawsuits typically happen AFTER the event, and are not always doable.

      If I'm running an online business, even without screen scrapers, I'd still have throttling and other systems to help protect my site against mischevious kids and nasties.

      --
  23. Copyright has nothing to do with it. by schon · · Score: 1

    Copyright, that's what.

    Copyright has nothing to do with it.

    They're using data, not copyrighted material.

    The circumstances are not exactly the same

    Actually, the circumstances are not remotely the same. You're talking about copyrighted material, and data.

    the law is basically the same.

    No, it isn't. Copyright cannot be applied to facts. Pricing is a fact, therefore it's not subject to copyright.

    You can copyright the format of the data, but not the data itself. Since the screen-scaper is extracting the data, it's not subject to copyright.

  24. Room for one by Hayzeus · · Score: 0, Offtopic

    The grammar in the second AC posting is flawless. Plus -- and this is only a guess -- the author is probably possessed of extraordinary intelligence and rugged good looks. I could be wrong, but I doubt it.

  25. Innovation may be hampered by PineHall · · Score: 2, Insightful

    Jon Udell created a bookmarklet called LibraryLookup to take the URL of the page you are on and pull off the ISBN and check your local library for the book. It can be used at places like Amazon.com. It is a very creative idea of using different websites to create the useful application. Now one would hate to see applications like this be outlawed. Maybe the difference is that the use is personal (fair use) and not "commerical".

    1. Re:Innovation may be hampered by kalidasa · · Score: 1

      Damn, thanks, PineHall. That is a great idea.

  26. EFF not 'involved' by tswaterman · · Score: 1
    The EFF has posted a pdf of the injunction at their site, for viewing. There does not seem to be any commentary, much less any positioning, on this particular case by the EFF(yet).

    I would hope that, if they do become involved, they will agree on the side of the recent FatWallet case, in which posted price information was decided not copyrightable.

    It's really not fair to say people are involved merely because they are posting information for public benefit.

  27. Froogle? by rcw-work · · Score: 2

    If American Airlines wins this case, what happens to froogle.google.com?

    1. Re:Froogle? by KalvinB · · Score: 3, Interesting

      That's apples and oranges. Froogle Google et all like DealTime use scraping (or whatever they do) to SUPPORT the original owners by directing traffic their way. Froogle Google is no different than any other search engine except it specializes in merchant sites.

      The people in this case are stealing information solely for their own gain.

      Ben

    2. Re:Froogle? by Zebbers · · Score: 1

      are you retarded? what do you think the airfare is? who do you think gets paid to transport the people who use this service to find fares? could it be...............american airlines. holy shit!

      AA says this flight costs this much. thats public fucking information. if i want to start a business that solely goes through all said public information and sells my conclusions to people. thats my deal. tough luck

  28. Re:Ambiguity by Anonymous Coward · · Score: 0

    http://archive.aclu.org/news/w032197a.html

    How about in deed?

  29. FareChase T&Cs by nm42 · · Score: 3, Funny

    Part of the Terms stated You agree that you will not take any action that imposes an unreasonable or disproportionately large load on our infrastructure.

    Does posting the link on Slashdot count?

  30. Re:Ambiguity by Dg93 · · Score: 3, Informative
    That's bullshit. Show me whan the ACLU has EVER defended the KKK even in rhetoric.

    here and here. And that's just in a couple moments spent searching on the ACLU's own site.

    --
    --Dg
  31. farechase dot come doesn't support mozilla ... by Anonymous Coward · · Score: 1, Informative

    From the homepage of farechase.com ...

    There has been a problem using this website.
    This could be due to one of the following problems:

    * Your browser is not supported - this website supports Internet Explorer 4 and higher on Windows platforms, and Netscape 4.7.x on Windows and Mac platforms (Explorer on Mac platforms will be supported soon)

    * Cookies are disabled in your browser

    Click here to download Internet explorer 5.5
    Click here to download Netscape Communicator 4.77

    Please contact us at webmaster@farechase.com with any questions or comments.

  32. Scrapper Load by pdrome4robert · · Score: 5, Informative

    This goes along with the article on pricing. In industries where pricing is heavily competitive (e.g. airlines, rental cars, computer equipment) pricing information is constantly shopped. The companies can't ask each other for rates because it is banned by by anti price fixing laws. So they shop competitors' prices on information services, some even have shopbots to do the work. Sabre, the largest travel booking network in North America, which is a closed network, has blocked some paying customers due to excessive shopping. They block shopping because automated shopbots elevate CPU and network usage. These shopbots can't tell when rates have changed, so they continuously hit Sabre. Wonder how hard Farechase was hitting AA.com?

    1. Re:Scrapper Load by Anonymous Coward · · Score: 0

      Also important to mention that Sabre is a branch of AMR, the parent of American Airlines...they have a larger reason to take issue to other airlines using shopbots on their site: competition.

    2. Re:Scrapper Load by TheOneEyedMan · · Score: 1

      Actually, acording to a recent article in FAST Company magazine, ATPCO, the airrline fare publishing system, only allows 3 fare changes per weekday and once a day on weekends. SO they only need to check during those times.

      --
      Reality is that which refuses to go away when I stop believing in it. --Phillip K. Dick (remove SPAM to email)
  33. Block their scraping servers by Anonymous Coward · · Score: 3, Interesting

    At my company, a major major market site, we publish all kinds of advice, hot socks, bond rates, mutual fund performance calculations etc., etc., etc... All this is publicly avalible on the site.

    I noticed that a bunch of smaller companies were scraping our content, stuff we owned, and redisplayed it on their sites..

    So, what we did was block the servers that were scraping us, and it largely has stopped the problem. Trying to stop the remaining theifs from manually copying our content isn't worth our legal department's time, and since they are all teny tiny sites doing this, we don't care that much anymore.

    But the larger theifs who were profiting from out content --and scraping in large amounts-- don't do so anymore as a result from denying their scraping servers.

    1. Re:Block their scraping servers by YoungHack · · Score: 1
      I noticed that a bunch of smaller companies were scraping our content, stuff we owned, and redisplayed it on their sites..

      Bad choice of words. People don't own information, or "content" for that matter. You have a copyright to your creative work. To claim some kind of ownership confuses things a lot.

      Copying information is not the same thing as stealing. It's copyright infringement. Your web site did not disappear from the net when it was "stolen". This is not to say you may not have suffered some harm from the act. But to claim ownership of "bond rates, mutual fund performance calculations" etc. is a bit offensive.

    2. Re:Block their scraping servers by Corydon76 · · Score: 1
      ...ownership of "bond rates, mutual fund performance calculations" etc.

      You were almost right, until you used the word "calculations". Consider for a moment: do you own your computer processing time? If somebody were to run a program on your computer without your consent and eat up processing power, would you take offense? Shouldn't that be illegal?

      Before you answer, consider why computer viruses and trojan horses are bad, and why society punishes people who write them.

  34. How they can protect their data by release7 · · Score: 1

    They could generate all their data using gifs. To confound software that performed screen captures and then OCR'ed the site, they could use a funky font or place noise in the background color.

    --

    <a href="http://www.joblessjimmy.com">Work is dumb and so is Jobless Jimmy.</a>

  35. Screen scraping and privacy by Jerf · · Score: 4, Insightful

    There is a connection between screen scraping and privacy arguments.

    Many here are posting "What's wrong with screen scraping? The information is there, I can get it, what's the problem?"

    By the same token, many decry things like Amazon.com selling their address just because "they have it".

    Information is information. If you have the "right" to scrape whatever you want and distribute it however you want, then companies have the right to distribute your personal information to whomever they want, under whatever circumstances they want.

    I prefer to live in the world where control over information on the societal level is still allowed; no concept of privacy can exist without it. Not letting people screen scrape isn't even something I'd consider a "price".

    To be a bit more theoretical, there is value in information transfer.

    This is a summary of a much longer and more complete argument, but it should get a lot of the point across. I won't be defending this on a point-by-point basis in replies as a result.

    1. Re:Screen scraping and privacy by Anonymous Coward · · Score: 1, Insightful

      The difference is that this is information that AA purposely made public. There's no privacy issue at all. Taking public information more public is not the same as publishing something that was supposed to be private.

      AA's allegations that they can forbid screen-scraping itself (not merely the resale of the info, which I can sympathize with slightly more) are disturbing. Isn't that essentially what screen readers for the blind do? What about search engines?

      In general, allowing public (i.e. not password-protected) websites to set completely arbitrary Terms of Use is a bad idea. By the same reasoning you could open a store and then have customers who spend less than $(arbitrary amount) arrested for trespassing. The definition of abuse of a public website (DoS, etc.) should be a matter of public law, not private "agreements."

    2. Re:Screen scraping and privacy by gilroy · · Score: 2, Insightful
      Blockquoth the poster:

      Information is information. If you have the "right" to scrape whatever you want and distribute it however you want, then companies have the right to distribute your personal information to whomever they want, under whatever circumstances they want.

      Bzzz, sorry, no. The difference is this: American Airlines put the information out there, in the public. I agree that if I start renting billboards and posting my address in 1,000,000 pt font on them, then I cannot cry foul if someone goes and sends me something -- or even if someone merely tells someone else my address.


      On the other hand, I cannot do business with amazon.com without giving them my address. Not only is it required so that stuff can be shipped to me, but it is also required by them for, well, the marketability of it. I haven't broadcast that address; I haven't made it public; I've sent it in confidence to one party.


      If you can't see the difference, well, it strikes me you aren't looking for one.

    3. Re:Screen scraping and privacy by UncleRoger · · Score: 1

      By the same token, many decry things like Amazon.com selling their address just because "they have it".

      The difference there is that one provides one's address to Amazon as part of a transaction between oneself and Amazon. Many people may expect that this information is shared in confidence.

      The fare info that is being scraped, however, is being published to the general public. The publisher has, however, attempted to put limitations on how that info can be accessed or used -- much like, I imagine, the various open source licenses say you can use OS code, but you have to provide your source code openly. (IANAL, and I'm probably not saying that right, but hopefully you get the idea.)

      Personally, I think the issue is whether one has the right to limit what can be done with info (or other assets) that one makes available to the public. I don't see why not; one is always free to not access it if one does not like the terms.

      --
      Stupid people will be persecuted to the fullest extent allowed by law.
    4. Re:Screen scraping and privacy by ComputerSlicer23 · · Score: 2, Interesting
      Handy to say, I won't give you the full argument, so I won't bother defending my concept. I'll have to remember that in the future as a complete and utter cop out to I can't present an idea, or defend it. (This is me baiting you into a reply...:-).

      Using your logic google should be illegal. You can find out a lot about people using google. It's a complete and utter invasion of privacy, it should be closed. I think you'll find people completely disagree with you.

      However, I would say that Amazon selling their customer list is different then me assembling lists of information off the web. I give Amazon my information, and they have a privacy policy, I expect them to follow it. I have to give my address to get something shipped to me. I don't have any other choices. Amazon is collecting private personal information from me that I have no alternative other then not do business with them. Information on the web is available to anyone, I'm not attempting to hide it, if I was it wouldn't be on the public web. If someone else posted it about my private life that they shouldn't be, I can send them a C&D letter about invading my privacy.

      The screen scrapers however, are collecting publically available information. Just like if someone decided to mail me on the basis of looking up my name in the telephone book, I can't object to that. I can object if I ask them nicely to stop sending me mail, or calling me, but it's not like can I say you can't use the phone book to lookup my number to contact me.

      Spammers who collect e-mail addresses I see as more of a nuciense, but I'm very protective of my e-mail address so it's less of a problem for me. However, my e-mail address is google'able, and you can find it out on the web. I'd be supportive of anti-spamming laws, because they are using public information to electronically do the equivilent of stalking, or repetative time wasting phone calls. Just like I can get a court order for some crazy person who follows me, I'd like to be able to get one for spammers to say look, stop it. I can't stop people who access publically available information. Now there are some things no one should be posting on the web, that'd be a personal privacy issue. However, airline tickets isn't one of them.

      I've seen a lot of companies intentionally do things, just so the only way to gather information is thru an automated system. They don't present the information in a simple easy to use form, just raise the bar of entry. Just like companies who will only give you a 100 page invoice on paper. They won't give it to you in an electronic format. However, you can lookup individual line items one at a time on the web. In a lot of cases, they are doing that to customers who own the information, but they just don't want the customer to be able to figure it out. Stuff like only telling you the prices one at a time over the phone. They do this to make it impossible for someone to verify they are being billed correctly. I've done work in this area, trust me, companies don't want you to be able to double check them to realize how badly they have screwed up. I firmly believe that technology should be usable in such cases. I some what seem this case in that vein of keeping big companies honest.

      Technology solves these problems. It empowers people to optimize problems, and save money, generate more profit, hire more people. Established corporations don't want anyone to do that, so they put up silly rules to govern how you can get the information that is yours from them. It's silly.

      Kirby

    5. Re:Screen scraping and privacy by Anonymous Coward · · Score: 0

      No there are specific privacy laws that say they can't do that whenever they feel like it. They have to tell you they are doing it, at least.

      I don't see how this maps onto the issue of taking tables of numbers from a web site though. It's not private information, i.e., AA doesn't make reasonable efforts to keep the information secret.

      That's the same BS like when Lars said "yeah they share our CDs, how would they like it if we share their credit card number" .. well, they don't put their credit card numbers on CDs by the millions out in the open.

    6. Re:Screen scraping and privacy by Jerf · · Score: 1

      Using your logic google should be illegal.

      You make the mistake of thinking that I consider Google sacred. The caching aspect of it probably was illegal, until the Safe Harbor provisions of the DMCA. It is quite clearly recognized in the law as an exception for the purposes of caching. I've heard rumblings about people suing Google for the automatic indexing.

      You can rationalize it by noticing that "robots.txt" can constitute acceptance, but it really is tenuous because "no robots.txt" constitutes acceptance, which is rather odd. In a fully rational legal system, it should probably be required to explicitly post a robots.txt that allows searching. If you think about it, this should make sense. Web search indexing may be a benefit to you, but it should be up to you to decide it's a benefit, not for the search engines, and not for the search engines to decide you didn't opt out.

      And the reason I "bailed out" is I'm still writing the complete argument; it's up to 100 pages and counting. Can't post that to slashdot.

      See cousin post for other points.

    7. Re:Screen scraping and privacy by bnenning · · Score: 1
      then companies have the right to distribute your personal information to whomever they want, under whatever circumstances they want.


      Yes, that's correct. Although if they make a statement that they will not reveal my information and do so anyway, that's fraud.


      Not letting people screen scrape isn't even something I'd consider a "price".


      And how do you plan on enforcing this? Are you going to empower the government to hunt down all Watson users? It's like the War on Drugs: to me the inability to legally smoke pot isn't a cost, but the expense and violations of privacy and civil liberties required by enforcement are.

      --
      How to solve most of our problems: 1.Lots of nuclear plants. 2.Cure aging.
    8. Re:Screen scraping and privacy by ComputerSlicer23 · · Score: 1
      No, but I'm betting the usefulness of Google outweights (if it doesn't now, it will in the future, and people will vote to make that law, and I don't believe it can be challenged on a constitional basis) the legal right of the individual's right to privacy, especially as Google will remove personal information from their cache if you ask them too.

      Was it illegal without caching? You come up put in a list of words, it says, here is a list of URL's that you might be interested in?

      No copyright violation, they didn't copy any bits (anymore then me downloading a web page is a violation). Why is the automation different then a human doing it? I've don't see the difference, but that's because I'm a tech head. Would it be different for the original Yahoo, when it was done the old fashioned way where each page was viewed and classified by a human (the links we're harvested automatically, but each page was classified by a human into a category)?

      They didn't republish it, they merely said, these are the ones you might be the most interested in. They are providing a service, would that be illegal? No content, no context, just the IP address of the server, and the name of the virtual host so you can go crawl the content by hand. Not even a direct URL. Is that illegal? Why is it? What legal princepal is that founded on?

      Last time I checked, corporations didn't have a right to privacy (you sound more legally knowledgeable then I am, so educate me). I'm not sure citizens have an iron clad right to privacy (they have the 4th amendment, but I'm not sure that covers anything but the gov't doing the searching), but it's generally considered a personal right by the courts to help ensure saftey and order in society.

      There are well established princepals on the internet for saying, you can't come here. They are implemented by the server in any of a variety of ways. Putting up a website implicitly states, you are allowed to be here. The robots.txt is the equivilent of being polite. Anybody who doesn't follow it might get reported to their ISP, sorta like reporting a noisy tenet out to the landlord. If they had some form of authentication, that is a clear sign they don't want me there. If they dropped my packets, they didn't want me there. Posting something on a public site is just like your garbage to me. It's out in the public, I can search it, if you don't like that don't leave it on the curb where anybody can just walk up to it. It's like leaving evidence in plain sight of a cop. It's right there, for any asshole to see, don't be surprised if it shows up in a court of law and it's legal as evidence. In my world websites are a public garbage can.

      If a cop showed up in court and said well, I put in his name into google and out popped his web page posted to the web site that has his digital signature on a complete confession, you are saying that might end up being throw out of court? I'd be interested to see that argued in court, not saying I know what will happen, but it'd be interesting to see the legal concepts behind that play out.

      I'm playing somewhat devils advocate here. To a degree, I think your right, that privacy as we know it will disappear. Get over it, it's already long past happened. I can virtually gaurantee that the CIA, DoD, and the FBI have a file on you. They have collected where you live, they know where you've worked, they know all kinds of stuff about you. I know for a fact I've had it done. I hang out with a guy whose got enough clearance that they do a background check on everyone he calls. I know they have a file on me. It says, "Mostly harmless", but the did check me out.

      I agree with you to an extent, that it should be something that limits and guidelines, but that's different then saying it's completely and utterly illegal, but I believe that a lot of corporations play the game to their own benefit, they are attempting to hide the facts from the customer, and that automation, and getting the right to process the data using tec

    9. Re:Screen scraping and privacy by SetiAlphaOne · · Score: 1

      I didn't read the responses to your comment, so sorry if I repeat anything.

      I would be more sympathetic to the companies who deem their information sacred if my email address and personal info weren't already harvested from the web and used to send tons of "opt-out" spam.

      Ironically, I don't think putting a Terms of Use statement on my sig forbidding this practice would either prevent it from happening or help me win a court-case against interlopers.

      It isn't like any of this is new, it is only in the news because now it is a Corporation getting shafted instead of John Q. Public.

      There is no sig, only ZUUL.

  36. Screenscraper. by rez_rat · · Score: 1

    Those squeegie guys standing at the intersections?

    haha
    Damn, only in Texas. :-P

    1. Re:Screenscraper. by Anonymous Coward · · Score: 0

      Actually, all of those guys doing it in Texas either came from New York or California or were taught how to do it by the masters from the other two states. As with most things in Texas, if it isn't big, it was imported... ;)

    2. Re:Screenscraper. by sn0wcrash · · Score: 1

      Being a Houstonian myself, I feel it is my duty to inform you of these peoples correct title! They are correlty reffered to as "Ex-Enron Employees" or "Ex-Dynegy Employees". Please use thier respectful titles!

  37. That's what we did... by Anonymous Coward · · Score: 0

    Yeah, read my post that I just wrote a minute ago.. its about the same time you asked this quiestion:

    its a top level post down a few from yours...

    http://yro.slashdot.org/comments.pl?sid=57030&cid= 5507332

    Block their scraping servers (Score:0)
    by Anonymous Coward on Thursday March 13, @05:54PM (#5507332)

  38. Stunning? by Anonymous Coward · · Score: 0

    Sadly, what's stunning?

  39. Stunning Display of Hipocracy by TOOSuave · · Score: 1

    IMHO There's no such thing as a "Stunning Display of Hipocracy" anymore...

    1. Re:Stunning Display of Hipocracy by Anonymous Coward · · Score: 0

      Not after /. takes the gold medal for it day in and day out. THe word no longer has any more meaning.

    2. Re:Stunning Display of Hipocracy by inode_buddha · · Score: 1

      It got morphed into a "Stunning display of hippocampusy"

      --
      C|N>K
    3. Re:Stunning Display of Hipocracy by Motherfucking+Shit · · Score: 1

      >IMHO There's no such thing as a "Stunning Display of Hipocracy" anymore...

      You apparently haven't seen Rosie O'Donnell lately...

      --
      "BSD: Free as in speech. Linux: Free as in beer. Windows 10: Free as in herpes." --Man On Pink Corner in #52607549.
  40. Tread softly by Karl+Cocknozzle · · Score: 2, Insightful
    Whether it is legal or not, I do not feel that it is ethical, and may leave the company if I am pushed to do this.

    My advice here is make sure you have a new job lined up. I "took a stand" about 14 months ago, ended up being pushed out, and just got a new job a few days ago. Moral of the story? Have a fallback position, or a big bank account.

    See, they can't fire you for refusing to break the law, but "you're not a team player" situations like this can lead to people getting fired for forgetting to refill the printer paper, or failing to turn off the lights on Friday night or something stupid like that...

    And definitely don't tell somebody you're interviewing with the reason you want to leave--You will almost automagically be eliminated from consideration for saying something "negative" about your former employer...Even if it is the truth.

    You have to come up with a creative quasi-lie to explain your desire to take the risk of changing jobs in a shitty economy.
    --
    Who did what now?
  41. Proxies by Anonymous Coward · · Score: 0

    Its much easier to block a proxy than to create a new one (on an IP) once it's blocked. Unless you own the ISP and have a zillion to rotate through.

    We do that, and after about 6 attempts, they stop scraping cause its so much work for them.

    1. Re:Proxies by Anonymous Coward · · Score: 0
      Its much easier to block a proxy than to create a new one (on an IP) once it's blocked. Unless you own the ISP and have a zillion to rotate through.
      But you don't have to be an ISP to have a zillion proxies...
  42. Re:Ambiguity by cyril3 · · Score: 1
    not based on constitutional law in the least

    Then they would lose in Court and yopu wouldn't have anything to worry about.

    The wonderful thing about the rule of law is that in the end the meaning of a law including the constitution is decided by the courts. thats what they are there for. so if the court says x and you say y then you are wrong.

  43. Re:Texas court decision? (OT, I know...) by Dark+Lord+Seth · · Score: 0, Offtopic

    That robot thing rules btw :) Had fun driving around and talking to the owner a bit ;)

  44. I am a lawyer by Anonymous Coward · · Score: 0

    You've come to the right place, pardner. While none of us really _is_ a lawyer, each of us is more than willing to pretend.

    Alas, this is my last post as an AC for the day so I can't really be replying a whole lot.

    But, you can expect lawyers from each side to take similar stances on all of these points raised by /.ers. They will try to make these fit the definintion of the laws avalible any way possible. Often, we argue a case against several laws, trying to point out how it does, or doesn't apply. If one works, Yahoo, we win that one, and try to prove another law one way or the other. Tricky part is, you can't go bananas and try to hit the court with zillions of examples for your case. Gotta pick 3-6 solid laws that show a violation or not, was the case. Sometimes, the seemingly smallest aspect of the volation to the non-law savy turns out to be the most powerful example for your case, and you win.

    And why AC? Because I'm a lawyer of course.

  45. TERMS AND CONDITIONS by Tuxinatorium · · Score: 5, Funny

    TERMS AND CONDITIONS OF THIS COMMENT: YOU MUST AGREE TO THE FOLLOWING TERMS AND CONDITIONS BEFORE READING THIS SLASHDOT COMMENT. Copying this comment is prohibited. Thinking about this comment is prohibited. Once you have begun reading this comment, you must leave at least one window of your browser open at this comment for the rest of Time. Prohibited circumvention measures include, but are not limited to, scrolling up or down, closing the browser window, or restarting your computer. All readers whose browser does not stay open to this comment for the rest of Time will be prosecuted to the full extent of the law. You attest that you will be fully responsible for this obligation regardless of any outside forces that may inhibit your ability to carry out this obligation, including but not limited to unstable Microsoft software, power outages, plagues of locusts, or the Apocalypse. Reading this comment while not under the influence of alcohol is prohibited. You may not tell your friends about this comment. Telling anyone that this comment was funny is prohibited. Moderating it "Funny" is prohibited, and offenders will be prosecuted to the full extent of the law. Reading this comment while sitting in front of a computer is prohibited. All violators of this comment are required by law to pay the specified fine of $10,000 to xenon@@microsoftsucks.org using PayPal. This EULA is considered a part of this comment and is the intellectual property of the owner. ALL RIGHTS RESERVED.

    NO WARRANTY: THIS COMMENT IS PROVIDED "AS IS" AND IF YOU DON'T LIEK THE SPEELING YOU HAVE TO PAY ANOTHER $10,000 FINE TO ME.


    --

    They can't force customers not to tell their friends about the prices, so how the hell do they have a right to stop anyone from relaying that information automatically? This kind of nonsense reminds me of software EULAS: You can't see the license before you buy it, but you must agree to the license to use the software and you can't return the software if you don't like the license because there aren't any stores in the world that accept returns on opened software. They're esssentially extorting rights from you without giving you any choice other than to throw away the software you just paid $$$ for. Posting something on a website is equivalent to posting a comment on slashdot, which is equivalent to yelling it out in public. You can't have a website listing prices or goods and have a website EULA prohibiting other sites from parroting it (xxxxxxxx company is selling xxxxxx for $xxx) any more than you can yell something out on the street and then force others to not tell anyone what you just said (or else get sued) by then dictating a verbal EULA for whatever you just yelled out.

    1. Re:TERMS AND CONDITIONS by jpt.d · · Score: 1

      I buy software, I expect it to perform as advertised. In actuality I believe that for it to be on sale, it must be fit for the particular purpose for which it is intended. I honestly do not put any stock in any license agreements for software for which I have physically paid for. They are protected by copyright, sure, but their license is another thing entirely. I believe British courts have already ruled on this sort of point. If I had money to back up my beliefs, then I might actually do something, but otherwise, I am a little guy they give dick shit about. (They already have my money, they aren't about to lose anything else).

      --
      What we see depends on mainly what we look for. -- John Lubbock Now search for that bug slave!
  46. Real issue is server use by geekee · · Score: 1

    The only real case here is whether a web server is automatically equal access for everyone, or can a company can legally refuse to allow certain people to use the server. I doubt price data is copyrightable. The case involves the fairness of Fairchase using AA's equipment for their own profit, and whether AA can legally restrict this behavior. Certainly, if I walked into an AA office and started asking prices and writing them down, AA could refuse and boot me out. Is the same the case on a web server?

    --
    Vote for Pedro
    1. Re:Real issue is server use by TheLink · · Score: 1

      Huh?

      Are we talking about the same case here?

      --
  47. Copyright does not apply to facts! by coldmist · · Score: 1

    You cannot copyright raw information, such as a list of phone numbers in a telephone book.

    I think this precedence should be applied here as well. It should also be applied to the perl module that "screen scraped" a TV's listing page. Although you can't copy the overall look of the page, the raw information is free (as in speech) to be used.

    It's unfortunate that licensing agreements are now trumping copyright limits.

    --
    Don't steal. The government hates competition.
  48. Re:databases by tomhudson · · Score: 1

    when you scrape the screen, you do not know exactly what the format of their database is. Your database is a "clean-room" implementation, and probably does not exactly reflect their database in terms of schema. Any database you create is thus legal. Same as a "clean-room" BIOS.

  49. Hmmm.. part of the explanation in previous story? by Destoo · · Score: 1

    In a previous story about the POS world, related to the high tech pricing game, there is a passage about airfare pricing, where each airline publishes about 17 times a week the price of seats for all their flights..

    So the big story here seems to be the tech behind fetching these prices from the website and not the prices themselves. ..unless the prices publishes on those websites do NOT concord with the ones they advertise to ATPCO?

    All of the major airlines ( except Southwest ) participate in a joint fare-publishing enterprise called ATPCO. ATPCO collects fares and rules ( such as advance-purchase requirements, refundability, and so on ) from each airline. ATPCO then publishes those fares back out to the airlines and to the reservation services.

    --
    Nouvelles de jeux et technologies en français. TC
  50. I give three shits (and here is why) by Anonymous Coward · · Score: 1, Insightful

    This decision made by the Texas court could set a precidence for all future cases revolving around this sort of alleged violation.

    Once a court makes a decision like this, future cases will reference this decision in future litigation.

    I for one, as a lawyer for several extremely major tech companies, pay close attention to events like this. These decisions will outline the legal ground on which this activity will be judged in the future. Asside from my personal involvement, this also could have major rammifications on the way business develops on the internet.

    No, this might not be impacting you directally, but it could modify the way you do business on, use, or enjoy the internet, or the free market in a very general perspective. Essentially, these seemingly benign legal events can have tremendous impacts on society, business, legal, and a host of other realms that make up your life.

    Yeah, this seems insignificant, and in most cases will be for you, but... don't blow these things off so easily.

  51. Hypocrisy by Anonymous Coward · · Score: 0
    I'm saddened that most people seem to think that it's more an issue of "What can I get away with?" (through technical/legal loopholes) rather than "Should I respect copyright and/or the wishes of those who provide me this free service?"

    When it comes to spam, these same people get on their high horses and pontificate about abuse/theft of services and bandwidth, yet when it's someone else's resources that are being abused it's "I'll take what I like and I don't care what you think."

    As screen-scraping becomes more commonplace, you can expect services to disappear becuase they've been ripped off too much. And that benefits nobody, even the screen-scrapers.

  52. EFF not "involved", supports Farechase by wendy · · Score: 4, Informative

    To clarify EFF's position, we're not involved in the case at this point. We do strongly support Farechase's right to access a publicly available website and repost uncopyrightable facts gathered from it.

    We may get involved with the case as it proceeds, but for the moment, we've just posted a copy of the injunction for reference.

    --

    -- Openlaw: Fighting for fair use and the public domain

    1. Re:EFF not "involved", supports Farechase by Destoo · · Score: 1

      here's the comment on the folder:

      AA_v_Farechase/
      American Airlines obtains an injunction against software vendor Farechase for scraping AA.com website for "web fares" information, relying on trespass to chattels and breach of a browsewrap license.

      I thought I spotted some bias in that description, but haven't been able to put my finger on it, english not being my native language.

      --
      Nouvelles de jeux et technologies en français. TC
    2. Re:EFF not "involved", supports Farechase by Anonymous Coward · · Score: 0

      So the EFF doesn't support the concept of "terms and conditions" for websites?

  53. Farechase should... by zenyu · · Score: 1


    publicly release the software for non-commercial use. American is complaining about the bandwidth a few web-crawlers have on their infrastructure. I'd like to see them deal with 5 million users crawling their website every day.

    I want whatever crack the judge is smoking. I can see how the web pages TOS could apply after the user signs the thing. But, this non-commercial use clause sounds too anti-competitive to be legal (I don't even think a non-commercial organization like the Red Cross should be able to get anyone to sign that contract, much less a commercial organization with a huge portion of the market). If I were the judge I would have hinted to the defense to seak a injunction against the AA TOS and then suspended this trial while trying American for economic harm to Farechase with their illegal contract terms.

    I wonder how massive this Judge's bribe was. Oh wait! Texas.. Was this judge appointed by President Dunce? Maybe the Judge's 70 on his IQ test looked like a very high "C average" to someone...

    1. Re:Farechase should... by TheLink · · Score: 1

      "I wonder how massive this Judge's bribe was. Oh wait! Texas.. Was this judge appointed by President Dunce? Maybe the Judge's 70 on his IQ test looked like a very high "C average" to someone..."

      Now that's a scary thought. I wonder how many people were rejected because their IQ was >=100 or "implausibly too high".

      --
  54. The summary is so true by Anonymous Coward · · Score: 0

    It is unclear what the EFF stands for.

  55. No need for fair use by siskbc · · Score: 1
    There is a fundamental distinction between programmatically scraping someone else's site and posting it as your own and an individual drawing down the website via a browser: fair use.

    To illustrate, it is fair use for me to go to the library and photocopy an article out of a journal and use it as source material for a paper. It is NOT fair use for me to photocopy the article and put it in my own magazine, publishing it as if it was mine, copyright and all.

    First, as already mentioned, airline fares aren't copyrightable (common facts clause in copyright code, yadda yadda). So that's out the window. Now we have to ask ourselves if they are in some other way violating the law (trade secrets or whatnot).

    Consider a non-internet example. If these guys are breaking copyright, then so is every store that runs a newspaper ad with a competitor's price. Does it matter if the scraping is done by bot or by hand? Am I in violation if I sit there and write the prices down? No, of course not, because when it is published it becomes a fact, which isn't protected.

    For it to be a violation of ANYTHING, it has to not be commonly known - hence, sites that published Best Buy's black friday prices before they were published got in trouble (I think it was best buy). But once you publish it, you can't claim secrecy.

    Ultimately, this will not have to do with copyright law, but whether their no-scraping user agreement is enforceable. We shall see.

    --

    -Looking for a job as a materials chemist or multivariat

  56. Ummmm, errrr. by inode_buddha · · Score: 1

    business as usual, in other words?

    --
    C|N>K
  57. Nationalization of airlines by Dukeofshadows · · Score: 0

    Normally I agree except that the pilots unions are ruining the industry like they did steel and came close to doing in automobiles. Unions are great when working conditions are miserable and they serve a great role until they begin extorting money from employers based on what they think they can get. United had pilots gettin $300,000+ for 80 hours of work a month, Delta was reporting less extreme but similar cases, Pan AM, Eastern, Piedmont, and lots of other airlines got shut down by greedy union workers and nationalization would help put an end to this. At the very least the feds need to step in and regulate the industry for a while before airline service is only allowed between a handful of cities where the routes are that profitable. Granted, smaller airlines are loving every minute of this since they don't have the same scontracts and don't have that kind of overhead, but we need to shore up the jobs already in existence to prevent the current recession from getting any worse. Look at what the mostly non-college educated members of the longshoreman's union did out in the West Coast with their union: they make well over $100k /year and nearly choked stores for good over Christmas. If this happens to airlines, businesses would take a serious hit from the inability to travel. I also think we need a unified infrastructure where all of the airlines display what their fares are and where they fly to that's more comprehensive than expedia or orbitz, like what was in place back in the 70s where they did this at the counter instead of online.

    --
    As long as there is a Second Amendment, there will always be a First Amendment.
    1. Re:Nationalization of airlines by 71thumper · · Score: 2, Insightful

      Some things to remember about pilot salaries:

      1) They can only work until age 60. FAA rule.

      2) They typically spend 8-10 years before making $75,000/year. My buddy is 32 years old, has flown for a 'regional' since 1997, and is still only making $50,000/year. And with the downturn since 9/11, it could easily be 7-10 years before he moves up the ladder (and he'll have to take a pay cut when moving to a 'major' airline the first few years).

      3) Any number of health conditions can end your career without warning, or just leave you unpaid. Have a heart attack at 55? Forget it, you're done.

      4) These guys have to be tested in a full-motion simulator every 6 months. Blow more something here, you could find yourself out of a job.

      5) No ability to "laterally" change jobs. If you fly for an airline (such as Braniff) and have 15 years seniority and are a 747 captain, and Braniff goes out of business, you're new job will have you sitting in the co-pilots seat of a DC-9 or 737, making 36 grand a year again.

      6) Oh yeah, you're in charge of the lives of hundreds of people each day. Your mistakes don't cause downtime, they cause DEATH.

      Now tell me again why pilots are overpaid?

      Steve

    2. Re:Nationalization of airlines by fucksl4shd0t · · Score: 0, Offtopic

      Now tell me again why pilots are overpaid?

      Ok, try this one on.

      1. They spend on average 8 hours a week with your kids, daily. Most parents spend about that time as well, or less.
      2. Your kids really trust them and the information they are given by them. They get in trouble when they don't.
      3. Your kids look up to them and try to behave like them.
      4. Like it or not, your kids will learn morality from them, as well as you.

      Considering that your kids (and mine) are the future of this world, would you feel comfortable paying their teachers a pilot's salary or teacher's salary? Mind you, too many mistakes by the adults in your kids lives can cause your kids to go throwing bombs and shooting up the school and stuff. Don't believe me? Read this

      yeah, I know. That's just reactionary crap I just said. Fuck it. :)

      --
      Like what I said? You might like my music
    3. Re:Nationalization of airlines by 0x0d0a · · Score: 1

      Delta was reporting less extreme but similar cases, Pan AM, Eastern, Piedmont, and lots of other airlines got shut down by greedy union workers and nationalization would help put an end to this.

      Yeah. And companies that cave in to unions go out of business. Yay free market.

      The problem, if anything, is the federal protection of unions. More federal intervention and our airlines would be like AmTrak, subsidized to hell. Then it costs a lot *and* you get to pay whether you ride or not.

      Granted, smaller airlines are loving every minute of this since they don't have the same scontracts and don't have that kind of overhead

      Maybe smaller airlines are the ones that should be running around. No huge margins, no massive overhead.

      but we need to shore up the jobs already in existence to prevent the current recession from getting any worse.

      That's ridiculous. The money to do so comes from *somewhere*. You want to tax someone else and reduce their spending power?

      You've confused keeping people in jobs with what the Feds love doing -- convince people to spend some of their savings, and the economy goes up short term. Looks wonderful, at least in the short run. Long term, you improve efficiency and technology to improve the economy. Keeping a small segment of the population stuffed in jobs doesn't do much for anyone.

      Look at what the mostly non-college educated members of the longshoreman's union did out in the West Coast with their union: they make well over $100k /year and nearly choked stores for good over Christmas

      Really? I'd love to see a link showing where these longshoremen, a manual labor job if there ever was one, are making "well over $100k/year".

      If this happens to airlines, businesses would take a serious hit from the inability to travel.

      Sure. If the smaller, regional airlines weren't there to have a field day and take all their customers if the big ones really *did* go down.

    4. Re:Nationalization of airlines by geekee · · Score: 1

      The short answer is nationalized airlines means regulated pilot salaries. This means worse pilots since it lessens the incentives for skilled people to become pilots. This same arguement can be used to show how nationalized health care will ruin US healthcare. We'll end up with worse doctors since the best people will choose other professions. Nationalization is not the answer. Normally unions work because if they get out of hand, someone will cross the picket line and work for a lower wage. The longshoreman example is a good couterexample since people who cross the line end up dead. Reducing organized crime is the only way to fix this problem.

      --
      Vote for Pedro
    5. Re:Nationalization of airlines by Anonymous Coward · · Score: 0

      $100K/year for longshoremen was pretty frequently reported in Seattle. Not only is union scale awfully high, but many worked some 3500 hours/year.

    6. Re:Nationalization of airlines by jadavis · · Score: 1

      Well, it's one thing to be given all the responsibility you mention, and another to actually live up to it. Have you seen a high-school teacher recently? Do they really deliver on your high standards?

      My awswer is a strong "NO". Some of my teachers knew the subject matter, and tried hard to never impose their moral sense on the students (as it should be; that's the parents' job). However, most (>90%) were incompetent (to put it mildly) and imposed all of their beliefs on the students in place of actual knowledge or facts.

      You maybe argue that if we pay them more, they'll be better? Then why have U.S. schools declined as money has inclined? Maybe because the rewards (money) are not tied to results. They weasel out of standardized tests (our only way of actually measuring their output) and would rather just appease kids and get off easy without work. Maybe we need to pay current teachers less and give them money when they produce results on tests.

      Oh, and remember that the idea that teachers should be paid more is advocated by the NEA primarily. That's an institution aimed at the betterment of teachers, not students or parents.

      Pilots, on the other hand, rarely crash, and often bring the plane safely to the destination, in a timely manner. Those are results worth paying for, not the teachers' poor excuse for education.

      --
      Social scientists are inspired by theories; scientists are humbled by facts.
    7. Re:Nationalization of airlines by fucksl4shd0t · · Score: 1

      I'm not going to quote your post because I happen to agree with much of it. :)

      Pilots' salaries are very much tied to results, when you think about it. At least, they should be as well. If a pilot *does* crash, and is determined to be at fault, what exactly happens to him? Presuming he lives, of course. Much like the captain at sea, the pilot should probably be the last person to leave the plane. Ah, the wonderful role of leadership. :)

      Yes, it is true that our education system has a LOT of problems. I recall my 10-th grade biology teacher saying that he's not allowed to talk about God and religion in school, then giving us the probability that a certain few proteins would combine in the exact right way to make a self-replicating molecule and saying that that's where he think God stepped in. I also recall the prejudice I met with from faculty (and students) when I firmly stated my desire not to pledge allegiance to the flag because I had already pledged my allegiance to freedom.

      Indeed, the education system needs lots of reform. I'll tell you one place I think it needs reform. Can the whole "teaching as profession" attitude. Personally, I consider it part of my obligation to the human race (NOT society) to spend my retirement years teaching, rather than being a playboy. I'll be a playboy now and forever, but I need to spend my retirement passing on what I've learned in life to whatever generation is in school at that time. So I will, when the time comes.

      But should morality be censored out of teaching entirely? I'm not so sure about that. As adults we have a collective responsibility to the kids, not just our own. We also have a responsibility to each other not to step on each other's toes and raise their kids for them. Realistically, a kid spends more waking time in school (including studying and homework, if they still do that) than he does with his parents. That's quite an influence, and to remove morality from it completely would be a mistake, IMO. On the other hand, whose definition of morality should be accepted? It's a tricky situation, and both sides of the coin have nothing but the best of intentions for the kids. Personally, I don't have an opinion either way because I haven't resolved the issue for myself, yet.

      And finally, what qualifies someone to be a teacher? A college degree and a certificate, last time I checked. "I should think you Jedis would have more respect for the difference between knowledge, and um huh uh, wisdom." (The only quote that made it out of that movie that matters :) ) And because of the low pay, they have to really *want* to do it. I figure it's the same as chosing a leader. The person who wants the job is the person who is least qualified to do it. :)

      So yeah, in a perfect world, I think that my points about teachers and salaries are important, but still only to a certain extent. If you teach on the tail end of your life, like I say it should be done, then you're probably going to collect retirement or something (social security? heh). So a high salary isn't needed, you've already got income. But as a profession, the story's quite different.

      Mostly I responded because I wanted to demonstrate a "mission critical" profession that is very low paid. That's all.

      --
      Like what I said? You might like my music
    8. Re:Nationalization of airlines by funwithstuff · · Score: 1

      The short answer is nationalized airlines means regulated pilot salaries. This means worse pilots since it lessens the incentives for skilled people to become pilots. This same arguement can be used to show how nationalized health care will ruin US healthcare. We'll end up with worse doctors since the best people will choose other professions.

      You're defending the US healthcare system? Where they check your credit rating before your pulse?

      My best guess: the best doctors are the ones who want to help people, or who are talented at the job. Not the ones who are in it for the money. Too much money in a profession just attracts greedy people. Sure, some of them will become very competent doctors, pilots, company directors, etc., but there isn't a magical class of people who are going to be really good at anything they try.

      (Of course, since this is Slashdot, I'm just going to be dismissed as some bleeding-heart lefty. Whatever.)

      --
      it's not about the karma, it's about the whuffie
    9. Re:Nationalization of airlines by jonrkc · · Score: 1

      In the history of trade unions we see a noble socialist goal despoiled perhaps irredeemably by the basest of capitalist motives. It's a crying shame. This will also, apparently, be the history of the Internet.

  58. Re:Fair use doesn't apply by tomhudson · · Score: 1

    Fair Use doctrine applies to copyright material. facts aren't copyrightable, hence there is no "fair use" restriction. You can do anything you want to with facts. Ask any politician. (or Enron's accountants, for a counter-example)

  59. Make a Bonfire of Your Reputations &MyResignat by MichaelCrawford · · Score: 1
    You may be interested to read Make a Bonfire of Your Reputations. I didn't write it, it's a 103 year old commencement address. I have it on my website, and linked prominently all around there, because I feel that the advice it gives is the right way to live.

    You may also be interested to read my resignation from Live Picture after they announced they were moving the company from Santa Cruz County to Silicon Valley.

    Having both these pages on my consulting business' website might well be losing me some business. I'll never know - if a potential client thinks I'm a troublemaker after reading them and decides not to hire me, they just click away from my site and never say anything to me.

    However, one of the reasons why I am self-employed is so that I can live in a way that is true to my conscience, which was never really fully possible when I worked for corporations.

    Also I feel that I'm doing a valuable public service. For example, I can tell from my server logs that many of the people who find my resignation on search engines are looking for examples of resignation letters, I imagine so they can figure out how to write one of their own. I'm glad that I'm able to be helpful that way.

    A number of the other responses say that one should only make a moral stand if you have money in the bank, or if you have another job lined up. Certainly not having those things will make your decision more difficult, but I should point out that history is full of courageous people who took moral stands despite knowing full well the terrible consequences that would befall them. We all, as a society, would be better off if more people would do that, but it would come at the cost of much sufferring for a few brave individuals.

    I can't say it's been easy being a consultant the last couple years, and I'm pretty sure those pages have made it harder for me. But I think it's the right thing to do. Money is tight but I'm sure I'll manage one way or another. At least I am able to make peace with my conscience by doing such things.

    Here's a couple other things I wrote to check out while you're at it:

    Thank you for your attention.

    --
    Request your free CD of my piano music.
  60. I scrape AA.com too... by mhoeffner · · Score: 2, Informative
    I scrape AA.com too, but in a very different way technically and for a different reason.

    I've developed a free program called MileTracker that consolidates users' frequent flier accounts. One of the accounts that I pull information from is of course at AA.com. I haven't received any complaints yet, but there are several reasons why I can think of that:

    • I do the scraping from the client. There is no central server involved at any point.
    • There are only a few hundred users at this point, each generating at most 2-3 requests a day. More likely they're only generating 1 request every few days.
    • I've been very careful to simulate an actual human user using a Web browser. There are some steps that I skip for performance reasons (such as downloading images which could be cached anyway), but I make sure to handle all cookies, redirects, Javascript, etc. I also throw in some delays and randomization.
    Someone looking through logs would probably have a lot of trouble telling the difference between a real user and my "ghost" user.

    The application really isn't harmful to AA. In fact, there's a good chance that I actually increase real traffic to AA.com amongst their loyal customers. When there is a change in a user's frequent flier account balance, I provide an easy way for them to actually login to AA.com so that they can view the details. If AA complains, I'd probably obey since I have more to lose than I do to gain. It's AA's customers that use MileTracker that would suffer.

    1. Re:I scrape AA.com too... by TheLink · · Score: 1

      Heck if I were AA, I'd set up a site/page for bots.

      You want price info without all the crap, sure here you go: all in a low bandwidth, computer readable format.

      After all these are public prices right?

      If you ever have custom pricing based on loyalty etc, then customers will have to use their own accounts to get _their_ prices, and scraping won't help.

      --
  61. a price list? by www.sorehands.com · · Score: 1

    You are correct. But, you can't use a bot to copy a price list. A bot copies the entire page, then searches that page for the prices.

    There is a standard, robots.txt, that any robot write should follow to see where they can go on a website.

  62. Similar "illegality" by YrWrstNtmr · · Score: 2, Insightful

    Our company gave up its internal call center ops. Another company bought it lock, stock, and server.
    They also made an offer to all the current phone people for continued employment. Not all accepted.

    Now...we (I) had written a personnel database to manage the phone peoples schedules, hiring, firing. This included name, address, phone, SSAN, paygrade, etc, etc. The new company also bought this.

    I get a phone call from the IT VP "Send so and so a copy (incl design, etc) of the personnel program. Including all the data. They want to get up and running as soona s possible."
    "WHAT??? We can't give out all that personal information! What about all the people who did NOT join the new company?"

    He pushed, I pushed back.

    "OK...I'll do it, on one condition. A signed letter (not an email) from:
    The head of HR
    The CEO
    The COO
    The head of our law firm
    and you (the IT VP)
    Otherwise, I'll send them a sanitized copy. No personal data whatsoever."

    After much discussion, they backed down.

    I went over and installed the sanitized program.
    Bottom line...if you feel it is illegal/immoral, stand up and be counted. If you're wrong, you'll find out soon enough. They you do whatever they want.
    If you're right, the powers that be will not stick their neck out that far.

    Protect yourself. Otherwise, when the shit hits the fan, you will be one of the scapegoats.

  63. Screen Scraping, Resource Hogging by mabu · · Score: 1

    If I were them I would have simply updated the web site in such a way to thwart some automated robot, or blocked the IP blocks or something similar.

    We had a client whose web site was crippled due to one of those price-comparison-robots hitting the server so fast, with so many simultaneous requests that it couldn't serve the public. I can see both sides of the story but it seems like a reasonable and fair idea to request permission before automating a process to scrape data from someone else's system for your own commercial gain. I'd categorize companies that do this (without permission) only a hair better than spammers on the scum scale.

    1. Re:Screen Scraping, Resource Hogging by TheLink · · Score: 1

      Screen Scraping != Resource Hogging. Different issues.

      Resource hogging:
      If someone is abusing your system, you warn them, or complain to their service provider, authorities.

      You could deny service or give them "customized info" (so many naughty things, so little time :) ).

      Screen Scraping:
      If it's customer initiated, you'd get the same hit anyway, and they are practically extending your reach, or you don't want your price listed amongst the other suppliers, hmmm?

      If you're the scraper you can and should design your site to cache data so that you don't need to waste bandwidth (yours and target's).

      If you're the scrapee, if lots of people are doing this, you could make a site/page that provides data to scrapees in a resource and bandwidth friendly manner, and in a machine parseable format too.

      --
    2. Re:Screen Scraping, Resource Hogging by Corydon76 · · Score: 1
      If someone is abusing your system, you warn them, or complain to their service provider, authorities.

      And American did, multiple times; as stated in the complaint, the lawsuit is their last resort.

      If it's customer initiated, you'd get the same hit anyway, and they are practically extending your reach, or you don't want your price listed amongst the other suppliers, hmmm?

      Complete baloney. A screen scraper hits your site whether or not an actual customer sees the prices. Most screen scrape sites don't use live triggers to screen scrape, because there's a potential time penalty (especially when the remote site, such as American's, is checking into a database with high contention).

      I worked for a very large online bookseller and this was always a problem.

      If you're the scrapee, if lots of people are doing this, you could make a site/page that provides data to scrapees in a resource and bandwidth friendly manner, and in a machine parseable format too.

      Legitimate sites don't need to screenscrape: they'll set up a working relationship with the company in question and get the data via legitimate channels. If the company doesn't want to deal, well, that's more screen real estate for their competitors.

  64. No, it is the same by Jerf · · Score: 1

    No, it is the same. The airline companies can't do business with you without showing their prices, anymore then you can do business without given them your address. The fact they appear to be "broadcasting" is an artefact of the fact that they want to do business with everybody. There's nothing special about being a corporation; you are free to start a business and if you do, you might also have to broadcast your address.

    There is no real asymmetry between businesses and people in this case; either there information once aquired can be shared with anybody, or there is grounds to limit it, perhaps only to potential customers, as both in the Amazon case (with your address) or in this case, to the potential customers of the airline, which Farechase is not.

    Also, quantity counts. Your billboard metaphor is entirely pointless on two grounds: One, it does not have enough information to be applicable to this discussion, and two, putting something on a billboard does not release the content into the public domain! It is still copyrighted and trademarked.

    There isn't a difference that matters. If any sort of protection can exist, then the airline can claim it and prevent Farechase from scraping. If no sort of protection of data can exist, then there's no such thing as privacy. "Putting it out to the public" is not a meaningful way of looking at it; almost nobody truly puts out data to the public, rather they put it out to potential customers.

    1. Re:No, it is the same by greenrd · · Score: 1
      You seem to fail to realise the obvious point that when I post something on a public website (like Slashdot), anyone can potentially view it, with no acess controls. (Being required to put it in a username and password does not really count as "access controls" if anyone can create an account .) There is no expectation of privacy. Same with a billboard. No expectation of privacy.

      When I give my address out to Amazon.co.uk, it's not the case that anyone can potentially view it. There is an expectation of privacy.

      Is it that hard to understand? Are you just being willfully obtuse?

    2. Re:No, it is the same by gilroy · · Score: 1

      Thanks for saving me the effort of making exactly those points.

  65. Regional Air vs. National Air by Dukeofshadows · · Score: 0, Offtopic

    My gripe is with the overpaid pilots of national airlines as they were reporting from local media here, particularly United airlines after it declared bankruptcy. Regional airlines can't afford that kind ot overpay, hence why I said they were loving this economy. AirTran, Braniff, JetBlue et. al don't seem to have this problem since they don't have the outlandish contracts. Thanks for the info on piloting aircraft. Best of luck to your friend.

    --
    As long as there is a Second Amendment, there will always be a First Amendment.
  66. another perspective by cygnusx197 · · Score: 1
    You guys are using the word 'information' rather ambiguously.
    Let me ask this... What if somone scraped 'information' from a favorite of people around here, O'Reiley.

    How would you feel then?

  67. That's all Farechase does by Anonymous Coward · · Score: 0

    Farechase presents you a list of webfares (e.g. American Airlines flight 123 for $250.00) then if you choose it, they send you to American Airlines's website to buy that fare. So what's the difference again between Froogle and Farechase?

  68. It's about controlling the distribution channel... by i_want_you_to_throw_ · · Score: 4, Interesting

    American uses Sabre internally (in fact used to own the WHOLE thing) and owns 25% of Worldspan (got it when they bought TWA): both customers of Farechase.

    Ultimatly this is about controlling the distribution channel for tickets: first stop paying commission to travel agents (that's right! they make 0% commission now) and now try to put a clamp around screen scrapers.

    Then there's the the fact that Orbitz is owned by the majors and is the very definition of collusion.

    The owners of Worldspan (which powers Orbitz and is Delta, American and Northwest) plan on bypassing SABRE and putting inventory on Worldspan for sale through Orbitz. This has already been announced. Why? Because if you buy a ticket through a SABRE channel (like travelocity), SABRE charges AA (and every other airline) a $4 segment fee. Not so when you buy it through your own CRS/GDS system.

    Again, it's about controlling the distribution channel.

    I wouldn't know this except I used to be employed by American as a SABRE programmer.

    American is nothing more than a bunch of slimy bastards (like all airlines with the exceptions of Southwest and JetBlue) and will deserve their bankruptcy filing when they do it.

    And they WILL given the failed airline economic model that the "majors" subscribe to. In a very funny ironic turn of events two new 747s are valued at more than the whole of AMR (AA's parent).

    Don't buy their stock anytime soon except to short it.

  69. Most wealthy enough to be jobless. by TheLink · · Score: 1

    Lots of people are wealthy enough to be jobless - it's a matter of how much suffering and humbling they are willing to endure.

    Often they're not even given a choice. Are the masses of people laid off wealthy enough to be jobless? Most of them survive somehow, some even living off garbage and/or other people's charity.

    Do you hold your beliefs as more important than a CFO's belief in the bottom line and how best to improve it? If they are, then be willing to do as the CFO does. If they aren't then how much really are your beliefs worth?

    Also, it's a good idea to always live beneath your means, so that when push comes to shove, you are in a better position to handle it. I know lots of people who don't, while they might still refuse when asked to do the wrong thing, they sure will be under a lot of pressure and stress - zero in the bank account, rent, loans and bills to pay. If you have a choice, why put yourself in such a bad strategic position?

    Pick your luxuries. I find the luxury of being able to tell the boss "Sorry, I don't do that sort of thing" beats that of an expensive item/car/house/etc.

    Many people are willing to die for their beliefs. There are so many cases where they might as well be willing, because people are going to kill them for their beliefs anyway.

    --
  70. Re:Ambiguity by Anonymous Coward · · Score: 0

    >Then they would lose in Court and yopu wouldn't have anything to worry about.

    If the system wasn't such a screw-up, maybe that's how it'd be. The problem is that since the Constitution never made the Supreme Court the judge of constitutionality and since the Supreme Court has a history of making stuff up as they go along, any sort of wild interpretation stands until a new court decides otherwise.

  71. But AA has most insane Terms! by Anonymous Coward · · Score: 0

    If I'm not mistaken, American Airlines has the web's longest disclaimer / usage policy. With terms like this, it's no wonder the law found in their favor.

  72. Re:Ambiguity by Anonymous Coward · · Score: 0

    "The judicial power shall extend to all cases, in law and equity, arising under this Constitution, the laws of the United States, and treaties made, or which shall be made, under their authority;"

    To me, that sounds like they have the power to determine whether laws are in fact Cosntitutional. Whether they abuse their power is another question, but I do believe they have at least this ability.

  73. Win/Lose by t0ny · · Score: 1

    this is one of those cases I hope they both lose.

    --

    Manipulate the moderator system! Mod someone as "overrated" today.

  74. You are wrong by m4g02 · · Score: 3, Insightful

    it's not "stealing". It wouldn't even be "stealing" if this information was worthy of copyright. HOWEVER, the fact remains that this information is NOT worthy of copright protection.

    But, its not just about the information, they are accessing their hardware using their bandwidth ignoring the agreement. Its the same thing spamers do that make everyone here yell. Funny how people can change their opinion when the afected is a for-profit company.

    I can open a restaurant and give menus away so my clients can order by phone, but if a fellow comes every day and takes a menu of mine just to copy the precies to his own menu I would never give one to him again, is my damn right after all since are my menus I printed in the paper i bought with the ink i bought, same with bandwidth.

    --
    Sigs are for morons... Wait a minute...
    1. Re:You are wrong by cHiphead · · Score: 1

      I disagree with your example. they arent taking something physically, its like having some dude walk in to your store with a camera, taking a picture of prices on your menu, and leaving. You have the menu, you expect people to look at it, comes with the territory.

      Btw, did you completely miss the boat? In any example, the guy is taking your menu to republish it in another form, but he is not starting a competing business. HE IS SENDING YOU BUSINESS. HELLo. Its like a free sales rep.

      --

      This is my sig. There are many like it, but this one is mine.
    2. Re:You are wrong by m4g02 · · Score: 1

      I disagree with your example. they arent taking something physically, its like having some dude walk in to your store with a camera, taking a picture of prices on your menu, and leaving. You have the menu, you expect people to look at it, comes with the territory.

      You are not used to IT stuff, right?, bandwidth has physical form, is not like your computer can connect to a server magically just because you want it to, first you need to stablish a physically connection using several hardware that belongs to someone who pays the bills.

      --
      Sigs are for morons... Wait a minute...
  75. Re:databases by mikeplokta · · Score: 1

    It's not the schema that's covered by the compilation copyright, it's the content. A "clean room" re-implementation of the same database is legal, but means going out and getting the data manually rather than by sucking it out of someone else's database.

  76. Screenscrapers and the Law-SmokeJumpers. by Anonymous Coward · · Score: 0

    "if you work less than this, your considered lazy and a threat to the company's existance."

    And the opposite is known as burnout. Bet the machinery gets better treatment.

  77. American Airlines business plan... by Anonymous Coward · · Score: 0

    1) File lawsuits to restrict customers' access to your fares.
    2) Watch revenues nose dive
    3) Bankruptcy!

  78. Re:Ambiguity by cyril3 · · Score: 1
    Umm, the separation of powers doctrin generally provides for 3 centres of power.

    The Legislature: Makes laws

    The Executive: Administers Law

    The Judiciary: Judges transgressions and in Constitutional cases determins if laws are 'lawful'

    I'm sure its the same in the US though in all jurisdictions high level executive and legislative powers tend to mix a bit, which makes an independent judiciary even more important.

  79. Try Az by freedog · · Score: 1

    The body of the unidentified man was found early on Wednesday by a passerby, Maricopa County Sheriff Joe Arpaio said. Arpaio said the victim, who was in his 30s, had been shot at close range, his hands bound behind his back.

    "We're positive that all the murders are related," Arpaio told Reuters.

    Eight other illegal immigrants have been slain since last March, killed in much the same manner before being dumped by the roadside. All the victims were male, bound before they were killed and all but one of those murdered was shot.

    - from CNN report 3-6-03; google: arizona border killings for more

  80. RTFInjunction Order by werdna · · Score: 1

    There are no copyright issues here -- this is an injunction given in a state district court, which has no jurisdiction on copyright questions. The only legal basis cited in the order is the suggestion that use of American's computer in violation of its terms and conditions "may" constitute some form of computer crime.

    Alas, the federal courts appear to have take the lead in the screen-scraping arena. The First Circuit Court recently upheld a similar claim arising under the Copyright Act.

    This is a bad sign -- manifesting profound ignorance as to how these technologies work. Hopefully, better lawyering will develop these cases more credibly in the future.

  81. Terms and conditions, my eye. by user+no.+590291 · · Score: 1

    The only terms and conditions I'm obligated to abide by when getting whatever a company puts on the web for public consumption are defined by the HTTP protocol.

  82. Compiled stuff by Anonymous Coward · · Score: 0

    Even if the content is public, surely compilations/translations etc can be copyrighted?

    Isnt this what most Linux distributions are doing?

  83. I created a screen-scraper once. by RobinH · · Score: 1

    I once created a screen scraper to grab the prices for our competitor's products and stick them in a database. Then we did this calculation: Our Price = Their Price * 0.95

    To this day I'm still not convinced that it was unethical because even large stores compare their prices to other stores all the time in an attempt to have the "lowest price". When you have two gas stations across the street from each other, they often set their prices based on the price of their competitor. In general, prices are considered public information.

    It's all irrelevant now... our competitor found out about us, dropped their price by 10% for a few months to put us out of business, and then jacked their prices right back to their original levels. I guess, for a while, we did something good for customers, and for that I'm satisfied.

    --
    "I have never let my schooling interfere with my education." - Mark Twain
  84. Lamber45: Mormon Kook? by Anonymous Coward · · Score: 0

    His website is chock full of interesting little tidbits, like this one.

  85. A touch of grey by ruthven78 · · Score: 1

    Hmm this one is a bit more perplexing though than just public doman vs copyright. I looked at farechase's website and they make software for the travel industry to quickly compare rates. This software, i assume, does the screenscraping on multiple sites to gather fare information on different airlines/hotels/etc. The problem is air fare rates is not really something you can copyright. There really is no difference in using a screenscraper and paying someone to surf the website, record the information, and then publish on their own site. I believe the screen scraper is a good thing since fares are so dynamic and thus change frequently...you'd have to hire an army to keep up on the changes. Though there is already subscription services such as WIZCOM that most hotels and airline spublish rates to. But the part about terms & conditions, those are lame.

  86. Injunctions and Texas Law by jdedman4 · · Score: 2, Informative
    Well, this will almost certainly be appealled, and since the lawsuit arose in a Tarrant County, Texas, district court, it will be reviewed by the Fort Worth Court of Appeals. Although litigants are usually prohibited from appealling until a final judgment has been reached in a lawsuit, Texas law specifically grants them the right to immediately appeal an order which "grants or refuses a temporary injunction or grants or overrules a motion to dissolve a temporary injunction." Just so you know, an appellate court considers the following when reviewing an order on a temporary injunction:
    Applicable Law and Standard of Review To be entitled to a temporary injunction a plaintiff must show: (1) a viable cause of action against the defendant; (2) a probable right to recovery; and (3) a probable, imminent, and irreparable injury in the interim. Walling v. Metcalfe, 863 S.W.2d 56, 57 (Tex.1993) (per curiam). The only question before the trial court is whether the applicant is entitled to preservation of the status quo pending trial on the merits. Id. at 58. In an appeal from an order granting a temporary injunction, our review is confined to the validity of that order. See id. The decision to grant or deny the temporary injunction lies within the sound discretion of the trial court; we will not disturb that decision absent a clear abuse of discretion. Id. This Court may neither substitute its judgment for that of the trial court nor consider the merits of the lawsuit. Universal Health Servs., Inc. v. Thompson, 24 S.W.3d 570, 576 (Tex.App.-Austin 2000, no pet.). Rather, we view the evidence in the light most favorable to the trial court's order, indulging every reasonable inference in its favor, and determine whether the order was so arbitrary as to exceed the bounds of reasonable discretion. Id. An abuse of discretion exists when the court misapplies the law to established facts or when it concludes that the applicant has demonstrated a probable injury or a probable right to recovery and the conclusion is not reasonably supported by evidence. Rugen v. Interactive Bus. Sys., Inc., 864 S.W.2d 548, 551 (Tex.App.-Dallas 1993, no writ).
    However, I'll note that the litigants must now, pending appeal and all of that, go to trial and put on a case for a permanent injunction. trial court may grant a temporary writ of injunction to preserve the status quo pending trial even though the applicant's prayer does not include a claim for equitable relief. Basically, this is so far from over.
  87. Someone tried that to us by zackbar · · Score: 1

    They were using a screenscraper as an interface to replicate our information. Some of our clients were logging into their system, posting data to their website, and the website was basically using a screenscraper to make our systems match.

    The problem was that it wasn't authorized, and we'd never heard of them, yet they claimed they were fully compatible with us to our clients. It was also impacting our systems adversely. Potentially, their systems may have accidentally created massive duplicate data too.

    We put a stop to it, but we did it by tech means. I hope the robot writer went nuts trying to get around the bits I implemented. heheheheheh.

  88. Re:databases by tomhudson · · Score: 1
    You're not "sucking it out of their database", since your scraper never sees their database. All it "sees" is information that's been posted on the web. Now, if you were to connect the their database server's port and run a series of commands like
    • show databases;
    • use aa_flights;
    • select * from flight_info where date = date();
    then your argument would hold water.
  89. American Airlines suck! by payndz · · Score: 1
    American is nothing more than a bunch of slimy bastards

    I don't know about their sliminess quotient, but I *do* know they're a shitty airline. Heathrow/Atlanta return (via Chicago) a couple of years back - worst flights I've ever been on. Uncomfortable (even by airline standards) and shabby seats, rude and unhelpful staff, lousy (again, even by airline standards) food, flickering and tiny overhead monitors for the movie (no multi-channel seat-back TVs here) and the plane itself was grubby, battered, smelly and generally an unpleasant place to spend seven hours. Normally I fly Virgin Atlantic, which is usually pretty good even in economy (the one time when I flew First Class... oh, the luxury! Even an in-flight massage!), but compared to American, even Virgin's economy seemed like business class. Ever since, I've taken every opportunity to slag American off purely on principle. Like now.

    --
    You must think in Russian.
  90. Why is it assumed public? by Striver · · Score: 1

    I have a web site. It resides on a server sitting next to me here in my home. To get to it, you have to enter my home, either physically or electronically. I think there is a legitimate case that this is different from information sent to your home via radio, TV, or newspaper. You must enter my private property to retrieve information from my web site and I can legally stipulate how you act on my property, whether you are allowed on my property at all and what you are able to do with any information you obtain there. Yes, My web site is connected to what can be considered a public conveyance...the Internet. My home is also connected to public access...the street. Anyone can look up my address and come to my house. Simply because I open my door to strangers, does not make my house, or my server, public property. I do recognize the difference when we are talking about a commercial web site or a store. However, aside from certain rules of non-discrimination, I don't see a significant difference. When I provide information on my business property to my customers, I can stipulate who has access to it and how it is used. For example, many of the great artworks hanging in museums are not under copyright. However, the museums can, and often do, prohibit visitors from taking photos of such works while visiting, just as I can prohibit people from duplicating information while visiting my private property.

    --
    this is loaner...my sig is in the shop
    1. Re:Why is it assumed public? by micq · · Score: 1

      It's not the same... good attempt, but not the same...

      Let's say your website information gets cached from an authorized users request... and I access the cache. I didn't go into your house to get the data, what do you have to say then? What if google cache's your content? I grabbed it off of google, what do you have then?

      Fact is, your house you can shut the door, your house you can lock the door, the correct analogy would be on your server you could password protect your stuff... sure, people can get around the password, as people can open your door or pick your locks, but you had a reasonable sense of protecting your privacy, belongings, and information... when you leave it out there for anyone, you don't reasonably try to protect it... if you don't reasonably try to protect your privacy, your stuff, then you can't reasonably expect others to consider it private and protected, can you?

      That's why it's public...

    2. Re:Why is it assumed public? by Striver · · Score: 1

      What if google cache's your content? I grabbed it off of google, what do you have then?

      I have Google trespassing on my private property

      --
      this is loaner...my sig is in the shop