Slashdot Mirror
MythTV Scheduling Service Reveals Pricing
An anonymous reader writes "A group of open source developers have been working behind the scenes to create a new service known as Schedules Direct to provide affordable scheduling data for North American users of MythTV. Today, they've announced an initial pricing plan of $15 for a 3 month block, non-recurring. Details are still fairly light at the moment, but there's a mailing list and a FAQ available on the site — one notable tidbit is that the developers 'expect pricing to drop by the end of the initial term. Our goal is $20/year.' This comes weeks before the planned shutdown of Zap2it Labs' Data Direct service mentioned previously."
I'd be willing to pay to get a machine-readable schedule of shows. But I'd certainly be willing to pay more for a machine-readable record of exactly when the commercials were.
Not that that's likely to happen any time soon.
Wait, what? I thought the advertisers were the television networks' customers.
Whilst a pay service might work well the fact is that site scraping can be very effective and provide very good results.
Australian users have never really had guide data available to them, so we have basically relied on either IceTV, a (very well done) for-pay data source, or ozTivo. Recently Australian users have had a new resource, Shepherd.
Shepherd is basically a bunch of scripts that are automatically updated and designed to read quite a few websites and data sources (including IceTV and ozTivo) and provides the best quality data I've seen so far. The set up is relatively easy, if you can get MythTv set up you can certainly get Shepherd set up, and doesn't require ongoing maintenance, once you get it working the script will keep itself up to date.
The TLDR version: Site Scraping can and does work well.
But before you do, let me just fill you in on how the Australian experience went, and why paying may not be such a bad thing.
Historically, there's been no XMLTV guide data source for Australians. So there have been a litany of screen scrapers that downloaded guide web pages, massaged them into XMLTV format, and passed them on to MythTV and friends.
The only problem is, the program guides are controlled by the TV networks, and the TV networks hate us. Ouch, but true. They've made the leap of logic that, if we had program guide data on our DVRs, we can skip the commercials.[2] So they've been arguing that they own the copyright to the guide data[3] and any unauthorised use of it (i.e. screen scraping) is a breach of their terms.
The only commercial company to publish guide data for DVRs is IceTV and they've been a lawsuit magnet from abovementioned TV networks. Not many people would pay a monthly subscription to something that could be killed at any time.
Meanwhile, in screen scraping land, it's been a game of cat-and-mouse. Find a web site that publishes guide data. Write a screen scraper (or wait for someone else to). In a few months, notice that nothing's been scheduled for a few days - the screen scraper has broken because they've (intentionally) changed the format to deter this. Find another web site. Repeat.
They did all sorts of things to deter us. Obfuscation through JavaScript. Only allowing n page views per hour. After they converted all the guide details to GIFs, we gave up. Most people have moved to IceTV or ozTiVo.
The ozTiVo guide is an interesting idea. It's essentially a wiki that people manually fill in with guide data. Then you can use its XMLTV interface to get guide data out. You're reliant on other people to fill it in, and (due to above copyright issue in Australia) a lot of program details are generic or omitted. But it's workable. This is a model which other people may be interested in setting up.
Fortunately for IceTV, in the last few days, it won its court case and is now happily legit.
So, to sum up, we in Australia are actually happy to pay for quality guide data. Because we know the alternatives. If someone wants to set up a screen scraper, good luck to you - we fought the good fight and lost, but maybe you won't.
--
[1] Ladies too!
[2] No, I don't know how they came up with that either.
[3] In Australia, this has historically been a grey area.
That's right, it's what you pay for your TiVo.
But:
* Not everybody has access to the services TiVo provides (they're not operating world-wide, and alternatives at least around here (in Switzerland) are nowhere near $5/mo, but are bundled with digital TV)
* Some people prefer an open-source alternative, not only to the PVR itself, but also for the data source
* Screen scraping works. Sort of. Sometimes. As soon as your scraper gets popular, the web site will change its layout to foil scraping attempts, and you can start new. It's an arms race, unfortunately, and there's no real way out of it. The networks and content providers jealously guard their data, and only license it to redistributors.
* Schedules Direct is such a licensing partner. Instead of distributing the data in proprietary format, they use standard XML. That is good.
and, most important of all:
* If you had read TFA (or even the freaking post), they're aiming to drop the price. For now, they have no idea how popular their service will be, but want to make sure they don't create a financial sinkhole. The folks behind this are from the MythTV and XMLTV community, and I'd be surprised if they see this as a get rich quick scheme. They're too realistic for that.