Python 3 Is Coming To Scrapy (scrapinghub.com)

New submitter Valdir Stumm Junior writes: Scrapy with beta Python 3 support is finally here! Released through Scrapy 1.1.0rc1, this is the result of several months of hard work on the part of the Scrapy community and Scrapinghub engineers.

This is a huge milestone for all you Scrapy users (and those who haven't used Scrapy due to the lack of Python 3). Scrapy veterans and new adopters will soon be able to move their entire stack to Python 3 once the release becomes stable. Keep in mind that since this a release candidate, it is not ready to be used in production.

Comments

What the fuck is Scrapy?

[Anonymous Coward]

What the fuck is Scrapy?

Re:What the fuck is Scrapy?

[vux984]

What the fuck is Scrapy?

Pretty sure it's that irritating dog they added to scooby doo to try to inject new life into it but which only made it worse.

Re:What the fuck is Scrapy?

[pem]

It's the sheep equivalent of mad cow disease.

Re:What the fuck is Scrapy?

[Darinbob]

I had scrapy once but the ointment cleared it right up.

Re:What the fuck is Scrapy?

[Anonymous Coward]

Scrapy (/skrepi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.

Re:What the fuck is Scrapy?

[squiggleslash]

It's an collaborative cloud-ready framework that leverages Python based open source technologies to extract data across multiple standards based web sites.

(Wow, actually looking at their website, I got it right, and I made that up initially.)

WTF Is Scrapy?

[Anonymous Coward]

Jesus christ I hate submissions like this. Not only is it a blatent product-pimping ad, they cant even be bothered to explain WTF they are pimping.

This should help:

[Anonymous Coward]

http://lmgtfy.com/?q=what+is+s...

Re:This should help:

[Anonymous Coward]

Nope, that link just goes to a page that says:

let methat for you [sic]

[Google Search] [I'm Feeling Lucky]

Enable javascript to use LMGTFY.

Re:This should help:

[Darinbob]

By your logic, all the Slashdot editors have to do in their summaries is say "there's some news, head to a news site to find out what it is!" Having to google what a summary is talking about means that it is a bad summary.

This

[OzPeter]

This is the sort of thing I mark as Binspam in the Firehose. Blatant advertising.

Unfortunately I was doing other things when it popped up.

Scrapy is a web spider

[Art3x]

From the summary:

Scrapy with beta Python 3 support is finally here!

Here's how I would write it:

Scrapy, a web spider, now has beta support for Python 3.

This is why I get paid the big bucks.

Re:Scrapy is a web spider

[plopez]

"Scrapy, a web spider, now has beta support for Python 3."

TL;DR ;)

Additional information

[stummjr]

Sorry guys for the not so informative story up there. Well, Scrapy is an open source framework to build web crawlers in Python. The lack of Python 3 support was a huge blocker for people who wanted to use Scrapy, but didn't want to use Python 2.7 anymore. This is why this release is a milestone for Scrapy users. It's very popular between python developers working with web crawling/web scraping. You can check the project page at GitHub here: https://github.com/scrapy/scra...

Thank God

[Anonymous Coward]

The only thing keeping me from using Scrapy were two things:

1) Lack of Python 3 support
2) Knowing what Scrapy is


Now only 2) is the thing that is keeping me from using it!

Re:What

[plopez]

The "s" is silent.