Slashdot Mirror


Python 3 Is Coming To Scrapy (scrapinghub.com)

New submitter Valdir Stumm Junior writes: Scrapy with beta Python 3 support is finally here! Released through Scrapy 1.1.0rc1, this is the result of several months of hard work on the part of the Scrapy community and Scrapinghub engineers.

This is a huge milestone for all you Scrapy users (and those who haven't used Scrapy due to the lack of Python 3). Scrapy veterans and new adopters will soon be able to move their entire stack to Python 3 once the release becomes stable. Keep in mind that since this a release candidate, it is not ready to be used in production.

4 of 87 comments (clear)

  1. Re:This should help: by Anonymous Coward · · Score: 2, Informative

    Nope, that link just goes to a page that says:

    let methat for you [sic]

    [Google Search] [I'm Feeling Lucky]

    Enable javascript to use LMGTFY.

  2. Scrapy is a web spider by Art3x · · Score: 3, Informative

    From the summary:

    Scrapy with beta Python 3 support is finally here!

    Here's how I would write it:

    Scrapy, a web spider, now has beta support for Python 3.

    This is why I get paid the big bucks.

  3. Re:What the fuck is Scrapy? by Anonymous Coward · · Score: 5, Informative

    Scrapy (/skrepi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.

  4. Additional information by stummjr · · Score: 5, Informative

    Sorry guys for the not so informative story up there. Well, Scrapy is an open source framework to build web crawlers in Python. The lack of Python 3 support was a huge blocker for people who wanted to use Scrapy, but didn't want to use Python 2.7 anymore. This is why this release is a milestone for Scrapy users. It's very popular between python developers working with web crawling/web scraping. You can check the project page at GitHub here: https://github.com/scrapy/scra...