Scrapy 1.1.0rc1 发布,支持 Python 3

Item loaders now support nested loaders (:issue:`1467`).

FormRequest.from_response improvements (:issue:`1382`, :issue:`1137`).

Added setting :setting:`AUTOTHROTTLE_TARGET_CONCURRENCY` and improved AutoThrottle docs (:issue:`1324`).

Added response.text to get body as unicode (:issue:`1730`).

Anonymous S3 connections (:issue:`1358`).

Deferreds in downloader middlewares (:issue:`1473`). This enables better robots.txt handling (:issue:`1471`).

HTTP caching now follows RFC2616 more closely, added settings:setting:`HTTPCACHE_ALWAYS_STORE` and:setting:`HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS` (:issue:`1151`).

Selectors were extracted to the parsel library (:issue:`1409`). This means you can use Scrapy Selectors without Scrapy and also upgrade the selectors engine without needing to upgrade Scrapy.

　　　　　　　　　　　　　 查看评论 回复