Scrapy

A high-level Web Crawling and Web Scraping framework

112 个版本 Python >=3.10
安装
pip install Scrapy
poetry add Scrapy
pipenv install Scrapy
conda install Scrapy
描述

|logo|

.. |logo| image:: https://raw.githubusercontent.com/scrapy/scrapy/master/docs/_static/logo.svg :target: https://scrapy.org :alt: Scrapy :width: 480px

|version| |python_version| |ubuntu| |macos| |windows| |coverage| |conda| |deepwiki|

.. |version| image:: https://img.shields.io/pypi/v/Scrapy.svg :target: https://pypi.org/pypi/Scrapy :alt: PyPI Version

.. |python_version| image:: https://img.shields.io/pypi/pyversions/Scrapy.svg :target: https://pypi.org/pypi/Scrapy :alt: Supported Python Versions

.. |ubuntu| image:: https://github.com/scrapy/scrapy/workflows/Ubuntu/badge.svg :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AUbuntu :alt: Ubuntu

.. |macos| image:: https://github.com/scrapy/scrapy/workflows/macOS/badge.svg :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AmacOS :alt: macOS

.. |windows| image:: https://github.com/scrapy/scrapy/workflows/Windows/badge.svg :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AWindows :alt: Windows

.. |coverage| image:: https://img.shields.io/codecov/c/github/scrapy/scrapy/master.svg :target: https://codecov.io/github/scrapy/scrapy?branch=master :alt: Coverage report

.. |conda| image:: https://anaconda.org/conda-forge/scrapy/badges/version.svg :target: https://anaconda.org/conda-forge/scrapy :alt: Conda Version

.. |deepwiki| image:: https://deepwiki.com/badge.svg :target: https://deepwiki.com/scrapy/scrapy :alt: Ask DeepWiki

Scrapy_ is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_ (formerly Scrapinghub) and many other contributors_.

.. _many other contributors: https://github.com/scrapy/scrapy/graphs/contributors .. _Scrapy: https://scrapy.org/ .. _Zyte: https://www.zyte.com/

Install with:

.. code:: bash

pip install scrapy

And follow the documentation_ to learn how to use it.

.. _documentation: https://docs.scrapy.org/en/latest/

If you wish to contribute, see Contributing_.

.. _Contributing: https://docs.scrapy.org/en/master/contributing.html

版本列表
2.16.0 2026-05-19
2.15.2 2026-04-28
2.15.1 2026-04-23
2.15.0 2026-04-09
2.14.2 2026-03-12
2.14.1 2026-01-12
2.14.0 2026-01-05
2.13.4 2025-11-17
2.13.3 2025-07-02
2.13.2 2025-06-09
2.13.1 2025-05-28
2.13.0 2025-05-08
2.12.0 2024-11-18
2.11.2 2024-05-14
2.11.1 2024-02-14
2.11.0 2023-09-18
2.10.1 2023-08-30
2.10.0 2023-08-04
2.9.0 2023-05-08
2.8.0 2023-02-02
2.7.1 2022-11-02
2.7.0 2022-10-17
2.6.3 2022-09-27
2.6.2 2022-07-25
2.6.1 2022-03-01
2.6.0 2022-03-01
2.5.1 2021-10-05
2.5.0 2021-04-06
2.4.1 2020-11-17
2.4.0 2020-10-11
2.3.0 2020-08-04
2.2.1 2020-07-17
2.2.0 2020-06-24
2.1.0 2020-04-24
2.0.1 2020-03-18
2.0.0 2020-03-03
1.8.4 2024-02-14
1.8.3 2022-07-25
1.8.2 2022-03-01
1.8.1 2021-10-05
1.8.0 2019-10-29
1.7.4 2019-10-21
1.7.3 2019-08-01
1.7.2 2019-07-23
1.7.1 2019-07-18
1.7.0 2019-07-18
1.6.0 2019-01-30
1.5.2 2019-01-22
1.5.1 2018-07-11
1.5.0 2017-12-29
1.4.0 2017-05-18
1.3.3 2017-03-10
1.3.2 2017-02-13
1.3.1 2017-02-08
1.3.0 2016-12-21
1.2.3 2017-03-03
1.2.2 2016-12-06
1.2.1 2016-10-21
1.2.0 2016-10-03
1.1.4 2017-03-03
1.1.3 2016-09-22
1.1.2 2016-08-18
1.1.1 2016-07-13
1.1.0 2016-05-11
1.1.0rc4 2016-04-28
1.1.0rc3 2016-03-01
1.1.0rc2 2016-02-29
1.1.0rc1 2016-02-04
1.0.7 2017-03-03
1.0.6 2016-05-04
1.0.5 2016-02-03
1.0.4 2015-12-30
1.0.3 2015-08-11
1.0.2 2015-08-06
1.0.1 2015-07-01
1.0.0 2015-06-19
1.0.0rc3 2015-06-12
1.0.0rc2 2015-06-05
1.0.0rc1 2015-05-22
0.24.6 2015-04-20
0.24.5 2015-02-25
0.24.4 2014-08-09
0.24.3 2014-08-09
0.24.2 2014-07-08
0.24.1 2014-06-27
0.24.0 2014-06-26
0.22.2 2014-02-14
0.22.1 2014-02-08
0.22.0 2014-01-17
0.20.2 2013-12-09
0.20.1 2013-11-28
0.20.0 2013-11-08
0.18.4 2013-10-10
0.18.3 2013-10-03
0.18.2 2013-09-04
0.18.1 2013-08-27
0.18.0 2013-08-10
0.16.5 2013-05-30
0.16.4 2013-01-23
0.16.3 2012-12-07
0.16.2 2012-11-09
0.16.1 2012-10-26
0.16.0 2012-10-18
0.14.4 2012-05-15
0.14.3 2012-04-20
0.14.2 2012-03-11
0.14.1 2012-01-02
0.12.0.2550 2011-10-25
0.10.4.2364 2010-11-16
0.9 2010-06-28
0.8 2009-12-12
0.7 2010-01-20