news-please

news-please is an open source easy-to-use news extractor that just works.

Apache License 2.0 134 个版本

Felix Hamborg <felix.hamborg@uni-konstanz.de>

主页

Download

Homepage

安装

pip install news-please

poetry add news-please

pipenv install news-please

conda install news-please

描述

news-please is an open source, easy-to-use news crawler that extracts structured information from almost any news website. It can follow recursively internal hyperlinks and read RSS feeds to fetch both most recent and also old, archived articles. You only need to provide the root URL of the news website. Furthermore, its API allows developers to access the exctraction functionality within their software. news-please also implements a workflow optimized for the news archive provided by commoncrawl.org, allowing users to efficiently crawl and extract news articles including various filter options.

分类

Development Status :: 5 - Production/Stable Environment :: Console Intended Audience :: Developers Intended Audience :: Science/Research License :: OSI Approved :: Apache Software License Operating System :: MacOS Operating System :: Microsoft Operating System :: POSIX :: Linux Programming Language :: Python :: 3.10 Programming Language :: Python :: 3.11 Programming Language :: Python :: 3.12 Programming Language :: Python :: 3.8 Programming Language :: Python :: 3.9 Topic :: Internet Topic :: Scientific/Engineering :: Information Analysis

版本列表

1.6.16 2025-09-21

1.6.15 2025-05-26

1.6.14 2025-03-25

1.6.13 2024-07-29

1.6.12 2024-07-08

1.6.11 2024-07-02

1.6.10 2024-06-26

1.5.48 2024-06-06

1.5.47 2024-06-04

1.5.44 2023-12-27

1.5.43 2023-12-27

1.5.41 2023-12-27

1.5.40 2023-12-22

1.5.35 2023-08-30

1.5.34 2023-08-29

1.5.33 2023-04-17

1.5.22 2022-04-04

1.5.21 2021-05-06

1.5.20 2021-04-22

1.5.18 2021-03-16

1.5.17 2021-02-24

1.5.16 2021-02-07

1.5.15 2021-02-05

1.5.14 2021-02-02

1.5.13 2020-10-23

1.5.3 2020-04-30

1.5.2 2020-04-08

1.5.1 2020-04-06

1.4.26 2020-03-20

1.4.25 2020-01-14

1.4.24 2019-11-08

1.4.23 2019-08-06

1.4.22 2019-08-06

1.4.21 2019-07-15

1.4.20 2019-07-15

1.4.19 2019-07-15

1.4.18 2019-07-15

1.4.17 2019-07-15

1.4.16 2019-07-15

1.4.15 2019-07-15

1.4.14 2019-07-12

1.4.13 2019-07-12

1.4.12 2019-07-12

1.4.11 2019-07-11

1.4.10 2019-07-11

1.3.14 2019-05-13

1.3.13 2019-04-02

1.3.11 2019-03-29

1.3.10 2019-03-28

1.2.53 2019-03-18

1.2.52 2019-02-22

1.2.51 2019-02-21

1.2.50 2018-12-08

1.2.44 2018-11-14

1.2.43 2018-11-14

1.2.42 2018-11-14

1.2.41 2018-06-27

1.2.40 2018-06-05

1.2.39 2018-05-29

1.2.36 2018-02-01

1.2.35 2017-11-27

1.2.33 2017-10-05

1.2.32 2017-10-05

1.2.31 2017-09-04

1.2.28 2017-08-27

1.2.27 2017-08-26

1.2.26 2017-08-18

1.2.25 2017-08-18

1.2.24 2017-08-17

1.2.22 2017-08-17

1.2.21 2017-08-16

1.2.20 2017-08-16

1.2.1 2017-08-16

1.1.53 2017-08-12

1.1.52 2017-08-07

1.1.51 2017-08-04

1.1.50 2017-08-04

1.1.49 2017-07-17

1.1.48 2017-06-29

1.1.47 2017-06-29

1.1.45 2017-06-29

1.1.43 2017-06-29

1.1.41 2017-06-29

1.1.40 2017-06-28

1.1.31 2017-06-25

1.1.30 2017-06-10

1.1.29 2017-06-08

1.1.28 2017-06-01

1.1.27 2017-06-01

1.1.26 2017-05-29

1.1.25 2017-05-29

1.1.23 2017-05-28

1.1.22 2017-05-21

1.1.21 2017-05-18

1.1.20 2017-05-18

1.1.19 2017-05-17

1.1.18 2017-04-03

1.1.17 2017-03-29

1.1.16 2017-03-29

1.1.15 2017-03-20

1.1.14 2017-02-25

1.1.12 2017-02-25

1.1.11 2017-02-24

1.0.27 2017-02-24

1.0.26 2017-02-24

1.0.25 2017-02-17

1.0.24 2016-12-18

1.0.23 2016-12-18

1.0.21 2016-12-18

1.0.20 2016-12-18

1.0.18 2016-11-09

1.0.17 2016-11-09

1.0.16 2016-11-09

1.0.14 2016-11-09

1.0.13 2016-11-09

1.0.12 2016-11-09

1.0.11 2016-11-08

1.0.10 2016-11-08

1.0.9 2016-11-08

1.0.8 2016-11-08

1.0.7 2016-11-08

1.0.6 2016-11-08

1.0.5 2016-11-08

1.0.4 2016-11-08

1.0.3 2016-11-08

1.0.2 2016-10-30

1.0.1 2016-10-30

1.0.0

1.0.0.post6 2016-10-30

1.0.0.post5 2016-10-30

1.0.0.post4 2016-10-23

1.0.0.post3 2016-10-23

1.0.0.post2 2016-10-23

1.0.0.post1 2016-10-23