readability-lxml

fast html to text parser (article readability tool) with python 3 support

Apache License 2.0 25 个版本
Yuri Baburov <burchik@gmail.com>
主页
Homepage
安装
pip install readability-lxml
poetry add readability-lxml
pipenv install readability-lxml
conda install readability-lxml
描述

PyPI version

python-readability

Given an HTML document, extract and clean up the main body text and title.

This is a Python port of a Ruby port of arc90's Readability project.

Installation

It's easy using pip, just run:

$ pip install readability-lxml

As an alternative, you may also use conda to install, just run:

$ conda install -c conda-forge readability-lxml

Usage

>>> import requests
>>> from readability import Document

>>> response = requests.get('http://example.com')
>>> doc = Document(response.content)
>>> doc.title()
'Example Domain'

>>> doc.summary()
"""<html><body><div><body id="readabilityBody">\n<div>\n    <h1>Example Domain</h1>\n
<p>This domain is established to be used for illustrative examples in documents. You may
use this\n    domain in examples without prior coordination or asking for permission.</p>
\n    <p><a href="http://www.iana.org/domains/example">More information...</a></p>\n</div>
\n</body>\n</div></body></html>"""

Change Log

  • 0.8.4 Better CJK support, thanks @cdhigh
  • 0.8.3.1 Support for python 3.8 - 3.13
  • 0.8.3 We can now save all images via keep_all_images=True (default is to save 1 main image), thanks @botlabsDev
  • 0.8.2 Added article author(s) (thanks @mattblaha)
  • 0.8.1 Fixed processing of non-ascii HTMLs via regexps.
  • 0.8 Replaced XHTML output with HTML5 output in summary() call.
  • 0.7.1 Support for Python 3.7 . Fixed a slowdown when processing documents with lots of spaces.
  • 0.7 Improved HTML5 tags handling. Fixed stripping unwanted HTML nodes (only first matching node was removed before).
  • 0.6 Finally a release which supports Python versions 2.6, 2.7, 3.3 - 3.6
  • 0.5 Preparing a release to support Python versions 2.6, 2.7, 3.3 and 3.4
  • 0.4 Added Videos loading and allowed more images per paragraph
  • 0.3 Added Document.encoding, positive_keywords and negative_keywords

Licensing

This code is under the Apache License 2.0 license.

Thanks to

  • Latest readability.js
  • Ruby port by starrhorne and iterationlabs
  • Python port by gfxmonk
  • Decruft effort to move to lxml
  • "BR to P" fix from readability.js which improves quality for smaller texts
  • Github users contributions.
分类
Environment :: Web Environment Intended Audience :: Developers Operating System :: OS Independent Programming Language :: Python Programming Language :: Python :: 3 Programming Language :: Python :: 3.10 Programming Language :: Python :: 3.11 Programming Language :: Python :: 3.12 Programming Language :: Python :: 3.13 Programming Language :: Python :: 3.8 Programming Language :: Python :: 3.9 Programming Language :: Python :: Implementation :: PyPy Topic :: Internet Topic :: Software Development :: Libraries :: Python Modules Topic :: Text Processing :: Indexing Topic :: Utilities
版本列表
0.8.4.1 2025-05-03
0.8.4 2025-05-03
0.8.1 2020-07-04
0.7.1 2019-04-29
0.7 2018-05-07
0.6.2 2016-04-11
0.6.1 2015-08-26
0.6.0.5 2015-07-27
0.6.0.4 2015-07-27
0.6.0.3 2015-07-26
0.5.1 2015-05-06
0.5 2015-04-27
0.3.0.6 2015-03-16
0.3.0.5 2014-09-22
0.3.0.3 2014-04-02
0.3.0.2 2013-10-10
0.3.0.1 2013-10-09
0.3 2013-10-09
0.2.6.1 2012-07-17
0.2.6 2012-06-21
0.2.5 2012-04-19
0.2.3 2011-07-26
0.2.2 2011-07-26
0.2.1 2011-07-01
0.2 2011-06-30