robots-parser@2.4.0

NodeJS robots.txt parser with support for wildcard (*) matching.

MIT 2021-12-20

npm install robots-parser@2.4.0

yarn add robots-parser@2.4.0

pnpm add robots-parser@2.4.0

bun add robots-parser@2.4.0

3.0.1 2023-02-21

3.0.0 2022-01-07

2.4.0 2021-12-20

2.3.0 2021-03-14

2.2.0 2021-02-11

2.1.1 2018-11-24

2.1.0 2018-03-21

2.0.0 2018-03-21

1.0.2 2018-01-25

1.0.1 2016-11-16

1.0.0 2014-09-27