robots-parser@3.0.1

A specification compliant robots.txt parser with wildcard (*) matching support.

MIT 2023-02-21

npm install robots-parser@3.0.1

yarn add robots-parser@3.0.1

pnpm add robots-parser@3.0.1

bun add robots-parser@3.0.1

3.0.1 2023-02-21

3.0.0 2022-01-07

2.4.0 2021-12-20

2.3.0 2021-03-14

2.2.0 2021-02-11

2.1.1 2018-11-24

2.1.0 2018-03-21

2.0.0 2018-03-21

1.0.2 2018-01-25

1.0.1 2016-11-16

1.0.0 2014-09-27