npm 包搜索

搜索 npm 上的 JavaScript 依赖包

搜索 "crawl" 的结果（共 8 个）
fdir

The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

MIT
util os sys fs walk crawler directory files io tiny-glob glob fast-glob speed javascript nodejs
fireworm

A crawling file watcher.

MIT
filewatching utility
get-all-files

A blazing fast recursive directory crawler with lazy sync and async iterator support.

MIT
fs recursive readdir path directory files lazy async iterator iterable
component-search2

search through crawl components

MIT
recrawl-sync

[![npm](https://img.shields.io/npm/v/recrawl-sync.svg)](https://www.npmjs.com/package/recrawl-sync) [![ci](https://github.com/aleclarson/recrawl/actions/workflows/release.yml/badge.svg)](https://github.com/aleclarson/recrawl/actions/workflows/release.yml)

MIT
fs crawl crawler directory readdir glob globby recrawl tiny
limiter

A generic rate limiter for the web and node.js. Useful for API clients, web crawling, or other tasks that need to be throttled

MIT
rate limiting throttling
scrawl

Dumb comment parsing for node

isbot

🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.

Unlicense
bot crawlers spiders googlebot useragent user agent parsing 🤖