io.github.nolindnaidoo/scrape-le
Scrape-LE
Analyse robots.txt content and report whether a path may be crawled.
- 2.4.0
- Version
- npm
- Transport
- —
- Tools
Security review
Review passedReviewed 1d ago.
- metadata: scanned
- packages: 1 checked
No findings.
Analyse robots.txt content and report whether a path may be crawled.
Reviewed 1d ago.
No findings.