SecretScraper is a highly configurable web scraper tool that crawls links from target websites and extracts sensitive data using regular expressions.
Usage: Python version >= 3.9
Features:
Web scraping: Extract links using DOM hierarchy and regular expressions.
Supports domain whitelist and blacklist.
Supports multiple targets, input target URLs from a file.
Supports local file scanning, customizable with headers, proxies, timeouts, cookies, crawl depth, follow redirects, etc.
Built-in regular expressions for searching sensitive information, flexibly configured in YAML format.
Installation:
pip install secretscraper
Update:
pip install --upgrade secretscraper
Single target:
secretscraper -u https://xxxxxxx.com/