nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-23 10:07:13 +00:00

100 lines
1 KiB
Text

AIBOT
Abonti
AfD-Verbotsverfahren
AllSubmitter
BackStreet
Barkrowler
Bitacle
Blow
BlowFish
Bullseye
CheTeam
Chlooe
ClaudeBot
Cloud mapping
Collector
Crawling at Home Project
CrunchBot
DTS Agent
Demon
DigitalPebble
Dirbuster
DnyzBot
DomCopBot
ExtLinksBot
Extractor
FlashGet
Fyrebot
GT::WWW
Getintent
GrabNet
Hloader
IDBTE4M
Indy Library
Internet Ninja
IstellaBot
JOC Web Spider
Lftp
Likse
MSIECrawler
Mag-Net
Metauri
Microsoft URL Control
MolokaiBot
Mozlila
NPbot
Navroad
NetLyzer
NetZIP
Nettrack
Nikto
NimbleCrawler
Nimbostratus
Nmap
Openfind
PHPCrawl
PageAnalyzer
QueryN Metasearch
Re-re
Reaper
Ripper
Rogerbot
SEOprofiler
ScanAlert
Seekport
SemrushBot
SeoSiteCheckup
Seomoz
SpaceBison
Sqworm
SurveyBot
Telesoft
Telesphoreo
Thumbor
Toata
Vagabondo
VeriCiteCrawler
VidibleScraper
Wallpapers
WallpapersHD
Web Auto
Web Sauger
WebEnhancer
WebImageCollector
WebmasterWorldForumBot
Webster
Whacker
Whatweb
Zauba
arquivo-web-crawler
autoemailspider
cognitiveseo
crawl.sogou.com
dataforseo.com
gopher
heritrix
netEstate NE Crawler
probe-image-size
scalaj-http
webmeup-crawler
zgrab