nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-09 22:11:16 +00:00

100 lines
1.1 KiB
Text

80legs
ASPSeek
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Alexibot
Anthill
AwarioSmartBot
BLEXBot
Backlink-Ceck
Badass
Barkrowler
Blow
Bullseye
BunnySlippers
BuzzSumo
CODE87
Calculon
CheTeam
Cloud mapping
Copyscape
Cosmos
CrunchBot
Custo
DatabaseDriverMysqli
Deusu
Disco
DnBCrawler-Analytics
DomainCrawler
DomainSigmaCrawler
Domains Project
EasyDL
EirGrabber
Flunky
FrontPage
GoZilla
Grabber
Haansoft
HybridBot
InfoNaviRobot
IstellaBot
LNSpiderguy
MSIECrawler
Majestic SEO
Mass Downloader
Meanpathbot
Microsoft URL Control
Minefield
Mozlila
Musobot
NPbot
Nettrack
Nimbostratus
OnCrawl
OpenLinkProfiler
Pavuk
ProPowerBot
Proximic
Psbot
Reaper
RepoMonkey
SEOlyt
ScreenerBot
SemanticJuice
Semrush
SenutoBot
SeoCherryBot
Shodan
Siphon
SiteSucker
Spinn3r
SputnikBot
Sucuri
TeleportPro
Tracemyfile
Vacuum
Virusdie
WWW-Collector-E
WWW::Mechanize
Web Sauger
WebGo IS
WebZIP
Woobot
arquivo-web-crawler
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseobot
everyfeed-spider
instabid
ips-agent
iubenda-radar
muhstik-scan
openai
plumanalytics
ripz
seobility
sogouspider
voyagerx.com