nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-13 10:13:11 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404enemy
BacklinkCrawler
Battleztar Bazinga
BlackWidow
Bullseye
CSHttp
Cosmos
CrazyWebCrawler
Crescent
DBLBot
Demon
Devil
DomainStatsBot
EroCrawler
Extreme Picture Finder
Flunky
GetWeb
Gotit
Grafula
HTMLparser
Havij
Humanlinks
IDBTE4M
IRLbot
IndeedBot
InfoTekies
Information Security Team InfraSec Scanner
InternetMeasurement
Iskanie
Jorgee
Keybot Translation-Search-Machine
Leap
LexiBot
Lightspeedsystems
LinkWalker
LinkextractorPro
Lipperhey Spider
Ltx71
MJ12bot
Majestic-SEO
MauiBot
MeanPath Bot
Meanpathbot
Nameprotect
NearSite
Nibbler
Nikto
Offline Navigator
Openfind
Pi-Monster
Picscout
Piepmatz
Pixray
ProPowerBot
ProWebWalker
Proximic
Pu_iN
PyCurl
Reaper
Screaming
SenutoBot
SocialRankIOBot
Sociscraper
Swiftbot
TheNomad
Turnitin
TwengaBot
URLy Warning
WWW-Mechanize
Wallpapers
WeSEE
WebEnhancer
WebStripper
WebmasterWorldForumBot
Website Quester
Whack
Who.is Bot
Widow
Wonderbot
Xaldon_WebSpider
Zade
Zitebot
ZyBorg
anthropic-ai
check1.exe
clark-crawler
crawl.sogou.com
crawler4j
eCatch
heritrix
ips-agent
iubenda-radar
linkdexbot
lwp-request
netEstate NE Crawler
oBot
openai
seocompany.store
seostar