nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2026-04-13 22:20:57 +00:00

100 lines
1.1 KiB
Text

01h4x.com
Aipbot
Alexibot
Aliyun
Anarchy99
AwarioSmartBot
BuiltBotTough
Bullseye
BunnySlippers
CazoodleBot
CheTeam
Cogentbot
Copier
CrunchBot
Curious
Custo
CyotekWebCopy
DTS Agent
Disco
DittoSpyder
Extreme Picture Finder
G-i-g-a-b-o-t
GT::WWW
GetRight
Gotit
GrabNet
Hloader
IDBTE4M
Information Security Team InfraSec Scanner
InfraSec Scanner
InternetMeasurement
Kozmosbot
LibWeb
Lightspeedsystems
Lipperhey
Lipperhey Spider
MIDown tool
Metauri
Microsoft Data Access
Mozlila
Needle
Nettrack
Nimbostratus
Openvas
OrangeBot
OutclicksBot
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Picsearch
PictureFinder
PleaseCrawl
Rainbot
ReGet
Rogerbot
SEOkicks-Robot
SEOstats
Scrapy
Searchestate
SemrushBot-FT
SeobilityBot
Sogou web spider
SpankBot
Spanner
Spinn3r
Sqlmap
Sqworm
Steeler
TinyTestBot
Titan
Trendiction
VoidEYE
Voltron
WeSEE
Web Auto
WebFuck
WebGo IS
WebReaper
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Whack
Whatweb
Widow
Xaldon_WebSpider
YaK
YoudaoBot
Zitebot
check1.exe
cognitiveseo
crawler.feedback
dataforseobot
meanpathbot
openai
probe-image-size
seostar
sitechecker.pro
sysscan
x22Mozilla