nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-16 22:09:47 +00:00

100 lines
1 KiB
Text

01h4x.com
Aboundexbot
AdsTxtCrawlerTP
AllSubmitter
Ankit
Asterias
Attach
BatchFTP
Bitacle
Brandprotect
Buck
Buddy
Bytespider
CCBot
ChinaClaw
ClaudeBot
Collector
CopyRightCheck
Crescent
DSearch
Deusu
Exabot
Express WebPictures
Extreme Picture Finder
Foobot
GPTBot
GoZilla
Gotit
HEADMasterSEO
Humanlinks
Image Sucker
InfraSec Scanner
InternetMeasurement
InternetSeer
IstellaBot
Jbrofuzz
JustView
Keybot Translation-Search-Machine
LNSpiderguy
LinkWalker
LinqiaScrapeBot
MIDown tool
MarkWatch
Morfeus Fucking Scanner
NICErsPRO
NearSite
Needle
NetMechanic
NetSpider
Nikto
OpenLinkProfiler
Openfind
OutfoxBot
Panscient
Picscout
Pixray
ProWebWalker
Probethenet
Pump
RealDownload
Reaper
SEOkicks-Robot
ScoutJet
ScrepyBot
SemrushBot-SI
SeobilityBot
SiteSucker
Sitebeam
Snapbot
Sociscraper
Spanner
Spbot
Spider_Bot
Spider_Bot/3.0
Sqlworm
Surfbot
Szukacz
True_Robot
Turnitin
V-BOT
Vacuum
WallpapersHD
Web Auto
WebCollage
WebLeacher
Website Quester
Woobot
Wprecon
Xaldon WebSpider
YaK
Zermelo
ZoomBot
ZoominfoBot
ZyBorg
anthropic-ai
archive.org_bot
gopher
linkdexbot
seostar
zauba.io