nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-31 22:04:45 +00:00

100 lines
1,021 B
Text

404enemy
Alexibot
AllSubmitter
Ankit
AwarioRssBot
BackDoorBot
BacklinkCrawler
BatchFTP
Black Hole
BlowFish
Bolt
Cliqzbot
Custo
DBLBot
DIIbot
DataCha0s
Dirbuster
Dispatch
DomCopBot
Ecxi
Express WebPictures
FDM
FHscan
Freeuploader
GetWeb
Gigabot
Grafula
HMView
HTMLparser
HTTrack
HaosouSpider
Hloader
IDBTE4M
Image Fetch
IndeedBot
IstellaBot
Libwhisker
Likse
LinkextractorPro
Lmspider
Ltx71
MIDown tool
MJ12bot
Mag-Net
MarkWatch
Msrabot
NearSite
Needle
Netvibes
Nuclei
OnCrawl
Openvas
OutclicksBot
OutfoxBot
Petalbot
RankActiveLinkBot
RankurBot
SEOkicks-Robot
SalesIntelligent
ScanAlert
ScreenerBot
Searchestate
SeekportBot
Semrush
SeoCherryBot
SlySearch
Snoopy
Stripper
Surfbot
True_Robot
Twice
URLy Warning
UnisterBot
VoidEYE
Voltron
WEBDAV
WallpapersHD
Web Sucker
WebLeacher
WebReaper
Webalta
Webshag
WebsiteQuester
Whacker
YaK
ZoomBot
autoemailspider
cohere-ai
crawl.sogou.com
internetVista monitor
ips-agent
linkfluence
lwp-trivial
muhstik-scan
pcBrowser
probe-image-size
scalaj-http
seoscanners
webprosbot
x22Mozilla