nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-12 10:13:39 +00:00

100 lines
1 KiB
Text

360Spider
404enemy
ASPSeek
Anarchy99
Backlink-Ceck
BuiltWith
Bullseye
CSHttp
Calculon
CazoodleBot
CheTeam
Collector
DSearch
DTS Agent
Demon
DomainStatsBot
EirGrabber
EroCrawler
FacebookBot
Fuzz
Genieo
Getintent
HTTP::Lite
Heritrix
Humanlinks
IDBot
IndeedBot
InfraSec Scanner
InternetMeasurement
IstellaBot
JamesBOT
Kozmosbot
LeechFTP
Lftp
Likse
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MTRobot
Magnet
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mozlila
Msrabot
NPbot
NetSpider
Netvibes
Nmap
Nutch
OrangeSpider
Panscient
Picscout
Pixray
PleaseCrawl
Quick-Crawler
Rainbot
ScrepyBot
SemrushBot
SemrushBot-SI
SeoSiteCheckup
Shodan
Siphon
SmartDownload
Sottopop
Spinn3r
SplitSignalBot
Swiftbot
TeleportPro
Thumbor
TinyTestBot
V-BOT
Wallpapers/3.0
WeSEE
Web Auto
WebBandit
WebCollage
WebFetch
WebWhacker
Widow
Xaldon WebSpider
ZumBot
awario.com
check1.exe
cohere-ai
eCatch
lwp-trivial
page scorer
satoristudio.net
seoscanners
sogouspider
trendiction.com
webgains-bot
webmeup-crawler