nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-01 22:08:19 +00:00

100 lines
1.1 KiB
Text

360Spider
80legs
Aboundex
Atomseobot
AwarioSmartBot
BBBike
BDCbot
BackStreet
Backlink-Ceck
Barkrowler
BatchFTP
Collector
Copyscape
Craftbot
Crescent
CrunchBot
Custo
DIIbot
DatabaseDriverMysqli
Deusu
Discobot
DomainSigmaCrawler
DomainStatsBot
EasyDL
Evil
Genieo
Go-Ahead-Got-It
GoZilla
HTTP::Lite
Heritrix
Humanlinks
Image Fetch
Information Security Team InfraSec Scanner
Jetty
JikeSpider
Lanshanbot
Lftp
Lightspeedsystems
LinqiaRSSBot
Lmspider
MTRobot
Mass Downloader
Metauri
Microsoft Data Access
Musobot
Needle
Nutch
PHPCrawl
PageGrabber
Papa Foto
Piepmatz
ProWebWalker
Proximic
Pump
PyCurl
RankingBot
SEOkicks-Robot
SEOprofiler
SemrushBot-SI
SiteCheckerBotCrawler
SmartDownload
Sogou web spider
Spanner
Spbot
Spinn3r
SplitSignalBot
SputnikBot
Sqlmap
Stripper
Sucker
T0PHackTeam
Telesoft
Trendictionbot
TwengaBot
Upflow
V-BOT
WWW::Mechanize
Web Sauger
WebEnhancer
WebFuck
WinHTTrack
Wprecon
Xaldon_WebSpider
Xenu
adscanner
arquivo-web-crawler
autoemailspider
cah.io.community
check1.exe
cognitiveseo
cohere-ai
facebookscraper
instabid
muhstik-scan
s1z.ru
sp_auditbot
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler