nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-09 22:08:10 +00:00

100 lines
1.1 KiB
Text

80legs
AwarioBot
AwarioRssBot
BackWeb
Brandwatch
Buddy
Cegbfeieh
CopyRightCheck
Custo
Devil
DigitalPebble
Dirbuster
Disco
DomainCrawler
DomainSigmaCrawler
Dragonfly
EMail Siphon
EirGrabber
EroCrawler
FlashGet
FrontPage
GeedoProductSearch
HMView
HTMLparser
HTTrack
IlseBot
InfoTekies
Internet Ninja
InternetMeasurement
JamesBOT
JetCar
Jorgee
Kenjin Spider
Keyword Density
Leap
LibWeb
Lightspeedsystems
LinkScan
MQQBrowser
Meanpathbot
Mediatoolkitbot
Morfeus Fucking Scanner
Mozlila
NPbot
Nessus
Nettrack
NextGenSearchBot
Nikto
Offline Navigator
Pandalytics
Panscient
PeoplePal
Pixray
Proximic
Pump
RankurBot
SEOstats
Semrush
SiteAuditBot
Sitevigil
SmartDownload
Snake
Sociscraper
Spbot
Spinn3r
SplitSignalBot
SputnikBot
Surfbot
Telesphoreo
Toweyabot
TurnitinBot
V-BOT
VCI
WEBDAV
WWW-Mechanize
Web Pix
WebFetch
WebImageCollector
WebWhacker
Whack
WinHTTrack
Woobot
Wprecon
Zermelo
ZyBorg
adscanner
arquivo-web-crawler
dataforseo.com
eCatch
everyfeed-spider
gopher
heritrix
magpie-crawler
mediawords
seocompany.store
serpstatbot
sexsearcher
tAkeOut
ubermetrics-technologies.com
zauba.io