nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-09 22:08:29 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ALittle Client
AfD-Verbotsverfahren
Alexibot
Alligator
Apexoo
Aspiegel
BDCbot
BackStreet
Backlink-Ceck
Badass
Bandit
BatchFTP
Bigfoot
Blackboard
Bolt
Brandwatch
BuiltBotTough
Bullseye
CATExplorador
CODE87
CSHttp
CheTeam
CherryPicker
Claritybot
Cliqzbot
Cocolyzebot
Copier
Curious
Custo
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
DigitalPebble
Disco
Discobot
DnyzBot
DomCopBot
DomainSigmaCrawler
Dotbot
Download Wonder
ECCP/1.0
EasyDL
Ecxi
EirGrabber
Extractor
Ezooms
FDM
FemtosearchBot
Firefox/7.0
FlashGet
FyberSpider
GermCrawler
Go!Zilla
GrabNet
Grabber
Grafula
GrapeFX
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
Harvest
Havij
IRLbot
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoTekies
Intelliseek
InterGET
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
Jetty
Joomla
Jorgee
JustView
Keyword Density
LNSpiderguy
Lanshanbot
Leap
LeechGet
LibWeb
Likse
Linkdexbot
LinkpadBot
LinqiaScrapeBot
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Moblie Safari
Mozlila
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
NetLyzer
NetZIP
Nettrack
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nuclei
Nutch
OpenLinkProfiler
Openfind
Openvas
OrangeSpider
OutfoxBot
PageAnalyzer
Panscient
Papa Foto
Pavuk
Petalbot
Picsearch
Pimonster
ProPowerBot
ProWebWalker
Pump
RankActiveLinkBot
RankingBot2
RealDownload
Reaper
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
ScanAlert
ScoutJet
Scrapy
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
SlySearch
SmartDownload
Sociscraper
SpaceBison
Spanner
Spbot
Spinn3r
Sqlmap
Stripper
Sucker
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
T8Abot
Teleport
Telesphorep
The Intraformant
Thumbor
Toata
Tracemyfile
TwengaBot
URLy Warning
UnisterBot
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Fetch
Web Pix
Web Sucker
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebWhacker
Webalta
Whacker
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Zermelo
ZmEu
ZoomBot
ZumBot
ZyBorg
autoemailspider
check1.exe
coccocbot-web
crawler.feedback
crawler4j
dataforseo.com
facebookscraper
gopher
instabid
meanpathbot
oBot
page scorer
polaris version
probe-image-size
scan.lol
seoscanners
seostar
sogouspider
sp_auditbot
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x22Mozilla