nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-18 22:13:27 +00:00

250 lines
2.6 KiB
Text

404enemy
ALittle Client
Abonti
AfD-Verbotsverfahren
Aipbot
Alexibot
AlphaBot
Anarchy
Ankit
Attach
AwarioSmartBot
BBBike
BDFetch
Backlink-Ceck
BacklinkCrawler
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
Blow
Boardreader
Brandwatch
BuiltBotTough
BuiltWith
CATExplorador
CODE87
Calculon
CazoodleBot
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Citoid
Crawling at Home Project
CrazyWebCrawler
CyotekWebCopy
DIIbot
DTS Agent
DataCha0s
Demon
Deusu
Devil
Digincore
Discobot
DomainCrawler
DomainStatsBot
Domains Project
Dragonfly
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Evil
Exabot
ExtLinksBot
ExtractorPro
Ezooms
FHscan
Foobot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GoZilla
Gotit
Grafula
HEADMasterSEO
Haansoft
HaosouSpider
HybridBot
IRLbot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Iskanie
IstellaBot
JOC Web Spider
JennyBot
JetCar
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Larbin
Leap
LeechFTP
LeechGet
Libwhisker
LieBaoFast
Likse
LinkWalker
Linkbot
Linkdexbot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MIIxpc
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mojeek
Mojolicious
Msrabot
Nameprotect
Net Vampire
NetAnts
NetLyzer
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nimbostratus
Ninja
Nmap
Nuclei
Nutch
Offline Explorer
Offline Navigator
OrangeSpider
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Papa Foto
Petalbot
Picscout
Piepmatz
Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
RSSingBot
RankActive
Rankivabot
Ripper
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
ScreenerBot
ScrepyBot
Searchestate
Seomoz
Shodan
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Sociscraper
SpaceBison
SpankBot
SputnikBot
Sqlworm
Sqworm
SuperHTTP
Surfbot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Tracemyfile
True_Robot
Typhoeus
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
Voil
Voltron
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers/3.0
Web Fetch
Web Pix
Web Sucker
WebAuto
WebImageCollector
WebPix
WebWhacker
Webster
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zeus
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
facebookscraper
gopher
ips-agent
iubenda-radar
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
plumanalytics
ripz
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
spyfu
sysscan
voyagerx.com
webgains-bot
x22Mozilla
zauba.io