nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-15 10:09:15 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ADmantX
ALittle Client
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Anarchie
Anarchy
Ankit
BBBike
Badass
BatchFTP
Bigfoot
Bitacle
Black Hole
BotALot
BuiltBotTough
BuiltWith
CCBot
CODE87
CensysInspect
Chlooe
Cliqzbot
Copier
Copyscape
Cosmos
DBLBot
DSearch
DTS Agent
DataCha0s
Deusu
Devil
Digincore
Disco
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
Domains Project
EMail Wolf
EasyDL
Ebingbong
Ecxi
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
FDM
FemtosearchBot
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
Genieo
GetRight
GetWeb
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grafula
HEADMasterSEO
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
Hloader
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
Intelliseek
InterGET
InternetSeer
Iskanie
JOC Web Spider
JetCar
JikeSpider
Joomla
JustView
Jyxobot
Kenjin Spider
Larbin
Leap
Lftp
Libwhisker
LieBaoFast
LinkScan
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MIDown tool
MJ12bot
Magnet
Majestic SEO
MarkMonitor
Mass Downloader
Mata Hari
Mb2345Browser
Meanpathbot
Microsoft Data Access
Mister PiX
Mojolicious
NICErsPRO
Nameprotect
Navroad
NearSite
NetLyzer
NetSpider
NetZIP
Netvibes
Niki-bot
Nikto
Not
Nuclei
Offline Explorer
OpenVAS
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pavuk
PeoplePal
Petalbot
Picsearch
Piepmatz
Pimonster
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pu_iN
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot2
ReGet
RealDownload
RebelMouse
Recorder
SBIder
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScanAlert
Scrapy
Screaming
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
SentiBot
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SlySearch
Snake
Snapbot
Sociscraper
Sosospider
SpaceBison
Spinn3r
SuperBot
Surfbot
SurveyBot
T8Abot
Teleport
TeleportPro
Telesphorep
TightTwatBot
Titan
Toata
Toweyabot
Trendiction
True_Robot
Turnitin
Twice
URLy.Warning
Upflow
Vacuum
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
Web Auto
Web Collage
Web Pix
WebImageCollector
WebLeacher
WebPix
WebStripper
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Webster
Whack
WinHTTrack
WiseGuys Robot
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
ZmEu
ZoominfoBot
ZyBorg
archive.org_bot
autoemailspider
coccocbot-web
cognitiveseo
dataforseo.com
facebookscraper
ips-agent
isitwp.com
lwp-trivial
meanpathbot
oBot
ripz
satoristudio.net
seobility
seoscanners
seostar
siteripz
sogouspider
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webpros.com
xpymep1.exe
zauba.io