nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-28 10:09:53 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
AlphaBot
Ankit
Apexoo
Aspiegel
Atomseobot
AwarioSmartBot
BDFetch
Badass
BatchFTP
Battleztar Bazinga
Bitacle
Blackboard
Boardreader
Brandprotect
Buddy
BuiltWith
BunnySlippers
CCBot
CODE87
CazoodleBot
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Collector
Copier
Craftbot
Crawling at Home Project
Crescent
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
Disco
Discobot
DittoSpyder
DomainAppender
DomainCrawler
Domains Project
Dotbot
ECCP/1.0
EasyDL
Ecxi
EroCrawler
Exabot
ExtLinksBot
Extractor
ExtractorPro
Ezooms
Fimap
Foobot
Fyrebot
GermCrawler
GetWeb
Getintent
GoZilla
Gotit
GrapeFX
GrapeshotCrawler
HTTrack
HaosouSpider
HonoluluBot
Humanlinks
IDBot
IlseBot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
Jetty
JikeSpider
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine
LWP::Simple
Likse
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Lmspider
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic-SEO
Masscan
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mozlila
Msrabot
Nameprotect
Nessus
NetAnts
Nibbler
Nikto
Nmap
Nuclei
Offline Explorer
Openfind
OrangeBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
Probethenet
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
Re-re
Reaper
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
ScanAlert
Searchestate
Seekport
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteCheckerBotCrawler
Siteimprove
SmartDownload
Snake
Snoopy
SocialRankIOBot
SpaceBison
Spammen
Spbot
SputnikBot
Sqlworm
Sqworm
Sucuri
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphorep
TheNomad
Toata
Toweyabot
Trendiction
TurnitinBot
TwengaBot
UnisterBot
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Mechanize
WeSEE
Web Auto
Web Fuck
Web Pix
Web Sucker
WebBandit
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebStripper
WebWhacker
Webalta
Website Quester
Whacker
Whatweb
Who.is Bot
Widow
Wonderbot
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
Zauba
Zermelo
Zeus
ZoomBot
adscanner
arquivo-web-crawler
autoemailspider
cah.io.community
cognitiveseo
crawl.sogou.com
evc-batch
facebookscraper
instabid
linkdexbot
lwp-request
oBot
pcBrowser
plumanalytics
probe-image-size
s1z.ru
seobility
seostar
serpstatbot
siteripz
sysscan
trendiction.com
ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zgrab