nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-16 22:07:07 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
AIBOT
Abonti
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Alligator
Ankit
Anthill
Attach
AwarioRssBot
AwarioSmartBot
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Battleztar Bazinga
BetaBot
BlackWidow
BlowFish
Brandwatch
BuiltWith
CATExplorador
CCBot
CazoodleBot
Cegbfeieh
CherryPicker
ChinaClaw
Claritybot
Cocolyzebot
Cogentbot
CopyRightCheck
Craftbot
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
Deusu
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Drip
EMail Siphon
EirGrabber
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
FDM
FHscan
Fimap
Fuzz
FyberSpider
Fyrebot
GetWeb
Getintent
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HMView
Hloader
IDBTE4M
IRLbot
IlseBot
Image Fetch
Image Sucker
InfoTekies
Iria
JOC Web Spider
JamesBOT
JetCar
Joomla
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LexiBot
LibWeb
Lightspeedsystems
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
Magnet
Majestic SEO
MauiBot
MegaIndex.ru
Microsoft Data Access
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Msrabot
Nameprotect
Navroad
Nessus
Net Vampire
NetSpider
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
Nimbostratus
Nutch
Offline Navigator
OpenLinkProfiler
OutfoxBot
POE-Component-Client-HTTP
Pandalytics
Panscient
PeoplePal
Picscout
Piepmatz
Pockey
Psbot
Pump
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankurBot
ReGet
RealDownload
Recorder
RedesScrapy
Rogerbot
SEOkicks
Scrapy
Searchestate
SentiBot
SeoSiteCheckup
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
SmartDownload
Snake
Sociscraper
Sottopop
Spanner
SputnikBot
Sqlmap
Steeler
Surfbot
SurveyBot
T0PHackTeam
Telesoft
Telesphoreo
TheNomad
Thumbor
Toata
Tracemyfile
True_Robot
TurnitinBot
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
WBSearchBot
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Enhancer
WebBandit
WebEnhancer
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebSucker
WebZIP
Website Quester
Webster
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zitebot
ZoomBot
ZoominfoBot
arquivo-web-crawler
backlink-check
coccocbot-web
com.plumanalytics
dataforseo.com
evc-batch
gopher
heritrix
instabid
lwp-request
lwp-trivial
mediawords
probe-image-size
ripz
scalaj-http
seostar
serpstatbot
siteripz
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io
zgrab