nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-28 22:06:44 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
AIBOT
ASPSeek
Abonti
Aboundexbot
AfD-Verbotsverfahren
Aipbot
Alexibot
Anarchie
Anarchy
Ankit
AwarioSmartBot
BDFetch
Battleztar Bazinga
Bigfoot
Bitacle
Buddy
BuiltWith
CCBot
CazoodleBot
Cegbfeieh
CensysInspect
CherryPicker
Claritybot
Cliqzbot
Cogentbot
Copyscape
Cosmos
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DSearch
Devil
Discoverybot
DomainCrawler
Dotbot
Dragonfly
EMail Siphon
EMail Wolf
Ecxi
Evil
Exabot
Express WebPictures
Extractor
Ezooms
FemtosearchBot
FlashGet
Flunky
Foobot
Freeuploader
GT::WWW
Genieo
Getintent
Gigabot
Go!Zilla
GoZilla
Grabber
Grafula
GrapeFX
GridBot
HTMLparser
Harvest
Heritrix
Humanlinks
IDBot
Iblog
IlseBot
Image Fetch
Internet Ninja
InternetSeer
Iskanie
IstellaBot
Keyword Density
Kinza
LWP::Simple
Lftp
Libwhisker
Linkbot
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
Mag-Net
MarkWatch
Mass Downloader
Masscan
MauiBot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Minefield
Moblie Safari
Mojolicious
Mozlila
Msrabot
NICErsPRO
NPbot
Name Intelligence
Nessus
NetZIP
Netvibes
NextGenSearchBot
Not
OpenLinkProfiler
OpenVAS
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
Pandalytics
Papa Foto
PeoplePal
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
ProWebWalker
Pu_iN
PxBroker
Quick-Crawler
RSSingBot
RankingBot2
RealDownload
RedesScrapy
Rogerbot
SBIder
SEOlyticsCrawler
SEOprofiler
SISTRIX
Scanbot
Screaming
ScreenerBot
ScrepyBot
SemanticJuice
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitevigil
Snapbot
Snoopy
SocialRankIOBot
Sottopop
Spbot
Spinn3r
Sqlmap
Steeler
Sucuri
SuperBot
SurveyBot
Suzuran
Teleport
The Intraformant
TheNomad
TightTwatBot
Toata
Tracemyfile
Typhoeus
VB Project
Vacuum
Vagabondo
Virusdie
VoidEYE
Voil
Voltron
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
Web Auto
Web Pix
Web Sauger
Web Sucker
WebCollage
WebFetch
WebFuck
WebGo IS
WebLeacher
WebReaper
WebSucker
Webshag
Website Quester
WebsiteExtractor
Webster
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Wprecon
Xenu
Zauba
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
ZyBorg
archive.org_bot
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com
eCatch
evc-batch
gopher
internetVista monitor
ips-agent
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
seostar
sexsearcher
spyfu
trendiction.com
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe
zauba.io