nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-12-04 10:08:42 +02:00

250 lines
2.5 KiB
Text

80legs
Abonti
Aboundex
Acunetix
ADmantX
AhrefsBot
AiHitBot
Aipbot
Alexibot
Anarchie
Ankit
Apexoo
archive.org_bot
arquivo-web-crawler
Attach
AwarioRssBot
BDCbot
BDFetch
Bitacle
Blow
BlowFish
Bolt
Brandwatch
Buddy
BuiltBotTough
Calculon
CATExplorador
CheeseBot
CherryPicker
CheTeam
Claritybot
Cliqzbot
Cogentbot
com.plumanalytics
Copier
Craftbot
CrazyWebCrawler
Custo
CyotekWebCopy
demandbase-bot
Demon
Digincore
DIIbot
Disco
Discobot
DomainAppender
Domains Project
DomainStatsBot
Dragonfly
Drip
DSearch
DTS Agent
Ebingbong
ECCP/1.0
EMail Wolf
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
Ezooms
FemtosearchBot
Fimap
Flunky
Foobot
FrontPage
GermCrawler
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
GT::WWW
heritrix
HMView
HTTP::Lite
HTTrack
HybridBot
Id-search
Image Fetch
IndeedBot
Indy Library
instabid
Intelliseek
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JetCar
JikeSpider
JOC Web Spider
Joomla
Jorgee
JustView
Kenjin Spider
Kinza
LexiBot
Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinkScan
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
lwp-trivial
MarkWatch
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
MegaIndex.ru
Metauri
MIDown tool
MJ12bot
Morfeus Fucking Scanner
MSFrontPage
Msrabot
Musobot
Name Intelligence
Navroad
Needle
Nessus
NetAnts
netEstate NE Crawler
NetSpider
Nettrack
Net Vampire
NetZIP
NextGenSearchBot
Niki-bot
NPbot
Offline Navigator
Openfind
OpenVAS
OPPO A33
OutfoxBot
PageScorer
Pandalytics
Papa Foto
PECL::HTTP
PHPCrawl
PictureFinder
Pixray
Pockey
POE-Component-Client-HTTP
Pump
PyCurl
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RebelMouse
RedesScrapy
RepoMonkey
SalesIntelligent
ScanAlert
Scanbot
scan.lol
ScoutJet
Searchestate
SearchmetricsBot
SEOkicks
Seomoz
SEOprofiler
SeoSiteCheckup
SEOstats
Siphon
SISTRIX
Sitebeam
SiteCheckerBotCrawler
sitechecker.pro
SiteExplorer
Siteimprove
SiteLockSpider
SMTBot
Snake
Snapbot
Sogou web spider
Sottopop
Spanner
Spbot
spyfu
Sqworm
Steeler
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesphoreo
Telesphorep
TightTwatBot
Titan
Toweyabot
Tracemyfile
trendiction.com
trendiction.de
True_Robot
TwengaBot
URLy Warning
Vacuum
Vagabondo
VB Project
VCI
VeriCiteCrawler
Virusdie
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WebAuto
Web Auto
WebBandit
Web Collage
Web Enhancer
WebFuck
webmeup-crawler
Web Pix
WebSauger
WebsiteExtractor
Webster
WebSucker
Web Sucker
WebWhacker
WeSEE
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
WISENutbot
Wonderbot
Woobot
Wotbox
Wprecon
WWW-Collector-E
WWW::Mechanize
Xaldon WebSpider
Xenu
YoudaoBot
Zauba
zauba.io
Zeus
zgrab
ZmEu