nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-03-02 22:00:22 +02:00

250 lines
2.5 KiB
Text

404checker
404enemy
80legs
Aboundex
AhrefsBot
AIBOT
AlphaBot
Ankit
arquivo.pt
AwarioRssBot
AwarioSmartBot
BacklinkCrawler
BackStreet
Battleztar Bazinga
BDCbot
Bigfoot
Bitacle
Blackboard
Blow
Boardreader
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
CheeseBot
CherryPicker
CheTeam
Claritybot
cognitiveseo
Copier
CopyRightCheck
Cosmos
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Custo
DatabaseDriverMysqli
DataCha0s
Demon
Deusu
Digincore
DigitalPebble
DIIbot
Discoverybot
DomainAppender
Dotbot
Dragonfly
Drip
DSearch
DTS Agent
EasyDL
Ebingbong
EirGrabber
evc-batch
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
facebookscraper
FDM
FemtosearchBot
Fimap
FlashGet
FyberSpider
Genieo
GermCrawler
GetRight
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
GrabNet
GrapeshotCrawler
GridBot
Haansoft
Harvest
Havij
Hloader
HTTrack
Humanlinks
Id-search
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
internetVista monitor
ips-agent
Iria
Iskanie
JennyBot
JOC Web Spider
Joomla
Jyxobot
Kenjin Spider
Lftp
LibWeb
Likse
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
lwp-trivial
Magnet
Mag-Net
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
MIDown tool
MIIxpc
MJ12bot
Mojeek
Mojolicious
Mr.4x3
MSFrontPage
MSIECrawler
NearSite
netEstate NE Crawler
NetLyzer
NetSpider
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NPbot
Octopus
OnCrawl
Openfind
OrangeSpider
OutfoxBot
PageAnalyzer
PageScorer
Pavuk
Picscout
Picsearch
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
Probethenet
ProPowerBot
ProWebWalker
PxBroker
Quick-Crawler
RankActive
RankingBot
Rankivabot
Recorder
RedesScrapy
Ripper
s1z.ru
SBIder
scan.lol
Scrapy
SEOlyticsCrawler
SEOprofiler
serpstatbot
SISTRIX
SiteLockSpider
Site Sucker
SlySearch
Sociscraper
sogouspider
Sogou web spider
Spammen
SpankBot
spyfu
Sqlmap
Sqlworm
Sqworm
Sucuri
SuperHTTP
Swiftbot
sysscan
Szukacz
tAkeOut
Teleport
Telesoft
Telesphoreo
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
trendiction.de
Turingos
Turnitin
UnisterBot
URLy Warning
VCI
VeriCiteCrawler
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WASALive-Bot
Webalta
WebBandit
WEBDAV
WebEnhancer
Web Fuck
WebImageCollector
WebmasterWorldForumBot
WebPix
WebReaper
Webshag
WebsiteQuester
WebStripper
WebSucker
Web Sucker
WeSEE
Whack
Wonderbot
Wprecon
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZyBorg