nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-12-16 18:07:55 +02:00

250 lines
2.5 KiB
Text

360Spider
404checker
404enemy
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
AlphaBot
archive.org_bot
arquivo.pt
arquivo-web-crawler
ASPSeek
autoemailspider
Badass
BBBike
BDCbot
BDFetch
Bigfoot
Bitacle
Black Hole
BlackWidow
Blow
Brandprotect
BuiltBotTough
BunnySlippers
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
CheTeam
Cliqzbot
Cloud mapping
Collector
CopyRightCheck
Copyscape
Cosmos
crawl.sogou.com
Crescent
CrunchBot
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
Devil
Digincore
DigitalPebble
Dispatch
DnyzBot
DSearch
ECCP/1.0
EMail Wolf
evc-batch
Exabot
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
FHscan
Firefox/7.0
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grabber
Grafula
HaosouSpider
heritrix
Heritrix
HTTP::Lite
HTTrack
HybridBot
Iblog
IlseBot
Image Fetch
Image Sucker
IndeedBot
Internet Ninja
InternetSeer
Iskanie
JetCar
Joomla
Jorgee
Kozmosbot
Larbin
LeechGet
Lftp
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinkWalker
Lmspider
LNSpiderguy
Ltx71
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mata Hari
MauiBot
MeanPath Bot
mediawords
Metauri
Microsoft Data Access
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
MSFrontPage
Name Intelligence
Nameprotect
NearSite
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
NetZIP
Nibbler
Niki-bot
Nikto
NPbot
Nutch
oBot
Octopus
OnCrawl
OpenVAS
OrangeBot
Page Analyzer
PageGrabber
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
pcBrowser
Picsearch
PictureFinder
Pimonster
Pi-Monster
Probethenet
Quick-Crawler
RankActiveLinkBot
Rankivabot
Recorder
Ripper
RocketCrawler
s1z.ru
SBIder
ScanAlert
Scanbot
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOkicks
SEOprofiler
SeoSiteCheckup
SEOstats
serpstatbot
Siphon
Sitebeam
SiteSnagger
SiteSucker
Sitevigil
SmartDownload
Snake
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
Spammen
Spanner
Spbot
Spinn3r
spyfu
Sqlmap
Sucker
Sucuri
SuperBot
SurveyBot
Suzuran
Telesoft
Telesphoreo
Telesphorep
TightTwatBot
Toata
Tracemyfile
Trendiction
trendiction.de
Turingos
Turnitin
TurnitinBot
Vagabondo
Virusdie
Voil
WASALive-Bot
Webalta
WebBandit
WebCollage
WebCopier
WebFetch
Web Fetch
WebFuck
WebGo IS
WebImageCollector
webmeup-crawler
WebReaper
Web Sauger
WebsiteQuester
Webster
WebSucker
Web Sucker
WebWhacker
WeSEE
Whacker
Whatweb
Widow
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
Xenu
Zade
Zauba
zauba.io
Zermelo
Zitebot
ZyBorg