nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-12-18 01:18:29 +02:00

250 lines
2.6 KiB
Text

360Spider
404enemy
Aboundex
ADmantX
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Anthill
Apexoo
arquivo.pt
arquivo-web-crawler
AwarioSmartBot
BackDoorBot
Backlink-Ceck
backlink-check
BackStreet
BackWeb
Badass
BDFetch
Bitacle
Blackboard
Black Hole
BLEXBot
Blow
BlowFish
Brandwatch
Buddy
BuiltWith
Bullseye
CCBot
Cegbfeieh
CheTeam
CODE87
cognitiveseo
com.plumanalytics
CopyRightCheck
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
Curious
CyotekWebCopy
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Deusu
Digincore
DigitalPebble
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Domains Project
domainsproject.org
DomainStatsBot
Dragonfly
Ebingbong
eCatch
Ecxi
EirGrabber
EMail Wolf
EroCrawler
evc-batch
ExtLinksBot
FemtosearchBot
FHscan
Fimap
FrontPage
Genieo
Gigabot
G-i-g-a-b-o-t
Grabber
Grafula
GrapeFX
GT::WWW
Heritrix
HTMLparser
HTTrack
Humanlinks
IDBTE4M
Image Sucker
Indy Library
InfoTekies
instabid
Intelliseek
InterGET
internetVista monitor
Iria
JamesBOT
Jbrofuzz
JetCar
Jetty
JikeSpider
JOC Web Spider
Joomla
JustView
Jyxobot
Kenjin Spider
Kinza
Lanshanbot
LexiBot
Lftp
Libwhisker
LieBaoFast
Likse
LinkpadBot
LinkScan
LinqiaScrapeBot
Lmspider
LWP::Simple
lwp-trivial
magpie-crawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Masscan
Mass Downloader
Mata Hari
MauiBot
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSIECrawler
Name Intelligence
NearSite
Needle
Nessus
NetMechanic
Nibbler
Niki-bot
Nikto
NPbot
Nutch
Octopus
OnCrawl
OpenVAS
OPPO A33
OrangeBot
OutfoxBot
PageAnalyzer
page scorer
Papa Foto
PECL::HTTP
Picsearch
PictureFinder
plumanalytics
POE-Component-Client-HTTP
polaris version
ProPowerBot
ProWebWalker
PyCurl
QueryN Metasearch
RankActive
RankFlex
Rankivabot
RankurBot
Recorder
RedesScrapy
ReGet
RepoMonkey
RocketCrawler
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
satoristudio.net
SBIder
Scanbot
scan.lol
ScoutJet
ScreenerBot
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
sitechecker.pro
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
SlySearch
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
SpaceBison
Spinn3r
spyfu
Sqlmap
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
T8Abot
TeleportPro
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turnitin
TurnitinBot
Twice
Typhoeus
Upflow
VidibleScraper
Virusdie
Voil
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
WebBandit
WebCopier
Web Enhancer
Web Fuck
WebGo IS
WebLeacher
webmeup-crawler
WebPix
Web Pix
WebSauger
Webshag
WebsiteQuester
WebStripper
WebSucker
Web Sucker
Whack
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Xaldon_WebSpider
Xenu
xpymep1.exe
YoudaoBot
Zade
zauba.io
ZumBot