nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-01-23 13:18:19 +02:00

250 lines
2.5 KiB
Text

360Spider
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Alligator
AlphaBot
arquivo.pt
ASPSeek
AwarioSmartBot
BackDoorBot
backlink-check
Bandit
BBBike
BDFetch
Bitacle
Blackboard
Black Hole
Bolt
BotALot
Brandprotect
BuiltBotTough
CazoodleBot
Cegbfeieh
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
cognitiveseo
com.plumanalytics
Cosmos
crawler.feedback
CrunchBot
Curious
DatabaseDriverMysqli
DataCha0s
Demon
Deusu
Digincore
DigitalPebble
DIIbot
Dirbuster
Dispatch
DomainCrawler
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
Ebingbong
eCatch
EMail Siphon
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
FHscan
Fimap
Firefox/7.0
Freeuploader
FyberSpider
Genieo
Gigablast
G-i-g-a-b-o-t
GoZilla
Go!Zilla
GrabNet
GrapeshotCrawler
Harvest
HEADMasterSEO
HMView
HybridBot
Iblog
IlseBot
Image Fetch
IndeedBot
instabid
InterGET
internetVista monitor
ips-agent
Iria
IstellaBot
Jbrofuzz
JetCar
JikeSpider
JOC Web Spider
Jorgee
JustView
Jyxobot
Keyword Density
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
Libwhisker
LinkWalker
Litemage_walker
lwp-request
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
Meanpathbot
MeanPath Bot
Metauri
Microsoft URL Control
MJ12bot
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
muhstik-scan
Musobot
Name Intelligence
Nameprotect
Navroad
NetAnts
NetMechanic
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Octopus
Offline Navigator
OnCrawl
OrangeBot
PageAnalyzer
PageGrabber
page scorer
Pandalytics
Pavuk
pcBrowser
PECL::HTTP
PHPCrawl
Picscout
Pixray
plumanalytics
Pockey
Probethenet
ProWebWalker
Psbot
Pump
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RealDownload
RebelMouse
RedesScrapy
ReGet
Rogerbot
RSSingBot
s1z.ru
SBIder
Scanbot
ScoutJet
ScreenerBot
Semrush
serpstatbot
sexsearcher
Shodan
Siphon
Siteimprove
SiteSucker
Site Sucker
Sitevigil
SlySearch
Snake
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
sp_auditbot
Spbot
SputnikBot
Sqworm
Sucker
SuperBot
SuperHTTP
SurveyBot
sysscan
Szukacz
Teleport
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Titan
Trendiction
Trendictionbot
TwengaBot
Upflow
URLy Warning
Voil
Wallpapers/3.0
WASALive-Bot
WebAuto
Web Collage
WebCopier
WEBDAV
Web Enhancer
Web Fetch
WebFuck
Web Fuck
WebGo IS
webmeup-crawler
WebPix
Web Pix
WebSauger
Web Sauger
Webshag
Webster
WebStripper
WebSucker
Web Sucker
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Woobot
Wprecon
WPScan
WWW::Mechanize
WWWOFFLE
x22Mozilla
Zade
zauba.io
Zermelo
zgrab
Zitebot
ZumBot