nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-09-23 20:36:06 +02:00

250 lines
2.5 KiB
Text

360Spider
404enemy
80legs
Abonti
Aboundex
Aboundexbot
ADmantX
AhrefsBot
AllSubmitter
AlphaBot
ASPSeek
autoemailspider
BackDoorBot
Backlink-Ceck
BackWeb
Badass
Barkrowler
Battleztar Bazinga
BBBike
BDFetch
Bitacle
Blackboard
BLEXBot
Blow
BotALot
Brandprotect
Buddy
BuiltBotTough
Calculon
CATExplorador
ChinaClaw
Claritybot
cognitiveseo
com.plumanalytics
Copier
crawler.feedback
CrazyWebCrawler
CrunchBot
CSHttp
Curious
Custo
DBLBot
Demon
Deusu
Digincore
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
Dragonfly
Ebingbong
eCatch
EirGrabber
EMail Wolf
evc-batch
ExtractorPro
facebookscraper
FDM
FHscan
Genieo
Gigabot
Gotit
Go!Zilla
Grafula
GrapeshotCrawler
GT::WWW
HaosouSpider
Harvest
HTMLparser
Humanlinks
IDBot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
internetVista monitor
Iria
IRLbot
JamesBOT
JennyBot
JetCar
JikeSpider
Jorgee
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Linkdexbot
LinkpadBot
LinkScan
LinkWalker
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
LWP::Simple
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic-SEO
MarkWatch
Masscan
MauiBot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
MIDown tool
Mr.4x3
MSFrontPage
MSIECrawler
muhstik-scan
Musobot
Needle
NetLyzer
NetSpider
Nettrack
Netvibes
NetZIP
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Offline Navigator
OnCrawl
Openvas
OpenVAS
OrangeBot
Page Analyzer
PageGrabber
Pavuk
PeoplePal
Picsearch
PictureFinder
Pimonster
Pi-Monster
Pockey
Probethenet
ProPowerBot
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot2
Reaper
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
ScanAlert
Scanbot
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
Seomoz
SeoSiteCheckup
Siphon
SISTRIX
SiteExplorer
Siteimprove
SiteLockSpider
Sitevigil
Snake
SocialRankIOBot
Sociscraper
sogouspider
Sosospider
Spanner
sp_auditbot
SputnikBot
Sqworm
Stripper
Sucker
SuperHTTP
Surfbot
Swiftbot
Szukacz
tAkeOut
Telesoft
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
trendiction.de
Turnitin
Twice
Typhoeus
Upflow
URLy Warning
Vacuum
VCI
Voltron
Wallpapers/3.0
WASALive-Bot
Webalta
WebAuto
WebBandit
Web Collage
WEBDAV
Web Enhancer
WebFetch
Web Fuck
WebLeacher
WebmasterWorldForumBot
WebPix
Webshag
Webster
WebStripper
WebSucker
WebZIP
Whatweb
Who.is Bot
Widow
WinHTTrack
Wonderbot
Woobot
Wotbox
WWW-Collector-E
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
zauba.io
Zitebot