nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-03 14:51:01 +02:00

250 lines
2.6 KiB
Text

404enemy
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchie
archive.org_bot
Attach
backlink-check
BackStreet
Barkrowler
BBBike
Bigfoot
Bitacle
Black Hole
BLEXBot
Blow
BlowFish
BotALot
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador
CheeseBot
CherryPicker
Cliqzbot
com.plumanalytics
Copyscape
Cosmos
Craftbot
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Curious
DatabaseDriverMysqli
DataCha0s
Demon
Digincore
Disco
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
Dotbot
Dragonfly
Drip
DSearch
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
evc-batch
Extractor
EyeNetIE
facebookscraper
Firefox/7.0
Flunky
Foobot
Freeuploader
Genieo
GetRight
Gigabot
Gotit
GoZilla
GrabNet
Grafula
HaosouSpider
Harvest
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HTTrack
Iblog
Image Fetch
IndeedBot
Indy Library
Internet Ninja
ips-agent
Iria
IRLbot
Iskanie
Jbrofuzz
JennyBot
JOC Web Spider
Joomla
JustView
Jyxobot
Larbin
LeechGet
LexiBot
LibWeb
Libwhisker
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
Mata Hari
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft Data Access
MJ12bot
Mojeek
MSFrontPage
Msrabot
MS Web Services Client Protocol
Musobot
Name Intelligence
Nessus
Netcraft
NetLyzer
NetMechanic
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Ninja
Nmap
Nutch
Octopus
Offline Navigator
Openfind
OpenVAS
OutclicksBot
PageGrabber
page scorer
Pandalytics
pcBrowser
PECL::HTTP
Picscout
Pimonster
Pixray
POE-Component-Client-HTTP
Probethenet
Psbot
PxBroker
PyCurl
QueryN Metasearch
Rankivabot
Reaper
Recorder
RedesScrapy
ReGet
Ripper
Rogerbot
ScanAlert
Screaming
ScreenerBot
Searchestate
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
SeoSiteCheckup
SEOstats
Shodan
Siphon
Sitebeam
SiteExplorer
SiteSucker
SMTBot
Snake
Snapbot
Snoopy
Sociscraper
Spammen
Spbot
SputnikBot
Sqworm
Steeler
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphoreo
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
trendiction.de
True_Robot
TurnitinBot
Twice
Upflow
URLy.Warning
Vagabondo
VCI
VeriCiteCrawler
Virusdie
WallpapersHD
WASALive-Bot
Webalta
WebCollage
WebCopier
Web Fetch
WebFuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebReaper
Webshag
WebsiteQuester
Website Quester
Web Sucker
WebWhacker
WebZIP
Whatweb
Widow
WiseGuys Robot
WISENutbot
Woobot
Wotbox
WWW-Collector-E
x22Mozilla
xpymep1.exe
YoudaoBot
Zauba
zauba.io
zgrab
ZmEu
ZyBorg