nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2021-06-23 02:12:50 +02:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
Aboundexbot
ADmantX
AhrefsBot
Anarchie
Anarchy
Apexoo
archive.org_bot
ASPSeek
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BackWeb
BDCbot
Blackboard
Black Hole
BlackWidow
Boardreader
Buddy
BuzzSumo
Calculon
CCBot
Cegbfeieh
CensysInspect
CheeseBot
Chlooe
Cloud mapping
coccocbot-web
Cocolyzebot
cognitiveseo
Copyscape
Cosmos
crawler4j
CrunchBot
CSHttp
CyotekWebCopy
DatabaseDriverMysqli
DataCha0s
DBLBot
Digincore
DigitalPebble
Dirbuster
Disco
Discoverybot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
domainsproject.org
DomCopBot
Dragonfly
DSearch
DTS Agent
EasyDL
Ebingbong
eCatch
ECCP/1.0
Ecxi
EMail Siphon
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
Fimap
Firefox/7.0
FrontPage
Fyrebot
GalaxyBot
Genieo
GermCrawler
Getintent
GetRight
GetWeb
Gotit
GoZilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
heritrix
Heritrix
HTMLparser
HTTP::Lite
Iblog
IlseBot
Image Sucker
IndeedBot
InfoTekies
instabid
Intelliseek
InterGET
InternetSeer
internetVista monitor
Iskanie
Jbrofuzz
Jetty
Jorgee
JustView
Jyxobot
Lanshanbot
LeechFTP
Libwhisker
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
LNSpiderguy
lwp-request
lwp-trivial
Magnet
magpie-crawler
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mass Downloader
MauiBot
Mb2345Browser
mediawords
MFC_Tear_Sample
MIIxpc
Mojeek
Morfeus Fucking Scanner
Mozlila
MQQBrowser
MSFrontPage
Msrabot
Name Intelligence
Needle
Nessus
NetAnts
Netcraft
NetLyzer
NetMechanic
Net Vampire
NICErsPRO
Niki-bot
NPbot
oBot
Octopus
Openfind
Openvas
OpenVAS
OPPO A33
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
PageThing.com
Pandalytics
pcBrowser
PECL::HTTP
Petalbot
Picscout
PictureFinder
plumanalytics
Pockey
ProPowerBot
Pu_iN
Pump
RankActiveLinkBot
RankurBot
RebelMouse
ReGet
Re-re
ripz
RocketCrawler
Rogerbot
SalesIntelligent
satoristudio.net
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SentiBot
seobility
SEOkicks
Seomoz
SEOprofiler
seoscanners
SEOstats
SiteExplorer
Siteimprove
SiteLockSpider
siteripz
SiteSnagger
SiteSucker
SmartDownload
Snake
Snapbot
Snoopy
Sogou web spider
Sosospider
SpaceBison
sp_auditbot
Spbot
Spinn3r
Sqlmap
Stripper
Sucker
SuperHTTP
Surfbot
Swiftbot
Szukacz
tAkeOut
Teleport
Telesoft
Telesphorep
Trendiction
Trendictionbot
trendiction.com
True_Robot
Turingos
URLy.Warning
Vacuum
VCI
VelenPublicWebCrawler
Virusdie
voyagerx.com
WallpapersHD
WebCollage
Web Collage
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebReaper
Web Sauger
Webshag
WebZIP
Whack
Whatweb
Widow
WiseGuys Robot
WISENutbot
Xaldon WebSpider
xpymep1.exe
YoudaoBot
zauba.io
zgrab
ZmEu