nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-04 10:09:13 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404checker
404enemy
AIBOT
ALittle Client
Abonti
AfD-Verbotsverfahren
AiHitBot
Alexibot
Anarchy
Ankit
Anthill
Aspiegel
Attach
AwarioRssBot
BBBike
BDCbot
BLEXBot
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
BlackWidow
Blackboard
Blow
BlowFish
Boardreader
Buck
CATExplorador
CCBot
CensysInspect
CheTeam
CherryPicker
Cocolyzebot
Collector
Copyscape
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
Deusu
Discoverybot
DittoSpyder
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
EMail Siphon
Ecxi
EroCrawler
Extractor
ExtractorPro
Extreme Picture Finder
FemtosearchBot
Fimap
FrontPage
GT::WWW
GalaxyBot
GetWeb
Go-Ahead-Got-It
GoZilla
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTMLparser
HaosouSpider
Harvest
Havij
Humanlinks
Iblog
Id-search
Image Fetch
Indy Library
JOC Web Spider
JamesBOT
JetCar
Jetty
Kenjin Spider
LWP::Simple
Lanshanbot
LeechFTP
LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Mag-Net
MarkMonitor
MarkWatch
Mb2345Browser
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
NPbot
Navroad
NearSite
Needle
Net Vampire
NetMechanic
Netcraft
NextGenSearchBot
Niki-bot
NimbleCrawler
Ninja
Nmap
Nuclei
Octopus
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Panscient
Pi-Monster
Picsearch
PictureFinder
Piepmatz
Pimonster
ProWebWalker
Probethenet
Pu_iN
PyCurl
RSSingBot
RankActive
RankActiveLinkBot
Rankivabot
Re-re
RealDownload
RepoMonkey
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Screaming
Semrush
SeoSiteCheckup
Seomoz
Siphon
Siteimprove
Sitevigil
Snake
Snapbot
Snoopy
SpaceBison
SpankBot
Sqlmap
Sqlworm
Stripper
SuperBot
Surfbot
Suzuran
T0PHackTeam
TeleportPro
Telesphorep
Thumbor
Toata
Toweyabot
Tracemyfile
True_Robot
Turingos
Turnitin
TwengaBot
URLy Warning
URLy.Warning
UnisterBot
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voltron
WPScan
Wallpapers
Wallpapers/3.0
WeSEE
Web Fetch
Web Pix
Web Sauger
WebAuto
WebCollage
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebSucker
Webalta
Webshag
Website Quester
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zitebot
ZmEu
ZoomBot
archive.org_bot
autoemailspider
cah.io.community
coccocbot-web
cognitiveseo
crawler4j
dataforseo.com
internetVista monitor
magpie-crawler
meanpathbot
netEstate NE Crawler
plumanalytics
ripz
satoristudio.net
scalaj-http
seobility
seoscanners
seostar
sitechecker.pro
trendiction.de
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab