nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-18 10:09:29 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
AlphaBot
Anarchy
Anarchy99
Ankit
Aspiegel
Attach
BBBike
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
Blow
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CCBot
CSHttp
CazoodleBot
CensysInspect
CheeseBot
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck
Copyscape
CrazyWebCrawler
CrunchBot
Curious
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
Dirbuster
Discobot
Dispatch
DomainAppender
DomainStatsBot
Domains Project
Dotbot
Dragonfly
EMail Siphon
EasyDL
Ecxi
EirGrabber
Evil
Exabot
EyeNetIE
FDM
Firefox/7.0
Fyrebot
GetWeb
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
Gotit
GrabNet
HTTP::Lite
Havij
Heritrix
Hloader
Humanlinks
Iblog
Image Fetch
Indy Library
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
Joomla
JustView
Kozmosbot
LWP::Simple
Leap
LeechGet
LexiBot
Lftp
LibWeb
LinkWalker
Linkdexbot
LinkpadBot
Lmspider
MFC_Tear_Sample
MIIxpc
MQQBrowser
Magnet
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Moblie Safari
Mojolicious
Mr.4x3
NICErsPRO
NPbot
Navroad
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Nimbostratus
Offline Navigator
OnCrawl
OpenVAS
Openvas
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Pandalytics
Pavuk
PeoplePal
Picsearch
PictureFinder
Pixray
Probethenet
Psbot
Pu_iN
PyCurl
Quick-Crawler
RankActive
RankFlex
RankingBot
RankurBot
RealDownload
RebelMouse
Recorder
SEOkicks
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
Seekport
SemanticJuice
Semrush
SentiBot
SiteCheckerBotCrawler
Sitebeam
Siteimprove
Snake
Sociscraper
SpaceBison
Spanner
Spinn3r
Sqlworm
Stripper
Surfbot
SurveyBot
Suzuran
Swiftbot
T8Abot
Telesphoreo
Telesphorep
TheNomad
Thumbor
TightTwatBot
Turingos
Turnitin
TwengaBot
V-BOT
VB Project
VCI
Vacuum
Vagabondo
Voil
WBSearchBot
WPScan
WWW::Mechanize
Web Enhancer
Web Pix
WebAuto
WebEnhancer
WebFuck
WebPix
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
WinHTTrack
Wotbox
Wprecon
Xenu
Zade
adscanner
archive.org_bot
autoemailspider
backlink-check
check1.exe
clark-crawler
coccocbot-web
dataforseo.com
eCatch
evc-batch
facebookscraper
gopher
heritrix
ips-agent
isitwp.com
lwp-request
magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot
scalaj-http
seoscanners
sexsearcher
siteripz
spyfu
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io
zgrab