nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-26 10:18:38 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
ALittle Client
Abonti
Aboundex
Aboundexbot
AhrefsBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchy
Ankit
BBBike
BDCbot
Backlink-Ceck
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
BlowFish
BuiltWith
BuzzSumo
CATExplorador
CODE87
CSHttp
Cegbfeieh
CensysInspect
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Copier
Copyscape
Craftbot
Crawling at Home Project
Crescent
Curious
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomainAppender
Domains Project
EMail Siphon
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
EyeNetIE
FHscan
FlashGet
Flunky
Fuzz
FyberSpider
GalaxyBot
Genieo
GermCrawler
Getintent
Go!Zilla
GrapeshotCrawler
GridBot
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Havij
Heritrix
Id-search
IlseBot
Image Fetch
Intelliseek
InterGET
Iria
Iskanie
JOC Web Spider
JikeSpider
Joomla
Jorgee
JustView
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
Lftp
Lightspeedsystems
LinkScan
LinkWalker
LinksManager
LinqiaScrapeBot
Litemage_walker
Lmspider
MQQBrowser
Majestic-SEO
MarkWatch
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mister PiX
Mojolicious
Mr.4x3
NICErsPRO
Nameprotect
Navroad
NearSite
NetAnts
NetMechanic
NetSpider
Netvibes
Ninja
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OrangeBot
OrangeSpider
PageThing.com
Pavuk
Pi-Monster
Picscout
Picsearch
PictureFinder
Pockey
Probethenet
Psbot
Pu_iN
Pump
PyCurl
RSSingBot
RankFlex
RankingBot2
Rankivabot
Recorder
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
Shodan
Site Sucker
SiteSnagger
Sitebeam
Siteimprove
SlySearch
SmartDownload
Snake
Sottopop
SpaceBison
SpankBot
Spinn3r
SputnikBot
Sucker
Sucuri
Surfbot
SurveyBot
Szukacz
T0PHackTeam
Teleport
TheNomad
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TwengaBot
Twice
UnisterBot
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
Voil
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Fetch
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebSauger
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
Webster
Widow
Wotbox
Xenu
Zermelo
Zitebot
ZoominfoBot
ZumBot
autoemailspider
check1.exe
clark-crawler
cognitiveseo
dataforseo.com
gopher
internetVista monitor
magpie-crawler
netEstate NE Crawler
oBot
plumanalytics
polaris version
scan.lol
serpstatbot
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.de
webprosbot
x09Mozilla
x22Mozilla
zgrab