nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-15 10:09:10 +00:00

250 lines
2.7 KiB
Text

404enemy
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Anthill
Apexoo
AwarioRssBot
BackDoorBot
BackWeb
Bandit
Battleztar Bazinga
BetaBot
Black Hole
BlackWidow
BlowFish
Bolt
BuiltBotTough
BuiltWith
CATExplorador
CODE87
CazoodleBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cogentbot
Crawling at Home Project
CrunchBot
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DomCopBot
DomainAppender
DomainStatsBot
Domains Project
Dragonfly
EMail Siphon
Ecxi
EroCrawler
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
FlashGet
Foobot
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GermCrawler
Gotit
GrapeshotCrawler
HMView
HTMLparser
Havij
Heritrix
Humanlinks
HybridBot
IDBot
Iblog
Image Sucker
IndeedBot
Indy Library
InfoTekies
Intelliseek
InterGET
Internet Ninja
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jetty
JustView
Jyxobot
Keyword Density
Kinza
LNSpiderguy
Lanshanbot
LeechGet
LibWeb
Libwhisker
LieBaoFast
LinkScan
LinkWalker
Lipperhey Spider
MIDown tool
MIIxpc
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Mojeek
Musobot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
NearSite
NetAnts
NetLyzer
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Ninja
Nmap
Nuclei
Octopus
Offline Explorer
Offline Navigator
OpenVAS
Openfind
Openvas
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Papa Foto
PictureFinder
Piepmatz
Pimonster
ProPowerBot
Psbot
RSSingBot
RankActiveLinkBot
RankFlex
Recorder
RedesScrapy
Ripper
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
Scanbot
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Siteimprove
SlySearch
Sosospider
SpaceBison
SpankBot
Sqlmap
Sqlworm
Sqworm
Stripper
SuperHTTP
Surfbot
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Telesphoreo
Telesphorep
Thumbor
Toata
Trendiction
Trendictionbot
Turnitin
TurnitinBot
Twice
Typhoeus
UnisterBot
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WASALive-Bot
WISENutbot
WPScan
WWW::Mechanize
Web Collage
Web Enhancer
Web Fetch
WebBandit
WebCopier
WebEnhancer
WebFuck
WebImageCollector
Webshag
WebsiteExtractor
Whatweb
Who.is Bot
WiseGuys Robot
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
ZoomBot
ZoominfoBot
adscanner
backlink-check
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
domainsproject.org
eCatch
isitwp.com
meanpathbot
netEstate NE Crawler
s1z.ru
seobility
seocompany.store
seostar
sogouspider
spyfu
trendiction.com
trendiction.de
ubermetrics-technologies.com
x22Mozilla