nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-23 22:06:57 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404enemy
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchy
Anarchy99
Ankit
Anthill
Apexoo
Atomseobot
AwarioSmartBot
BackWeb
Backlink-Ceck
Bandit
Black Hole
Blackboard
Blow
BlowFish
Brandprotect
Buck
Buddy
BuiltWith
BuzzSumo
CCBot
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Cocolyzebot
Cogentbot
Copyscape
Cosmos
CrazyWebCrawler
Custo
CyotekWebCopy
DBLBot
DIIbot
DatabaseDriverMysqli
Demon
DigitalPebble
Dirbuster
Disco
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
FDM
FHscan
Fimap
Fuzz
Fyrebot
GalaxyBot
GetRight
Go!Zilla
Go-Ahead-Got-It
Gotit
GridBot
HMView
HTTrack
Haansoft
Harvest
Havij
Heritrix
HonoluluBot
IDBot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
InterGET
IstellaBot
Jbrofuzz
Jetty
JustView
Jyxobot
Keyword Density
Kozmosbot
Leap
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkScan
Linkbot
LinkpadBot
LinksManager
Litemage_walker
Ltx71
MIIxpc
MSFrontPage
Mag-Net
Majestic SEO
Majestic12
MarkMonitor
MauiBot
MegaIndex.ru
Metauri
Mozlila
Mr.4x3
Nameprotect
NearSite
Nessus
NetSpider
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nmap
Not
Octopus
Offline Explorer
OpenLinkProfiler
OpenVAS
OutfoxBot
PageGrabber
PageScorer
Panscient
PictureFinder
Piepmatz
Pimonster
Psbot
Pu_iN
Pump
RankActive
RankActiveLinkBot
Rankivabot
RankurBot
Recorder
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
ScrepyBot
Searchestate
SemanticJuice
SentiBot
SeobilityBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteLockSpider
Snake
Snapbot
Sosospider
Sottopop
Spbot
Spinn3r
Sqlworm
Stripper
SuperBot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
The Intraformant
Titan
Tracemyfile
Trendiction
Trendictionbot
Turingos
Turnitin
Typhoeus
URLy.Warning
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voltron
WEBDAV
WPScan
WWWOFFLE
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Sucker
WebAuto
WebBandit
WebCollage
WebFuck
WebPix
WebReaper
WebSucker
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Woobot
Wprecon
Xaldon WebSpider
Xenu
Zade
Zauba
Zermelo
Zitebot
ZoominfoBot
ZumBot
check1.exe
clark-crawler
coccocbot
dataforseo.com
heritrix
instabid
iubenda-radar
mediawords
netEstate NE Crawler
plumanalytics
scalaj-http
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler