nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-14 14:22:56 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Asterias
AwarioRssBot
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Bigfoot
Black Hole
BlackWidow
Blow
Bolt
BotALot
Brandwatch
Buck
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CSHttp
CazoodleBot
CensysInspect
CherryPicker
Chlooe
Cloud mapping
Cocolyzebot
CopyRightCheck
CrazyWebCrawler
DTS Agent
DataCha0s
Deusu
Digincore
DigitalPebble
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Drip
EroCrawler
ExtLinksBot
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Freeuploader
FrontPage
Fuzz
GalaxyBot
GetWeb
Getintent
Gigabot
Gotit
Grafula
GrapeFX
GridBot
HMView
Heritrix
Hloader
Humanlinks
IRLbot
Iblog
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Iskanie
IstellaBot
JOC Web Spider
JetCar
Jetty
JikeSpider
Joomla
Jorgee
JustView
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
Lftp
LibWeb
Libwhisker
LieBaoFast
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Ltx71
MFC_Tear_Sample
MJ12bot
MTRobot
Mag-Net
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Microsoft Data Access
Mojeek
Morfeus Fucking Scanner
Musobot
Name Intelligence
Needle
Nessus
Net Vampire
NetMechanic
NextGenSearchBot
Niki-bot
Nuclei
Nutch
OpenLinkProfiler
OrangeSpider
OutfoxBot
PHPCrawl
PageAnalyzer
PageScorer
Pandalytics
Panscient
Pi-Monster
Pimonster
Pockey
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankurBot
Reaper
RebelMouse
Recorder
RocketCrawler
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SalesIntelligent
ScanAlert
Scrapy
ScreenerBot
Searchestate
Semrush
SemrushBot
SentiBot
Seomoz
Shodan
Siphon
Site Sucker
SiteLockSpider
SiteSucker
Sitebeam
SlySearch
SmartDownload
Snapbot
Sociscraper
Sottopop
Spammen
Spanner
Spinn3r
SputnikBot
Sqlmap
Sucker
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
T8Abot
TeleportPro
Telesoft
Trendiction
Trendictionbot
True_Robot
TwengaBot
Twice
UnisterBot
VB Project
Virusdie
VoidEYE
Voil
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
Web Enhancer
Web Fetch
Web Fuck
WebAuto
WebBandit
WebCopier
WebFetch
WebImageCollector
WebSauger
WebSucker
Webshag
Webster
Whatweb
Widow
WinHTTrack
Wotbox
Wprecon
Zade
ZmEu
ZoomBot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
check1.exe
coccocbot-web
crawl.sogou.com
crawler4j
eCatch
evc-batch
isitwp.com
lwp-request
magpie-crawler
meanpathbot
netEstate NE Crawler
oBot
pcBrowser
ripz
satoristudio.net
seobility
serpstatbot
sogouspider
sp_auditbot
webmeup-crawler
x22Mozilla