nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-27 22:07:14 +00:00

250 lines
2.7 KiB
Text

ALittle Client
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
AlphaBot
Ankit
Apexoo
Aspiegel
BBBike
BDCbot
BDFetch
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
Bitacle
Black Hole
BlackWidow
Brandprotect
Brandwatch
Buddy
BuzzSumo
CCBot
CSHttp
CazoodleBot
CheTeam
CheeseBot
Collector
Copier
Copyscape
Crawling at Home Project
Crescent
Custo
CyotekWebCopy
DIIbot
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Dirbuster
Disco
DnyzBot
DomainAppender
DomainStatsBot
Domains Project
Dotbot
Dragonfly
EMail Wolf
Evil
Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
Fyrebot
GT::WWW
Go!Zilla
Gotit
GrabNet
Grafula
HMView
HTMLparser
Harvest
Heritrix
Hloader
HonoluluBot
Humanlinks
HybridBot
IRLbot
Image Sucker
InterGET
Iskanie
IstellaBot
JOC Web Spider
JennyBot
Jetty
Jorgee
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
LexiBot
Lftp
LieBaoFast
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
Lmspider
Ltx71
MIDown tool
Mail.RU_Bot
Majestic SEO
Meanpathbot
Metauri
Minefield
Mister PiX
Moblie Safari
Name Intelligence
Nameprotect
Needle
Nessus
NetAnts
Netvibes
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Nmap
Nuclei
Offline Navigator
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
Picscout
PleaseCrawl
Pockey
ProWebWalker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
ReGet
Reaper
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOlyticsCrawler
SalesIntelligent
ScreenerBot
SearchmetricsBot
Seekport
SemrushBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Siteimprove
SlySearch
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
Sqlmap
Sqlworm
Sucker
Surfbot
Suzuran
Swiftbot
TeleportPro
Telesoft
TightTwatBot
Titan
Toweyabot
Turingos
URLy Warning
URLy.Warning
V-BOT
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
WPScan
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Webster
Whacker
Who.is Bot
Zitebot
ZmEu
ZumBot
adscanner
arquivo.pt
autoemailspider
cah.io.community
check1.exe
coccocbot
com.plumanalytics
crawler.feedback
dataforseo.com
demandbase-bot
facebookscraper
gopher
instabid
ips-agent
iubenda-radar
linkdexbot
lwp-request
meanpathbot
mediawords
netEstate NE Crawler
oBot
probe-image-size
scan.lol
seobility
sexsearcher
sitechecker.pro
siteripz
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab