nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-27 22:07:15 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ALittle Client
ASPSeek
Abonti
Aboundex
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
Atomseobot
BDFetch
BackStreet
BackWeb
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
BlowFish
Boardreader
Bolt
Buddy
BuiltWith
CODE87
Calculon
CazoodleBot
CensysInspect
CheTeam
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
Custo
Demon
Devil
Digincore
Dirbuster
Disco
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
ECCP/1.0
EMail Siphon
Ebingbong
Exabot
ExtLinksBot
FHscan
FemtosearchBot
FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetWeb
Getintent
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
Heritrix
HonoluluBot
Humanlinks
IRLbot
Image Fetch
InfoNaviRobot
InfoTekies
InterGET
Iria
JOC Web Spider
JennyBot
JetCar
Kinza
Kozmosbot
LWP::Simple
Lanshanbot
Linkbot
LinkextractorPro
LinksManager
Lipperhey
Lipperhey Spider
MSFrontPage
MTRobot
Magnet
Majestic SEO
MarkWatch
Masscan
MicroMessenger
Microsoft Data Access
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NPbot
NearSite
Needle
Net Vampire
NetAnts
NetLyzer
NetMechanic
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nmap
Nuclei
Openfind
Openvas
OutclicksBot
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Pi-Monster
PleaseCrawl
Pockey
Psbot
PxBroker
PyCurl
RSSingBot
RankActive
RankingBot
Rankivabot
RankurBot
ReGet
Reaper
Recorder
Ripper
RocketCrawler
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
Scrapy
Screaming
Seekport
SeobilityBot
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snake
Snapbot
Sociscraper
Sosospider
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
Sqlmap
Sqlworm
Sucker
Surfbot
Swiftbot
T0PHackTeam
Teleport
Telesoft
Telesphorep
Thumbor
Tracemyfile
Upflow
Virusdie
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
Web Fetch
Web Sauger
Web Sucker
WebCollage
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebZIP
WebmasterWorldForumBot
Website Quester
Webster
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZoomBot
ZumBot
adscanner
arquivo-web-crawler
cah.io.community
coccocbot
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
facebookscraper
heritrix
isitwp.com
iubenda-radar
lwp-trivial
magpie-crawler
pcBrowser
ripz
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
seostar
sexsearcher
sitechecker.pro
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
xpymep1.exe
zgrab