nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-30 22:08:31 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Acunetix
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchie
AwarioRssBot
BBBike
BackWeb
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
BetaBot
Bitacle
Black Hole
Blackboard
BlowFish
CCBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
CherryPicker
Chlooe
Claritybot
Cocolyzebot
Cogentbot
Collector
Copier
Cosmos
Craftbot
CrunchBot
Curious
CyotekWebCopy
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil
Dirbuster
Discobot
DomainStatsBot
Domains Project
Drip
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Exabot
Extractor
FDM
FHscan
Fimap
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetWeb
Getintent
Gotit
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
Havij
Heritrix
Hloader
IRLbot
Iblog
Id-search
IlseBot
Image Sucker
IndeedBot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iskanie
Jetty
JustView
Jyxobot
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
LeechFTP
Lftp
Libwhisker
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MIDown tool
MIIxpc
MQQBrowser
Mag-Net
Magnet
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
MeanPath Bot
MicroMessenger
Mister PiX
Mozlila
Msrabot
Musobot
Name Intelligence
Nessus
NetAnts
NetLyzer
NetMechanic
NetZIP
Nettrack
Niki-bot
Nmap
Nuclei
Nutch
Offline Navigator
OrangeBot
PECL::HTTP
Page Analyzer
PageScorer
Pandalytics
PeoplePal
Petalbot
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
PxBroker
RankActiveLinkBot
RankingBot
Re-re
ReGet
Recorder
Ripper
SEOprofiler
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
ScreenerBot
Searchestate
SeobilityBot
Seomoz
SiteSnagger
Siteimprove
Sitevigil
SocialRankIOBot
Sociscraper
Sosospider
SpankBot
Sqlmap
Sqlworm
Surfbot
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
TheNomad
True_Robot
Turnitin
TwengaBot
Typhoeus
URLy.Warning
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Collector-E
WWW-Mechanize
Web Pix
WebAuto
WebCollage
WebCopier
WebFuck
WebSucker
Website Quester
WebsiteExtractor
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zauba
ZmEu
ZoominfoBot
ZumBot
arquivo-web-crawler
arquivo.pt
clark-crawler
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
eCatch
gopher
ips-agent
lwp-request
magpie-crawler
mediawords
oBot
plumanalytics
probe-image-size
scalaj-http
scan.lol
seobility
sitechecker.pro
voyagerx.com
webprosbot
zgrab