nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-14 10:18:07 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Acunetix
AiHitBot
AllSubmitter
Alligator
Ankit
Anthill
Attach
BDCbot
BackWeb
Backlink-Ceck
Bigfoot
BlackWidow
Blackboard
Boardreader
Brandprotect
Buddy
BuiltWith
Bullseye
BunnySlippers
Calculon
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copier
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DSearch
DataCha0s
Devil
Dirbuster
Disco
Dispatch
DittoSpyder
DomCopBot
DomainAppender
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EirGrabber
Evil
Extractor
EyeNetIE
Ezooms
Fimap
Flunky
Fuzz
GalaxyBot
GetWeb
Gotit
Grabber
Grafula
GrapeFX
GridBot
HTTP::Lite
HaosouSpider
Heritrix
Hloader
Humanlinks
HybridBot
Iblog
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
Iria
Iskanie
JOC Web Spider
JamesBOT
JetCar
Jetty
JustView
Kinza
LNSpiderguy
LWP::Simple
Leap
LeechGet
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkpadBot
Ltx71
MFC_Tear_Sample
MIIxpc
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic12
MarkWatch
MauiBot
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Musobot
NICErsPRO
Needle
Nessus
NetAnts
NetMechanic
Nettrack
Nikto
Nutch
Offline Explorer
Offline Navigator
Openvas
OutfoxBot
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Papa Foto
Picsearch
Pimonster
Pockey
Pu_iN
Pump
QueryN Metasearch
RankActiveLinkBot
ReGet
RealDownload
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
ScrepyBot
Searchestate
SemrushBot
SeobilityBot
Shodan
Siphon
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
SmartDownload
Snapbot
Sqworm
Sucker
SurveyBot
T0PHackTeam
Telesphoreo
TightTwatBot
Toata
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
VCI
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
Voltron
WBSearchBot
WPScan
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Fetch
Web Sucker
WebAuto
WebCollage
WebFuck
WebPix
WebReaper
WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
WiseGuys Robot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zeus
ZumBot
ZyBorg
arquivo.pt
autoemailspider
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch
gopher
ips-agent
lwp-request
lwp-trivial
mediawords
plumanalytics
polaris version
probe-image-size
ripz
seoscanners
serpstatbot
sp_auditbot
sysscan
tAkeOut
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
x22Mozilla