nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-06 22:09:43 +00:00

250 lines
2.6 KiB
Text

01h4x.com
AIBOT
Abonti
Alexibot
AllSubmitter
Alligator
Ankit
Anthill
Asterias
Atomseobot
BBBike
BDCbot
BLEXBot
BackDoorBot
Backlink-Ceck
Barkrowler
BetaBot
Blackboard
BlowFish
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
CCBot
CODE87
CSHttp
CensysInspect
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copier
CrunchBot
Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Devil
Digincore
Discobot
DittoSpyder
DnyzBot
DomainAppender
Domains Project
Download Wonder
Drip
ECCP/1.0
Ecxi
EroCrawler
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
FDM
Fimap
FlashGet
Foobot
Fuzz
FyberSpider
GT::WWW
GermCrawler
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrapeFX
GrapeshotCrawler
HTTP::Lite
HaosouSpider
Hloader
Humanlinks
IRLbot
Image Fetch
Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iskanie
JamesBOT
Jbrofuzz
Jyxobot
Keyword Density
Kozmosbot
Lanshanbot
Leap
LinkWalker
LinqiaScrapeBot
Litemage_walker
Lmspider
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
MicroMessenger
Minefield
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Name Intelligence
Navroad
NearSite
Nessus
Net Vampire
NetAnts
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openvas
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageThing.com
Pandalytics
Pi-Monster
Picscout
Picsearch
Pixray
PleaseCrawl
Psbot
Pu_iN
QueryN Metasearch
Quick-Crawler
RebelMouse
Recorder
RedesScrapy
Ripper
Rogerbot
SMTBot
Searchestate
SearchmetricsBot
SeoSiteCheckup
Seomoz
SiteSnagger
Sitebeam
Sitevigil
SlySearch
Snapbot
Sogou web spider
Sottopop
SpaceBison
Spammen
Spinn3r
Sqlmap
Sqlworm
Stripper
SurveyBot
Swiftbot
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
TheNomad
Toata
Toweyabot
Twice
Upflow
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voltron
WASALive-Bot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebWhacker
WebZIP
Webshag
WebsiteExtractor
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Xenu
YoudaoBot
Zauba
Zitebot
ZoomBot
ZoominfoBot
adscanner
arquivo.pt
autoemailspider
backlink-check
check1.exe
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
facebookscraper
heritrix
ips-agent
isitwp.com
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
probe-image-size
ripz
scalaj-http
seobility
seoscanners
serpstatbot
sysscan
webgains-bot
webpros.com
webprosbot
xpymep1.exe