nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-06 10:11:07 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ASPSeek
Aboundexbot
Acunetix
AiHitBot
Aipbot
Alexibot
AlphaBot
Anarchy99
Apexoo
Aspiegel
Atomseobot
Attach
AwarioRssBot
BDFetch
BackStreet
BackWeb
BacklinkCrawler
Bandit
Barkrowler
Blackboard
BlowFish
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
CCBot
CODE87
Calculon
CazoodleBot
Cegbfeieh
CherryPicker
ChinaClaw
Citoid
Collector
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
Crescent
Curious
Custo
CyotekWebCopy
DataCha0s
Demon
Deusu
Devil
DigitalPebble
Discobot
DomCopBot
DomainCrawler
Dotbot
Download Wonder
Drip
ECCP/1.0
Ebingbong
Ecxi
Evil
Exabot
ExtLinksBot
Extractor
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetRight
Go-Ahead-Got-It
GridBot
HTMLparser
HTTrack
HaosouSpider
Havij
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
IRLbot
IndeedBot
InterGET
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jetty
Jorgee
JustView
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MJ12bot
MTRobot
Mag-Net
Majestic SEO
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
Meanpathbot
MegaIndex.ru
Minefield
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Musobot
Name Intelligence
Nameprotect
NearSite
NetAnts
NetSpider
NetZIP
Netcraft
Netvibes
Nibbler
Niki-bot
Nimbostratus
Ninja
Nmap
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
Page Analyzer
PageAnalyzer
Panscient
Papa Foto
Petalbot
Picsearch
Pockey
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankurBot
Re-re
ReGet
Reaper
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
Scanbot
Screaming
ScreenerBot
ScrepyBot
Seekport
Semrush
SeoSiteCheckup
Siphon
Site Sucker
SiteExplorer
SiteSucker
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpankBot
SputnikBot
Sqworm
Sucker
Sucuri
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesphoreo
TheNomad
TurnitinBot
TwengaBot
Typhoeus
VB Project
Vacuum
VeriCiteCrawler
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Pix
Web Sucker
WebFetch
WebFuck
WebmasterWorldForumBot
Webshag
WebsiteQuester
Whatweb
Wonderbot
Xaldon_WebSpider
Xenu
ZoomBot
ZoominfoBot
ZyBorg
arquivo-web-crawler
backlink-check
check1.exe
demandbase-bot
eCatch
instabid
isitwp.com
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
polaris version
ripz
seostar
serpstatbot
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla