nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-09 10:09:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
80legs
AIBOT
ASPSeek
Acunetix
AiHitBot
Aipbot
AllSubmitter
Anarchy
Anarchy99
Anthill
Asterias
Atomseobot
AwarioSmartBot
BDFetch
Backlink-Ceck
Bandit
BatchFTP
Blow
BotALot
Brandwatch
Buck
BuiltWith
BunnySlippers
CATExplorador
CSHttp
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Collector
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
DigitalPebble
Disco
Discoverybot
DomainSigmaCrawler
Dotbot
ECCP/1.0
EasyDL
Ebingbong
Ecxi
EirGrabber
Evil
Exabot
Extractor
Ezooms
Firefox/7.0
FlashGet
GermCrawler
Gigabot
GrabNet
Grafula
GridBot
HTMLparser
HaosouSpider
HonoluluBot
IDBTE4M
Id-search
InfoTekies
Intelliseek
InterGET
InternetSeer
Jbrofuzz
JetCar
JikeSpider
Jorgee
JustView
Keybot Translation-Search-Machine
LNSpiderguy
Lanshanbot
Larbin
Leap
Libwhisker
Lightspeedsystems
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
Masscan
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojolicious
MolokaiBot
Mr.4x3
Msrabot
NICErsPRO
Net Vampire
NetLyzer
NetMechanic
NetZIP
Netvibes
NimbleCrawler
Ninja
Nmap
Nuclei
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OutfoxBot
PECL::HTTP
Pandalytics
Petalbot
Piepmatz
Pockey
Pump
PxBroker
PyCurl
Quick-Crawler
RankurBot
Re-re
Reaper
Recorder
RedesScrapy
Ripper
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
ScoutJet
Scrapy
ScrepyBot
SemanticJuice
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Snapbot
Sosospider
Spammen
Spinn3r
Sqlworm
Steeler
Sucker
SuperHTTP
Suzuran
T8Abot
Telesoft
Telesphoreo
TightTwatBot
Toata
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
URLy.Warning
Upflow
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fuck
WebBandit
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebPix
WebWhacker
WebZIP
Webshag
WebsiteQuester
WinHTTrack
WiseGuys Robot
Wprecon
YoudaoBot
Zermelo
Zeus
Zitebot
ZmEu
ZoominfoBot
arquivo-web-crawler
autoemailspider
clark-crawler
cognitiveseo
com.plumanalytics
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
gopher
heritrix
instabid
ips-agent
isitwp.com
iubenda-radar
magpie-crawler
mediawords
netEstate NE Crawler
plumanalytics
satoristudio.net
scan.lol
seobility
seocompany.store
sysscan
ubermetrics-technologies.com