nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-26 10:09:31 +00:00

250 lines
2.6 KiB
Text

80legs
ALittle Client
Abonti
Aipbot
Anarchy99
Apexoo
Asterias
Attach
AwarioRssBot
BDCbot
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Bandit
Barkrowler
Battleztar Bazinga
Bitacle
Bolt
BotALot
Bullseye
CODE87
CSHttp
CheTeam
CheeseBot
CherryPicker
Citoid
Claritybot
Cliqzbot
Cogentbot
Collector
Copier
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
Crescent
DSearch
DTS Agent
DataCha0s
DigitalPebble
Dirbuster
Dispatch
DnBCrawler-Analytics
DnyzBot
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EirGrabber
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetRight
Getintent
Gigabot
GoZilla
Gotit
HTMLparser
HTTP::Lite
HaosouSpider
Hloader
IDBot
Iblog
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InternetSeer
Iria
JamesBOT
Jetty
JikeSpider
Jorgee
JustView
Jyxobot
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LWP::Simple
Larbin
LinkScan
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
MegaIndex.ru
MolokaiBot
Mr.4x3
NearSite
Needle
NetAnts
Nettrack
Nikto
NimbleCrawler
Nimbostratus
Nutch
Octopus
Offline Explorer
OpenVAS
Openfind
Openvas
OrangeBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Pavuk
Pi-Monster
Picscout
Picsearch
PleaseCrawl
ProWebWalker
Pu_iN
Pump
PyCurl
QueryN Metasearch
RSSingBot
Re-re
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SalesIntelligent
ScoutJet
Scrapy
Screaming
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
SeoSiteCheckup
Siphon
Site Sucker
SlySearch
Snoopy
Sottopop
SpaceBison
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucuri
SuperHTTP
Surfbot
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
Telesphoreo
The Intraformant
Toata
Trendiction
Trendictionbot
Twice
Typhoeus
UnisterBot
V-BOT
Vacuum
Vagabondo
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WISENutbot
Wallpapers
WeSEE
Web Auto
Web Collage
Web Sucker
WebAuto
WebCollage
WebGo IS
WebLeacher
WebPix
WebReaper
WebWhacker
Webshag
WebsiteExtractor
Webster
Whacker
Whatweb
Who.is Bot
WinHTTrack
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
ZoomBot
ZoominfoBot
ZumBot
adscanner
arquivo.pt
cah.io.community
check1.exe
cognitiveseo
crawler4j
dataforseo.com
demandbase-bot
evc-batch
heritrix
magpie-crawler
meanpathbot
muhstik-scan
plumanalytics
satoristudio.net
scalaj-http
seocompany.store
seoscanners
serpstatbot
sexsearcher
siteripz
sysscan
webmeup-crawler
x22Mozilla
zgrab