nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-07 10:09:29 +00:00

250 lines
2.5 KiB
Text

80legs
ADmantX
Abonti
Aboundexbot
Acunetix
Alligator
Anarchy
Anarchy99
Ankit
Anthill
Aspiegel
Attach
AwarioSmartBot
BDCbot
BackDoorBot
Backlink-Ceck
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
Blackboard
BotALot
Brandwatch
BuiltWith
Bullseye
BunnySlippers
CCBot
CODE87
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Cloud mapping
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Dirbuster
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainStatsBot
Dotbot
Download Wonder
Drip
EMail Wolf
EirGrabber
Evil
FHscan
Fimap
Flunky
Foobot
Freeuploader
Fuzz
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetWeb
Getintent
Gigabot
GoZilla
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
HaosouSpider
HybridBot
IDBTE4M
IRLbot
Id-search
IndeedBot
Intelliseek
Internet Ninja
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jetty
JikeSpider
Joomla
Jorgee
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LWP::Simple
Larbin
LeechFTP
LeechGet
LieBaoFast
Lightspeedsystems
LinkScan
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MJ12bot
MSIECrawler
MTRobot
Majestic SEO
Masscan
MegaIndex.ru
Moblie Safari
Mr.4x3
Musobot
Name Intelligence
Nessus
NetAnts
NetLyzer
NetMechanic
Netcraft
Netvibes
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nuclei
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeSpider
OutfoxBot
PECL::HTTP
PageScorer
PageThing.com
Pandalytics
PeoplePal
Petalbot
Pimonster
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
Quick-Crawler
RSSingBot
RankActive
RankurBot
Reaper
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scrapy
ScrepyBot
Seekport
SeoSiteCheckup
Seomoz
Shodan
Siphon
SiteSnagger
Sitebeam
Sitevigil
SmartDownload
Snapbot
Snoopy
Sottopop
SpaceBison
Spbot
Sqlworm
Sqworm
Stripper
Sucker
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
TheNomad
TightTwatBot
Trendictionbot
True_Robot
Twice
URLy Warning
V-BOT
Vacuum
VelenPublicWebCrawler
VidibleScraper
Voil
Voltron
WASALive-Bot
WBSearchBot
WWWOFFLE
Wallpapers
WallpapersHD
Web Sucker
WebCopier
WebReaper
WebStripper
WebSucker
Webalta
Webshag
WebsiteExtractor
Whatweb
Who.is Bot
Xaldon WebSpider
Xenu
Zade
Zermelo
Zeus
ZmEu
ZoominfoBot
arquivo.pt
autoemailspider
check1.exe
clark-crawler
crawl.sogou.com
crawler4j
domainsproject.org
evc-batch
instabid
ips-agent
linkdexbot
lwp-trivial
polaris version
seocompany.store
sexsearcher
sogouspider
sp_auditbot
trendiction.de
voyagerx.com
x09Mozilla
x22Mozilla
zauba.io