nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-19 10:10:01 +00:00

250 lines
2.7 KiB
Text

80legs
ALittle Client
Aboundex
AfD-Verbotsverfahren
Aipbot
AllSubmitter
AlphaBot
Anthill
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BDFetch
BackStreet
BackWeb
Backlink-Ceck
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
BotALot
Brandprotect
Buck
BuiltBotTough
Bullseye
CCBot
CheeseBot
Cloud mapping
Cogentbot
Copier
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
DBLBot
DIIbot
DSearch
DTS Agent
Demon
Discobot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
Download Wonder
EMail Siphon
Ebingbong
Ecxi
EroCrawler
ExtLinksBot
Ezooms
FDM
FemtosearchBot
Fimap
Foobot
G-i-g-a-b-o-t
GermCrawler
Getintent
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HMView
HaosouSpider
Harvest
Hloader
Humanlinks
HybridBot
IDBTE4M
Id-search
IlseBot
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
Iria
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
Kenjin Spider
Larbin
LeechFTP
LexiBot
LibWeb
LieBaoFast
LinkWalker
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Meanpathbot
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Nameprotect
NearSite
Nessus
Net Vampire
NetAnts
Netvibes
NextGenSearchBot
Niki-bot
Nimbostratus
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenVAS
Openvas
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Pandalytics
Picscout
Picsearch
Pimonster
Pixray
Pockey
ProWebWalker
Probethenet
Pu_iN
Pump
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
RebelMouse
RepoMonkey
RocketCrawler
Rogerbot
SEOlyticsCrawler
SEOprofiler
SearchmetricsBot
Semrush
SentiBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
Sogou web spider
Sosospider
Spammen
SpankBot
Sqlmap
SuperBot
SurveyBot
Swiftbot
T8Abot
TeleportPro
TheNomad
Thumbor
Trendiction
Trendictionbot
Turingos
Typhoeus
UnisterBot
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Voil
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebBandit
WebCollage
WebImageCollector
WebLeacher
WebSauger
Webshag
WebsiteExtractor
Whack
Whatweb
Who.is Bot
Wotbox
Xaldon_WebSpider
Zade
Zermelo
ZmEu
ZoomBot
ZumBot
ZyBorg
autoemailspider
backlink-check
check1.exe
clark-crawler
com.plumanalytics
dataforseo.com
domainsproject.org
eCatch
evc-batch
heritrix
instabid
ips-agent
lwp-request
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
plumanalytics
satoristudio.net
seobility
seoscanners
sitechecker.pro
siteripz
sogouspider
sp_auditbot
tAkeOut
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
webpros.com
zgrab