nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-11-25 10:09:18 +00:00

250 lines
2.5 KiB
Text

360Spider
ADmantX
AIBOT
ALittle Client
Aboundex
Acunetix
AhrefsBot
Alexibot
AllSubmitter
AlphaBot
Anarchy99
Anthill
Asterias
Attach
AwarioRssBot
Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
BlackWidow
Blackboard
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
CSHttp
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Copyscape
Craftbot
Crescent
CrunchBot
DTS Agent
Devil
Digincore
Dirbuster
Discobot
DittoSpyder
DomainSigmaCrawler
Dragonfly
Drip
EMail Siphon
Ebingbong
FDM
Fimap
Freeuploader
FrontPage
Fuzz
Fyrebot
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
Gotit
GrapeFX
GridBot
HEADMasterSEO
HMView
HTTrack
Havij
IDBTE4M
IDBot
IRLbot
Id-search
Image Fetch
Image Sucker
IndeedBot
Indy Library
Internet Ninja
InternetSeer
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
JustView
Kenjin Spider
Kinza
LWP::Simple
Lanshanbot
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinksManager
LinqiaRSSBot
MIIxpc
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mass Downloader
Masscan
Meanpathbot
Metauri
Mister PiX
Mojeek
Msrabot
Nessus
NetMechanic
NetZIP
Netvibes
Nibbler
Niki-bot
Nimbostratus
Ninja
Nmap
Octopus
Openfind
Openvas
OrangeSpider
PECL::HTTP
PageAnalyzer
PageThing.com
Pandalytics
Pavuk
PeoplePal
Petalbot
Piepmatz
Pimonster
Pixray
PleaseCrawl
Pu_iN
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankActive
Rankivabot
RankurBot
Re-re
ReGet
RebelMouse
Recorder
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
SalesIntelligent
Scrapy
Screaming
SemanticJuice
SemrushBot
SentiBot
Siphon
SiteLockSpider
SiteSucker
Sitebeam
SlySearch
Sogou web spider
Sottopop
SpaceBison
Spanner
Spbot
Sqworm
Steeler
Sucker
Sucuri
SuperBot
Swiftbot
T8Abot
Teleport
TeleportPro
Telesphorep
TheNomad
Thumbor
TightTwatBot
Toata
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WWW-Mechanize
WallpapersHD
Web Fuck
Web Sucker
WebCopier
WebFuck
WebLeacher
WebReaper
WebSauger
WebSucker
WebWhacker
Webalta
Webshag
Whack
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wotbox
Zauba
Zermelo
Zeus
Zitebot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
cognitiveseo
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
heritrix
ips-agent
lwp-trivial
mediawords
oBot
page scorer
pcBrowser
polaris version
s1z.ru
satoristudio.net
scalaj-http
seobility
seostar
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe