nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-10-12 10:18:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ALittle Client
Aboundex
Acunetix
Alligator
Aspiegel
BBBike
BLEXBot
BackDoorBot
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
BlowFish
Boardreader
Bolt
Buck
Buddy
BuiltWith
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrunchBot
Curious
Custo
CyotekWebCopy
DTS Agent
Demon
Digincore
DigitalPebble
Dirbuster
Discobot
Dispatch
DittoSpyder
DnyzBot
Dotbot
Drip
ECCP/1.0
EMail Siphon
EirGrabber
Evil
FDM
Firefox/7.0
FrontPage
GT::WWW
GalaxyBot
Genieo
Gigabot
Go-Ahead-Got-It
Grafula
GridBot
HEADMasterSEO
Haansoft
Harvest
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
IndeedBot
Indy Library
InfoTekies
InterGET
InternetSeer
JOC Web Spider
Jbrofuzz
JustView
Jyxobot
Kinza
Kozmosbot
LNSpiderguy
Larbin
Leap
Libwhisker
Likse
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
Majestic SEO
Majestic-SEO
Majestic12
Masscan
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
Musobot
NICErsPRO
Name Intelligence
Needle
NetMechanic
NetSpider
Netcraft
Netvibes
Nibbler
Niki-bot
Nikto
Nimbostratus
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PictureFinder
Piepmatz
Psbot
Pump
RankFlex
RankingBot
RankurBot
ReGet
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SMTBot
Screaming
Semrush
Seomoz
Shodan
Siphon
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snake
Snoopy
Sociscraper
Sosospider
Sottopop
Spanner
Spinn3r
Sqlmap
Sqworm
Steeler
Stripper
SuperHTTP
Swiftbot
Telesoft
Telesphoreo
Telesphorep
TightTwatBot
Trendiction
Turingos
TurnitinBot
Twice
Typhoeus
URLy Warning
UnisterBot
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
Voil
Voltron
WWW-Mechanize
WeSEE
Web Sauger
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebReaper
WebStripper
WebWhacker
WebZIP
Website Quester
WebsiteExtractor
Whatweb
WinHTTrack
Wonderbot
Wotbox
Zeus
Zitebot
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
cognitiveseo
dataforseo.com
demandbase-bot
facebookscraper
instabid
ips-agent
isitwp.com
magpie-crawler
meanpathbot
oBot
s1z.ru
satoristudio.net
scalaj-http
seobility
seostar
sitechecker.pro
siteripz
sogouspider
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe
zgrab