nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-11-13 22:07:15 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
Aboundex
Aboundexbot
AhrefsBot
Anarchy
Asterias
Attach
AwarioRssBot
BBBike
BackWeb
Backlink-Ceck
Barkrowler
BatchFTP
Bitacle
Blackboard
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
CATExplorador
Cegbfeieh
CensysInspect
CheeseBot
Chlooe
Cloud mapping
Collector
Copier
Copyscape
Craftbot
CrazyWebCrawler
DataCha0s
Deusu
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainStatsBot
Dotbot
EMail Siphon
EMail Wolf
EasyDL
Extractor
Extreme Picture Finder
FDM
FlashGet
Flunky
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrapeFX
Haansoft
HaosouSpider
Hloader
HonoluluBot
IDBot
IRLbot
Id-search
IlseBot
Image Sucker
InterGET
Internet Ninja
JamesBOT
JennyBot
Jetty
Joomla
Jyxobot
Kinza
LexiBot
Lftp
LibWeb
Likse
LinkScan
LinkWalker
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MIIxpc
MQQBrowser
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Mass Downloader
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Minefield
Moblie Safari
MolokaiBot
Mr.4x3
NICErsPRO
Name Intelligence
Nameprotect
Needle
Nessus
Net Vampire
NetAnts
NetZIP
Netcraft
Nibbler
Niki-bot
Nmap
Nuclei
Offline Navigator
OpenLinkProfiler
OutclicksBot
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Pi-Monster
PictureFinder
Probethenet
Pu_iN
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
RankingBot2
Re-re
Reaper
Recorder
RedesScrapy
RepoMonkey
SEOkicks-Robot
Scrapy
Screaming
ScrepyBot
SemanticJuice
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SmartDownload
Snoopy
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spbot
SputnikBot
Sqworm
Steeler
Stripper
Suzuran
Swiftbot
T8Abot
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toata
Tracemyfile
Trendictionbot
True_Robot
TurnitinBot
Twice
URLy.Warning
UnisterBot
Vagabondo
VoidEYE
Voltron
WBSearchBot
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Fetch
Web Fuck
Web Pix
WebAuto
WebEnhancer
WebFuck
WebGo IS
WebReaper
WebStripper
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whacker
Whatweb
Xaldon WebSpider
Zade
Zermelo
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
backlink-check
com.plumanalytics
crawl.sogou.com
crawler4j
domainsproject.org
eCatch
gopher
ips-agent
linkdexbot
lwp-request
magpie-crawler
pcBrowser
s1z.ru
scalaj-http
scan.lol
seoscanners
seostar
serpstatbot
siteripz
spyfu
sysscan
trendiction.com
trendiction.de
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
zauba.io
zgrab