nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-07-21 22:07:20 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AlphaBot
Anarchy
Ankit
Apexoo
Attach
AwarioRssBot
BackDoorBot
BacklinkCrawler
Badass
Barkrowler
BatchFTP
Bigfoot
Bitacle
Black Hole
Blackboard
Bolt
Buck
Buddy
BunnySlippers
CODE87
CSHttp
Calculon
Cegbfeieh
ChinaClaw
Citoid
Claritybot
Crawling at Home Project
Crescent
Custo
DBLBot
DTS Agent
DataCha0s
Demon
Deusu
DigitalPebble
Dirbuster
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
Drip
EMail Wolf
EroCrawler
Exabot
ExtLinksBot
EyeNetIE
Ezooms
FlashGet
Fyrebot
G-i-g-a-b-o-t
Genieo
GetRight
Getintent
Gigabot
GrapeFX
HEADMasterSEO
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Iblog
Id-search
IlseBot
Image Sucker
Internet Ninja
JamesBOT
Jbrofuzz
JetCar
Joomla
JustView
Kozmosbot
LWP::Simple
Larbin
LeechFTP
Lftp
LibWeb
Libwhisker
LinkScan
LinkWalker
Linkbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
MIIxpc
MTRobot
Magnet
Majestic12
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Moblie Safari
Mojeek
Mojolicious
Musobot
NPbot
Name Intelligence
Needle
NetAnts
Nettrack
Nibbler
Niki-bot
Not
Octopus
OpenLinkProfiler
Openfind
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Panscient
Picscout
Picsearch
PictureFinder
Pimonster
PleaseCrawl
ProPowerBot
Probethenet
Psbot
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot2
RebelMouse
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SISTRIX
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
Siteimprove
SmartDownload
Snake
Sociscraper
SpaceBison
Spanner
Spbot
Spinn3r
Stripper
SuperHTTP
Surfbot
T0PHackTeam
Teleport
TeleportPro
TightTwatBot
Toata
Tracemyfile
Trendictionbot
Twice
Typhoeus
URLy Warning
UnisterBot
Upflow
VB Project
VCI
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
WEBDAV
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Auto
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebReaper
WebmasterWorldForumBot
WebsiteQuester
Whack
Whatweb
WinHTTrack
Woobot
Xaldon_WebSpider
Zade
ZumBot
ZyBorg
arquivo-web-crawler
backlink-check
cah.io.community
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
facebookscraper
ips-agent
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
page scorer
polaris version
probe-image-size
s1z.ru
seoscanners
serpstatbot
siteripz
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
webprosbot
xpymep1.exe
zgrab