nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-10-25 10:18:47 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
ADmantX
ASPSeek
Abonti
Aboundex
Acunetix
Aipbot
AlphaBot
Anarchie
Anthill
Aspiegel
Asterias
Attach
AwarioRssBot
BLEXBot
BackDoorBot
Backlink-Ceck
Badass
Barkrowler
BetaBot
Bigfoot
Blow
BlowFish
Boardreader
Bolt
Buck
BuiltBotTough
Bullseye
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Cloud mapping
Cocolyzebot
Cogentbot
Copier
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DSearch
DTS Agent
Dirbuster
Disco
Discoverybot
DomCopBot
DomainStatsBot
Dotbot
Download Wonder
EasyDL
EirGrabber
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Fimap
Foobot
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
Gigabot
GoZilla
Gotit
Grabber
GridBot
HTMLparser
HTTrack
HaosouSpider
Havij
Heritrix
HybridBot
IDBTE4M
IDBot
IRLbot
Id-search
IlseBot
Indy Library
Intelliseek
Iria
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keyword Density
LWP::Simple
Larbin
LexiBot
LibWeb
LieBaoFast
LinkWalker
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
MIDown tool
MIIxpc
MQQBrowser
Magnet
Majestic12
MarkWatch
MauiBot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojolicious
Mozlila
Musobot
Nessus
NetSpider
Netcraft
Nibbler
Nimbostratus
Nmap
Nutch
Offline Navigator
OpenVAS
OrangeBot
OutfoxBot
PageGrabber
Petalbot
Pi-Monster
Picscout
Piepmatz
ProPowerBot
ProWebWalker
Pump
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
Scrapy
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
Shodan
Site Sucker
SiteExplorer
Sitebeam
Snake
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
Spammen
SpankBot
Spanner
Spbot
Spinn3r
Sucker
Sucuri
Suzuran
T0PHackTeam
T8Abot
Telesphoreo
Telesphorep
TightTwatBot
Toata
Trendiction
URLy Warning
Upflow
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WBSearchBot
WWW::Mechanize
WeSEE
Web Auto
Web Fuck
Web Pix
WebPix
WebReaper
WebSauger
WebStripper
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
WinHTTrack
Woobot
Wotbox
Xaldon_WebSpider
Zauba
Zitebot
ZmEu
ZoomBot
ZoominfoBot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
eCatch
facebookscraper
gopher
ips-agent
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
oBot
pcBrowser
polaris version
satoristudio.net
seostar
serpstatbot
spyfu
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zgrab