nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-02-21 10:09:28 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404enemy
ADmantX
Abonti
Aboundex
AhrefsBot
AlphaBot
Anarchy
Anthill
Aspiegel
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Bandit
BotALot
BuiltBotTough
BuzzSumo
CCBot
Claritybot
Collector
Copier
CopyRightCheck
Craftbot
CrunchBot
Curious
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Demon
Devil
Digincore
DigitalPebble
Dirbuster
Dispatch
DnBCrawler-Analytics
DomainSigmaCrawler
Dotbot
Dragonfly
EMail Wolf
EasyDL
Firefox/7.0
FrontPage
FyberSpider
GT::WWW
Genieo
Gigabot
Gotit
Grabber
HMView
HTMLparser
HTTP::Lite
HaosouSpider
Havij
Hloader
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
Indy Library
InfoNaviRobot
InfoTekies
IstellaBot
JamesBOT
Jbrofuzz
JetCar
JikeSpider
JustView
Jyxobot
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechGet
Libwhisker
Lightspeedsystems
Likse
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Masscan
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
MolokaiBot
Navroad
Needle
NetLyzer
NetSpider
NextGenSearchBot
Nmap
Nuclei
Nutch
OpenVAS
Openfind
OutclicksBot
Page Analyzer
PageScorer
Panscient
Petalbot
PictureFinder
Pixray
ProPowerBot
ProWebWalker
Pu_iN
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankurBot
Re-re
RealDownload
Recorder
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SEOprofiler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
SemrushBot
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
SlySearch
SocialRankIOBot
Sosospider
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Stripper
Surfbot
SurveyBot
Szukacz
T8Abot
The Intraformant
Thumbor
TightTwatBot
Toata
Tracemyfile
True_Robot
Turingos
Typhoeus
URLy Warning
V-BOT
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voil
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Sauger
WebAuto
WebCollage
WebCopier
WebEnhancer
WebImageCollector
WebSauger
WebStripper
WebWhacker
WebZIP
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
WinHTTrack
WiseGuys Robot
Wotbox
Xenu
YoudaoBot
Zauba
Zermelo
Zitebot
ZmEu
ZoomBot
ZoominfoBot
adscanner
archive.org_bot
arquivo.pt
autoemailspider
cah.io.community
check1.exe
clark-crawler
com.plumanalytics
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
facebookscraper
instabid
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
page scorer
plumanalytics
probe-image-size
ripz
seoscanners
sexsearcher
siteripz
sogouspider
tAkeOut
trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla