nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-08-25 22:06:53 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ALittle Client
ASPSeek
Abonti
Aboundexbot
Anarchie
Ankit
Apexoo
Aspiegel
BDCbot
BLEXBot
BackDoorBot
Backlink-Ceck
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
Brandprotect
Brandwatch
Buck
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CCBot
CSHttp
Cegbfeieh
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Crescent
Custo
DBLBot
DIIbot
DTS Agent
Devil
Digincore
DigitalPebble
Dirbuster
DittoSpyder
DomainCrawler
EMail Wolf
Ecxi
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
FDM
FlashGet
Flunky
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GetRight
Gigabot
Grabber
HTTP::Lite
Haansoft
HaosouSpider
Heritrix
Humanlinks
HybridBot
IDBot
Iblog
Image Fetch
IndeedBot
Indy Library
Intelliseek
InterGET
Iria
IstellaBot
JennyBot
JetCar
JikeSpider
Joomla
Jorgee
JustView
Keyword Density
LWP::Simple
Lanshanbot
Leap
LeechGet
LexiBot
Lftp
LibWeb
Likse
LinkScan
LinkWalker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
MIIxpc
MJ12bot
MTRobot
Metauri
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Msrabot
NICErsPRO
NPbot
Nameprotect
NearSite
Needle
Net Vampire
NetSpider
Netvibes
Nikto
NimbleCrawler
Nimbostratus
Nmap
Openvas
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Papa Foto
Pavuk
Picscout
Piepmatz
Pixray
PleaseCrawl
ProWebWalker
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
Rankivabot
RealDownload
RebelMouse
RedesScrapy
RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
Scrapy
Semrush
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
SiteCheckerBotCrawler
SiteSucker
Sitebeam
SlySearch
Snoopy
Sociscraper
Sogou web spider
Sottopop
Spanner
SputnikBot
Stripper
SuperBot
Surfbot
Szukacz
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TightTwatBot
Toata
Tracemyfile
Trendiction
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Sucker
WebCopier
WebEnhancer
WebImageCollector
WebStripper
WebWhacker
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whatweb
WinHTTrack
Woobot
Wotbox
Wprecon
Xenu
Zade
Zauba
Zermelo
Zeus
archive.org_bot
arquivo.pt
autoemailspider
instabid
internetVista monitor
isitwp.com
lwp-request
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
ripz
s1z.ru
satoristudio.net
scalaj-http
seostar
sexsearcher
spyfu
trendiction.com
trendiction.de
ubermetrics-technologies.com
webprosbot
xpymep1.exe
zauba.io