nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-09-04 22:07:28 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
AIBOT
Abonti
Aboundex
AhrefsBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
BBBike
BDCbot
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
Bolt
BotALot
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
CCBot
ChinaClaw
Chlooe
Cloud mapping
Cocolyzebot
Cosmos
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
Discoverybot
DittoSpyder
DomCopBot
DomainStatsBot
Domains Project
Download Wonder
Drip
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Foobot
Freeuploader
Fyrebot
GT::WWW
GermCrawler
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTrack
Haansoft
Heritrix
IDBot
Id-search
IlseBot
Iskanie
JamesBOT
JennyBot
Jetty
JikeSpider
Joomla
Jorgee
Kinza
Kozmosbot
LNSpiderguy
Larbin
LeechGet
LexiBot
Libwhisker
LieBaoFast
LinkpadBot
LinksManager
Lmspider
MSFrontPage
Magnet
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Meanpathbot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Msrabot
NPbot
Navroad
NearSite
NetLyzer
NetSpider
NetZIP
Nettrack
Nikto
Nmap
Offline Navigator
Openfind
OutclicksBot
POE-Component-Client-HTTP
Pandalytics
Panscient
Pi-Monster
Picscout
Picsearch
Pixray
PleaseCrawl
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankurBot
Re-re
ReGet
RedesScrapy
Ripper
SBIder
SEOlyticsCrawler
SEOprofiler
SMTBot
Scanbot
Screaming
Searchestate
SentiBot
SeobilityBot
Seomoz
Shodan
Siphon
SiteExplorer
SiteLockSpider
SiteSucker
Sitebeam
Sitevigil
SlySearch
Snoopy
Sqlmap
Sqlworm
Sqworm
Sucker
Sucuri
SuperBot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Telesphorep
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendictionbot
URLy Warning
URLy.Warning
VCI
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebSauger
WebStripper
Webalta
Webshag
Webster
Whack
Whacker
WiseGuys Robot
Wonderbot
Woobot
Wotbox
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
cah.io.community
check1.exe
clark-crawler
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch
gopher
heritrix
instabid
internetVista monitor
lwp-request
lwp-trivial
meanpathbot
oBot
page scorer
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla
zgrab