nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-test.list
2020-08-28 23:45:18 +02:00

250 lines
2.6 KiB
Text

80legs
Abonti
ADmantX
AIBOT
AllSubmitter
Apexoo
archive.org_bot
arquivo-web-crawler
Attach
AwarioSmartBot
BacklinkCrawler
BackWeb
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
BDFetch
Bitacle
Blackboard
BlackWidow
Blow
Brandwatch
Buddy
Bullseye
CCBot
CherryPicker
Cliqzbot
Cloud mapping
coccocbot-web
Collector
CopyRightCheck
crawler.feedback
crawl.sogou.com
CSHttp
Curious
Custo
DataCha0s
demandbase-bot
Dirbuster
Discobot
DittoSpyder
DnyzBot
DomainCrawler
Domains Project
Dotbot
Dragonfly
Drip
DTS Agent
Ebingbong
eCatch
EirGrabber
evc-batch
Evil
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
facebookscraper
FDM
Freeuploader
FrontPage
FyberSpider
Getintent
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
GoZilla
Go!Zilla
GrapeshotCrawler
GridBot
HEADMasterSEO
heritrix
Heritrix
HTMLparser
Humanlinks
Iblog
IlseBot
Image Sucker
Indy Library
InterGET
internetVista monitor
ips-agent
IstellaBot
Jbrofuzz
JetCar
JOC Web Spider
JustView
Jyxobot
Lanshanbot
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Magnet
magpie-crawler
Majestic SEO
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
meanpathbot
Meanpathbot
MeanPath Bot
mediawords
Metauri
MicroMessenger
MIIxpc
Mojeek
Mojolicious
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
muhstik-scan
Musobot
Nessus
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nibbler
NICErsPRO
NimbleCrawler
NPbot
Offline Explorer
Openfind
Openvas
OPPO A33
OrangeSpider
page scorer
Pandalytics
Papa Foto
Pavuk
PeoplePal
PHPCrawl
Pi-Monster
Pixray
Pockey
POE-Component-Client-HTTP
ProPowerBot
QueryN Metasearch
Rankivabot
RealDownload
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
RSSingBot
satoristudio.net
SBIder
Scanbot
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
SEOprofiler
seoscanners
SEOstats
Shodan
SiteCheckerBotCrawler
sitechecker.pro
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
Site Sucker
SmartDownload
Snake
Snoopy
Sociscraper
sogouspider
Sogou web spider
Sosospider
Sottopop
SpankBot
Spbot
Spinn3r
SputnikBot
spyfu
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
sysscan
T0PHackTeam
T8Abot
Telesoft
The Intraformant
Thumbor
TightTwatBot
Toata
Tracemyfile
Trendiction
trendiction.com
True_Robot
Turnitin
Typhoeus
URLy Warning
URLy.Warning
Vagabondo
VB Project
VidibleScraper
VoidEYE
Voil
Voltron
WASALive-Bot
Webalta
WebAuto
Web Auto
WebCollage
Web Enhancer
WebGo IS
WebmasterWorldForumBot
WebReaper
Webshag
Website Quester
WebSucker
WebZIP
WeSEE
Whack
Whacker
WinHTTrack
Wprecon
WPScan
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
zauba.io
Zeus
ZumBot