nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-10-07 22:07:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Anthill
Apexoo
Atomseobot
Attach
BDCbot
BDFetch
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
BlowFish
Boardreader
BotALot
BuiltWith
BuzzSumo
CATExplorador
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
Custo
DBLBot
DIIbot
DTS Agent
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
EMail Wolf
EirGrabber
Evil
ExtLinksBot
Extractor
EyeNetIE
FDM
FHscan
Firefox/7.0
FrontPage
Fyrebot
GalaxyBot
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
GridBot
HTMLparser
HTTP::Lite
Harvest
Havij
HybridBot
IDBTE4M
Iblog
IlseBot
Image Fetch
Indy Library
InterGET
IstellaBot
JOC Web Spider
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
LibWeb
Libwhisker
Likse
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MIDown tool
MSFrontPage
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
Masscan
Mata Hari
MauiBot
Metauri
MicroMessenger
Microsoft URL Control
Minefield
Moblie Safari
Mojolicious
Mozlila
NICErsPRO
Navroad
Nessus
Nibbler
NimbleCrawler
Not
Offline Navigator
OnCrawl
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Papa Foto
Picscout
PleaseCrawl
Pockey
ProPowerBot
Probethenet
PxBroker
QueryN Metasearch
RSSingBot
RankingBot
Rankivabot
RealDownload
Reaper
RepoMonkey
RocketCrawler
SBIder
SEOkicks
SEOprofiler
SalesIntelligent
ScanAlert
Scrapy
Seekport
Semrush
SeoSiteCheckup
Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitevigil
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpankBot
Spanner
Spbot
Sqlmap
Steeler
Stripper
Sucker
Sucuri
Surfbot
SurveyBot
Swiftbot
Telesphoreo
Telesphorep
Titan
Toweyabot
TwengaBot
URLy Warning
VCI
Vagabondo
VelenPublicWebCrawler
Voltron
WBSearchBot
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Pix
WebEnhancer
WebLeacher
WebSauger
WebmasterWorldForumBot
Webshag
Website Quester
Whack
Whatweb
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
ZoomBot
ZyBorg
autoemailspider
cah.io.community
clark-crawler
coccocbot
com.plumanalytics
eCatch
evc-batch
internetVista monitor
isitwp.com
iubenda-radar
linkdexbot
muhstik-scan
polaris version
ripz
s1z.ru
seobility
seocompany.store
seostar
sexsearcher
sitechecker.pro
spyfu
tAkeOut
trendiction.de
voyagerx.com
webpros.com
x22Mozilla
zauba.io