nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-10-17 10:17:47 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404enemy
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchy99
Ankit
Apexoo
Aspiegel
AwarioSmartBot
BDFetch
BackStreet
BackWeb
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
BlackWidow
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CSHttp
CensysInspect
CheTeam
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
Custo
DigitalPebble
Discobot
Dispatch
DomCopBot
Domains Project
Dotbot
Drip
EasyDL
EroCrawler
Evil
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FrontPage
Fyrebot
Genieo
Go!Zilla
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
Hloader
Humanlinks
HybridBot
Iblog
InfoTekies
Intelliseek
InternetSeer
Iria
Iskanie
JamesBOT
Jbrofuzz
JennyBot
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Larbin
LexiBot
LibWeb
Libwhisker
Likse
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
Mag-Net
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MeanPath Bot
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
NetAnts
NetSpider
Nettrack
NextGenSearchBot
NimbleCrawler
OnCrawl
Openvas
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PeoplePal
Petalbot
PictureFinder
Pimonster
Pixray
Pockey
Pu_iN
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
ReGet
Reaper
RedesScrapy
Ripper
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Scrapy
SearchmetricsBot
Semrush
SeoSiteCheckup
Shodan
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
SuperHTTP
SurveyBot
Szukacz
T8Abot
Telesphorep
The Intraformant
TightTwatBot
Titan
Tracemyfile
Trendictionbot
Turingos
Turnitin
UnisterBot
Upflow
VB Project
Vagabondo
Voil
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WallpapersHD
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebFuck
WebGo IS
WebImageCollector
WebPix
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Who.is Bot
Widow
Xaldon_WebSpider
YoudaoBot
Zermelo
Zeus
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
eCatch
evc-batch
instabid
lwp-trivial
meanpathbot
mediawords
oBot
page scorer
s1z.ru
satoristudio.net
scalaj-http
seostar
serpstatbot
sexsearcher
sogouspider
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
x22Mozilla
zgrab