nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-09-14 10:09:14 +00:00

250 lines
2.5 KiB
Text

360Spider
ASPSeek
Abonti
Aboundex
Aboundexbot
AhrefsBot
Anarchy
Anthill
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackWeb
BacklinkCrawler
Bigfoot
Black Hole
Blackboard
Blow
Bolt
Brandwatch
Buck
Buddy
BuzzSumo
CODE87
CSHttp
CazoodleBot
CensysInspect
ChinaClaw
Cliqzbot
Cloud mapping
Collector
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Custo
DIIbot
DSearch
Demon
DigitalPebble
Dirbuster
Discobot
Discoverybot
Dispatch
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
EroCrawler
ExtLinksBot
Extractor
Fimap
FlashGet
Foobot
Freeuploader
Fuzz
FyberSpider
GT::WWW
GalaxyBot
GermCrawler
GetWeb
Gotit
Grabber
Grafula
GridBot
HTMLparser
HTTrack
Haansoft
HaosouSpider
Hloader
HonoluluBot
Humanlinks
IDBTE4M
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InterGET
Iskanie
JOC Web Spider
JetCar
Jetty
Jorgee
JustView
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
Larbin
LeechFTP
LeechGet
LibWeb
LieBaoFast
Likse
LinkScan
Linkbot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIIxpc
MSFrontPage
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Name Intelligence
NetAnts
NetMechanic
NetSpider
Nettrack
Nikto
Nimbostratus
Ninja
Nuclei
Offline Navigator
OpenVAS
OutclicksBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Pavuk
PeoplePal
Petalbot
PictureFinder
PleaseCrawl
Pu_iN
Pump
PxBroker
PyCurl
Quick-Crawler
RankActive
RankingBot
Re-re
ReGet
RealDownload
Reaper
RocketCrawler
SEOkicks
SEOkicks-Robot
SMTBot
Scanbot
SearchmetricsBot
Seekport
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Sitebeam
Sitevigil
SlySearch
Snake
SocialRankIOBot
Sociscraper
Sogou web spider
Spinn3r
Steeler
Szukacz
Telesoft
Telesphoreo
Titan
Toweyabot
Tracemyfile
URLy Warning
UnisterBot
V-BOT
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WBSearchBot
WPScan
WWW-Mechanize
WWW::Mechanize
WallpapersHD
Web Auto
Web Pix
Web Sucker
WebBandit
WebEnhancer
WebFuck
WebLeacher
WebReaper
WebSauger
WebSucker
Webshag
Whack
Widow
WiseGuys Robot
Xaldon WebSpider
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
arquivo.pt
autoemailspider
clark-crawler
cognitiveseo
com.plumanalytics
demandbase-bot
eCatch
evc-batch
facebookscraper
gopher
instabid
iubenda-radar
muhstik-scan
oBot
pcBrowser
ripz
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
sexsearcher
sitechecker.pro
spyfu
sysscan
voyagerx.com
webgains-bot
webpros.com
x22Mozilla