nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-09-03 10:09:33 +00:00

250 lines
2.5 KiB
Text

360Spider
404enemy
ADmantX
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
Alexibot
Anarchie
Asterias
Atomseobot
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bigfoot
BlackWidow
Blackboard
Blow
BotALot
Brandwatch
BuiltWith
Bullseye
BuzzSumo
CSHttp
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Copier
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DBLBot
DataCha0s
Deusu
DigitalPebble
Disco
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomainCrawler
Dotbot
ECCP/1.0
Evil
Express WebPictures
FemtosearchBot
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
Getintent
GoZilla
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HybridBot
IDBTE4M
IRLbot
Iblog
IlseBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
Iria
JamesBOT
Jbrofuzz
JetCar
Jetty
JustView
Jyxobot
Lanshanbot
Leap
Likse
LinkWalker
LinkpadBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Mag-Net
Mail.RU_Bot
MarkMonitor
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
MolokaiBot
Mr.4x3
NPbot
Needle
Nessus
Net Vampire
NetMechanic
NetSpider
NetZIP
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Not
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
PageGrabber
Papa Foto
PeoplePal
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
PxBroker
PyCurl
Quick-Crawler
RankActive
Rankivabot
Re-re
Reaper
RedesScrapy
RepoMonkey
Rogerbot
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Semrush
SeobilityBot
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
SlySearch
Snapbot
Sociscraper
Sogou web spider
Sottopop
SpaceBison
Spanner
Spbot
SputnikBot
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Swiftbot
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
Toweyabot
Tracemyfile
Turnitin
Twice
V-BOT
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WeSEE
Web Auto
Web Collage
Web Fetch
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebSucker
WebsiteExtractor
Webster
Who.is Bot
Widow
WiseGuys Robot
YoudaoBot
Zade
Zauba
Zeus
Zitebot
ZoominfoBot
backlink-check
coccocbot
cognitiveseo
dataforseo.com
eCatch
evc-batch
facebookscraper
heritrix
internetVista monitor
ips-agent
isitwp.com
linkdexbot
magpie-crawler
meanpathbot
netEstate NE Crawler
polaris version
ripz
s1z.ru
scan.lol
siteripz
sp_auditbot
sysscan
tAkeOut
trendiction.com
voyagerx.com
webgains-bot
x09Mozilla
x22Mozilla
zauba.io