nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-07-16 10:09:09 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
AllSubmitter
Alligator
Anthill
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Bigfoot
Black Hole
Blackboard
BlowFish
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CCBot
CSHttp
CheTeam
CherryPicker
ChinaClaw
Chlooe
Citoid
Claritybot
Collector
Copier
Cosmos
Craftbot
Curious
Custo
CyotekWebCopy
DBLBot
DTS Agent
DatabaseDriverMysqli
Devil
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DittoSpyder
Domains Project
Download Wonder
Dragonfly
Exabot
ExtLinksBot
EyeNetIE
FHscan
FemtosearchBot
Fimap
FlashGet
Freeuploader
FrontPage
GalaxyBot
GoZilla
GrabNet
GrapeshotCrawler
HTTP::Lite
HTTrack
HaosouSpider
Harvest
HonoluluBot
HybridBot
IDBTE4M
IRLbot
Id-search
Image Fetch
Image Sucker
IndeedBot
Indy Library
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jorgee
JustView
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
Lftp
LibWeb
Libwhisker
LieBaoFast
Likse
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MSIECrawler
Majestic-SEO
Majestic12
Mata Hari
Mb2345Browser
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mojolicious
Mozlila
Name Intelligence
Nameprotect
Needle
Nessus
NetMechanic
Netcraft
Netvibes
Nibbler
Nikto
Ninja
Nmap
Nuclei
Offline Explorer
OnCrawl
OpenLinkProfiler
Openvas
OutfoxBot
PageScorer
PageThing.com
Pandalytics
Panscient
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
Pockey
Probethenet
RankActive
RankingBot2
RankurBot
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SalesIntelligent
Scrapy
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
Seomoz
SiteSnagger
SiteSucker
SlySearch
SmartDownload
Snake
Snoopy
Sogou web spider
Sosospider
SpankBot
Spanner
Spbot
Spinn3r
Sucker
SuperBot
SurveyBot
Teleport
Telesoft
Telesphoreo
The Intraformant
Thumbor
TightTwatBot
Trendiction
Trendictionbot
Turnitin
TwengaBot
Twice
URLy Warning
UnisterBot
Upflow
VB Project
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WPScan
WallpapersHD
Web Enhancer
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebCollage
WebGo IS
WebPix
WebReaper
WebSauger
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Whack
Who.is Bot
Widow
WinHTTrack
Xaldon_WebSpider
YoudaoBot
Zermelo
Zitebot
ZmEu
ZumBot
archive.org_bot
arquivo.pt
autoemailspider
cah.io.community
check1.exe
clark-crawler
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com
heritrix
internetVista monitor
ips-agent
iubenda-radar
magpie-crawler
meanpathbot
mediawords
muhstik-scan
pcBrowser
s1z.ru
satoristudio.net
scan.lol
seoscanners
serpstatbot
sexsearcher
sp_auditbot
sysscan
tAkeOut
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
zauba.io
zgrab