nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-27 10:11:58 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Aboundexbot
Acunetix
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anarchy
BBBike
BatchFTP
Bigfoot
Bolt
Brandprotect
BuiltWith
Citoid
Cogentbot
Collector
CrazyWebCrawler
Crescent
Curious
Dispatch
EirGrabber
ExtLinksBot
ExtractorPro
Flunky
Getintent
GrabNet
GrapeFX
HTTrack
Harvest
Havij
Hloader
Indy Library
JetCar
Keyword Density
Lanshanbot
LinqiaMetadataDownloaderBot
Lipperhey
MFC_Tear_Sample
Mass Downloader
Mata Hari
MicroMessenger
Microsoft URL Control
Morfeus Fucking Scanner
Musobot
NextGenSearchBot
Nikto
Nutch
Octopus
Offline Navigator
PageGrabber
Panscient
Pi-Monster
Pockey
ProWebWalker
Psbot
RankActiveLinkBot
Ripper
SEOstats
ScanAlert
Screaming
Semrush
SemrushBot-OCOB
SeoCherryBot
SeoSiteCheckup
Site Sucker
SiteLockSpider
SlySearch
SmartDownload
Spider_Bot
SputnikBot
SuperHTTP
Turnitin
URLy.Warning
VB Project
Virusdie
WallpapersHD
Web Enhancer
Web Fetch
Web Sucker
WebCopier
Widow
WinHTTrack
Wotbox
Zeus
Zitebot
archive.org_bot
arquivo-web-crawler
awario.com
com.plumanalytics
crawl.sogou.com
evc-batch
linkfluence
meanpathbot
pcBrowser
spyfu
trendiction.de
webmeup-crawler
webpros.com
zgrab