nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-10 22:04:54 +00:00

100 lines
1.1 KiB
Text

Abonti
Anarchie
Anthill
AwarioSmartBot
BDCbot
BacklinkCrawler
Badass
BatchFTP
Blackboard
CODE87
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cloud mapping
Cocolyzebot
Crawling at Home Project
DataCha0s
Devil
Digincore
Dispatch
DomCopBot
Domains Project
ECCP/1.0
FHscan
Firefox/7.0
GetRight
Getintent
Heritrix
Kenjin Spider
LeechGet
Lightspeedsystems
LinkextractorPro
LinqiaMetadataDownloaderBot
Ltx71
Majestic SEO
Masscan
Meanpathbot
Metauri
Moblie Safari
Mojeek
Name Intelligence
Nameprotect
Navroad
Nessus
Nettrack
Netvibes
Nibbler
Nutch
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Pi-Monster
Picscout
Probethenet
Pump
RSSingBot
RankActiveLinkBot
Rankivabot
Reaper
RepoMonkey
Rogerbot
SEOstats
SMTBot
Scanbot
SeoSiteCheckup
SiteExplorer
Siteimprove
Snoopy
SuperBot
T8Abot
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
Turnitin
UnisterBot
Wallpapers/3.0
Web Fetch
Web Sucker
WebAuto
Website Quester
Webster
Wprecon
Zauba
ZmEu
ZoomBot
ZoominfoBot
check1.exe
domainsproject.org
linkfluence
mediawords
s1z.ru
seoscanners
seostar
serpstatbot
trendiction.de
webprosbot
zgrab