nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-09 10:07:28 +00:00

100 lines
1.1 KiB
Text

Anarchy
BatchFTP
Boardreader
Brandprotect
CODE87
Cegbfeieh
Craftbot
Curious
Deusu
DomainCrawler
DomainStatsBot
Domains Project
ECCP/1.0
EirGrabber
Exabot
Express WebPictures
Genieo
GetWeb
Getintent
GrapeFX
HMView
Havij
Heritrix
Humanlinks
Internet Ninja
JOC Web Spider
JamesBOT
Jbrofuzz
Joomla
Jorgee
Keybot Translation-Search-Machine
Keyword Density
LibWeb
Lmspider
Majestic-SEO
Masscan
Moblie Safari
Mozlila
Msrabot
Nameprotect
NearSite
NetLyzer
Nikto
NimbleCrawler
Ninja
OpenLinkProfiler
Openvas
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Panscient
Petalbot
Pump
PxBroker
Rankivabot
ReGet
SEOkicks-Robot
SEOprofiler
SEOstats
SearchmetricsBot
Seekport
SemanticJuice
SentiBot
Site Sucker
SiteLockSpider
Sitebeam
Sitevigil
SlySearch
Sosospider
Spammen
Spbot
T0PHackTeam
TheNomad
TightTwatBot
Toweyabot
Trendictionbot
True_Robot
UnisterBot
Voil
Web Collage
Web Enhancer
Web Sucker
WebAuto
WebSauger
WebStripper
Website Quester
Woobot
Xaldon WebSpider
Xaldon_WebSpider
archive.org_bot
check1.exe
demandbase-bot
gopher
instabid
isitwp.com
magpie-crawler
openai.com
page scorer
webmeup-crawler