nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-11 10:13:25 +00:00

100 lines
1.1 KiB
Text

ADmantX
Aboundex
Aspiegel
AwarioSmartBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
BlackWidow
Buck
BunnySlippers
Cegbfeieh
Citoid
Curious
Custo
Evil
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
Fimap
Flunky
Freeuploader
G-i-g-a-b-o-t
Genieo
GetWeb
GrabNet
Grabber
GrapeFX
HMView
IRLbot
IlseBot
Image Sucker
InfraSec Scanner
InternetMeasurement
Jbrofuzz
Kozmosbot
LeechGet
LibWeb
Lipperhey
MSIECrawler
MTRobot
Majestic12
MarkMonitor
Mata Hari
Mediatoolkitbot
Metauri
Microsoft URL Control
NetMechanic
Nettrack
NextGenSearchBot
Nimbostratus
Nuclei
Offline Explorer
Offline Navigator
PECL::HTTP
QueryN Metasearch
RankActive
RepoMonkey
ScanAlert
ScoutJet
Screaming
SearchmetricsBot
SeekportBot
SemrushBot-FT
Spanner
Spbot
Spinn3r
Surfbot
Thumbor
Tracemyfile
Trendiction
Turnitin
UnisterBot
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
WWWOFFLE
Web Enhancer
WebCopier
WebReaper
WebSucker
WebWhacker
Webster
Who.is Bot
Xaldon WebSpider
Zeus
autoemailspider
coccocbot
crawler4j
demandbase-bot
heritrix
iubenda-radar
magpie-crawler
meanpathbot
oBot
serpstatbot
sitechecker.pro
spyfu
webgains-bot