Commit graph

4 commits

Author SHA1 Message Date
Reuven
7b7cfebf33 chore: reorganize scripts into subfolders
Create organized structure:
- benchmark/ - Performance benchmarking scripts
- ci/ - CI/CD automation scripts
- deploy/ - Deployment scripts and docs
- publish/ - Package publishing scripts
- test/ - Testing scripts
- validate/ - Validation & verification scripts

Update README with new structure and usage examples.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-21 23:48:37 -05:00
rUv
de9aa2ea5a feat: Implement GNN forgetting mitigation (#17)
This commit addresses GitHub issue #17 by implementing comprehensive
forgetting mitigation for continual learning in the GNN module.

## New Features

### Optimizer Implementation (training.rs)
- Full Adam optimizer with bias-corrected first and second moments
- SGD with momentum support
- Lazy initialization of state buffers for efficiency

### Replay Buffer (replay.rs)
- Experience replay with reservoir sampling for uniform distribution
- Distribution shift detection with statistical tracking
- Configurable capacity and batch sampling

### Elastic Weight Consolidation (ewc.rs)
- Fisher information diagonal computation
- Anchor weight consolidation for task boundaries
- EWC penalty and gradient computation

### Learning Rate Scheduling (scheduler.rs)
- Constant, StepDecay, Exponential schedulers
- CosineAnnealing with warm restarts
- WarmupLinear for pre-training warmup
- ReduceOnPlateau for adaptive learning

## Deployment Infrastructure

### GitHub Actions Release Pipeline (.github/workflows/release.yml)
- 8-stage CI/CD pipeline for complete releases
- Validates, builds crates, WASM, and native modules
- Publishes to crates.io and npmjs.com
- Creates GitHub releases with artifacts

### Deployment Script (scripts/deploy.sh)
- Comprehensive deployment orchestration
- Version synchronization across Cargo.toml and package.json
- Dry-run mode for testing
- Cross-platform native builds support

## Test Coverage
- 177 tests passing in ruvector-gnn
- Comprehensive tests for all new modules
- Convergence tests for optimizers

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-26 23:17:07 +00:00
rUv
38c79dc4ac feat: Add automated package-lock.json sync tooling
 New Features:
- sync-lockfile.sh: Auto-sync lock file with package.json changes
- install-hooks.sh: Install git pre-commit hooks
- ci-sync-lockfile.sh: CI/CD auto-fix for lock file issues
- Pre-commit hook: Automatically runs on git commit
- validate-lockfile.yml: GitHub Actions workflow for validation

📚 Documentation:
- CONTRIBUTING.md: Complete contribution guide
- scripts/README.md: Automation scripts documentation

🎯 Benefits:
- Prevents "lock file out of sync" CI/CD failures
- Automatic staging of lock file changes
- Zero manual intervention needed
- Works with any workflow (hooks, manual, CI/CD)

🔧 Usage:
1. Install hooks: ./scripts/install-hooks.sh
2. Add dependencies normally
3. Commit - hook auto-syncs lock file
4. CI validates automatically

Resolves the recurring package-lock.json sync issues.
2025-11-25 21:24:14 +00:00
rUv
d6dc474fca feat: Phase 3 - WASM architecture with in-memory storage
Complete architectural implementation for WebAssembly support:

🏗️ **In-Memory Storage Backend:**
- Created storage_memory.rs with DashMap-based storage
- Thread-safe concurrent access
- No file system dependencies
- Full VectorDB API compatibility
- Automatic ID generation
- 6 comprehensive tests

⚙️ **Feature Flag Architecture:**
- storage: File-based (redb + memmap2, not WASM)
- hnsw: HNSW indexing (hnsw_rs, not WASM)
- memory-only: Pure in-memory for WASM
- Conditional compilation by target

🔌 **Storage Layer Abstraction:**
- Dynamic backend selection at compile time
- Clean separation between native/WASM
- Same API across all backends
- Transparent fallback mechanism

📦 **WASM-Compatible Dependencies:**
- Made redb, memmap2, hnsw_rs optional
- Uses FlatIndex for WASM (no HNSW)
- Configured getrandom for wasm_js
- Full JavaScript bindings already present

📊 **Performance Trade-offs:**
- Native: 50K ops/sec, HNSW, 4-5MB binary
- WASM: 1K ops/sec, Flat index, 500KB binary
- Automatic fallback: native → WASM → error

📝 **Documentation:**
- Complete Phase 3 status document
- Architecture explanation
- Performance comparison
- Build instructions
- Future enhancements

🐛 **Known Issues:**
- getrandom version conflicts (0.2 vs 0.3)
- Requires wasm-pack for clean build
- IndexedDB persistence stubbed (future)

Next: Resolve getrandom conflicts and complete WASM build

🤖 Generated with Claude Code
2025-11-21 13:40:34 +00:00