Commit graph

3 commits

Author SHA1 Message Date
rUv
58f620ca28 fix(training): use 3600s timeout for GPU Cloud Run jobs
GPU-enabled Cloud Run jobs have a maximum timeout of 1 hour.
The previous 7200s (2hr) setting was rejected by the API.

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-03-28 12:21:58 +00:00
rUv
737b18e772 feat: add nightly continuous learning pipeline (ADR-129)
- nightly_train.sh: 5-phase nightly pipeline (export brain learnings,
  contamination check, incremental LoRA, release gates, push to HF)
- Updated deploy_training.sh with nightly Cloud Run job + scheduler
- Updated ADR-129 with nightly continuous learning section

Schedule: daily 03:00 UTC, ~$4/day, skips if <10 new records.
All 7 release gates must pass before publishing.

Ref: #310

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-03-28 02:30:25 +00:00
rUv
f12e6c1584 feat: implement ADR-129 training pipeline and TurboQuant sidecar infra
Training tooling:
- release_gate.py: Automated 7-gate ship/no-ship checker (G1-G7)
- export_training_data.py: Dataset export with governance (schema,
  dedup, quality scoring, contamination check)
- contamination_check.py: 13-gram eval contamination detection
- run_calibration.py: Phase 1 imatrix + TurboQuant profiling
- run_sft.py: Phase 2 LoRA SFT + DPO training
- deploy_training.sh: Cloud Run job creation + Vertex AI setup
- Dockerfile: GPU training image (transformers + peft + trl)

Rust infrastructure:
- turboquant_profile.rs: .turboquant.json sidecar config loading,
  per-layer TQ config discovery, default profiles

Ref: ADR-129, #310

Co-Authored-By: claude-flow <ruv@ruv.net>
2026-03-28 02:27:32 +00:00