mirror of
https://github.com/saymrwulf/KnowledgeRefinery.git
synced 2026-06-11 00:28:59 +00:00
38a99476d6
macOS app for corpus ingestion, semantic search, and concept universe visualization powered by local LLMs via LM Studio. Architecture: - Go daemon (17MB single binary, zero dependencies) - chi router, pure-Go SQLite, tiktoken tokenizer - 6-stage pipeline: scan → extract → chunk → embed → annotate → conceptualize - Brute-force cosine vector search in memory - 89 tests across 8 packages - SwiftUI app (macOS 15+) - Multi-workspace management with auto-start daemons - Live pipeline progress, search, concept browser - WebGPU 3D universe renderer with Canvas2D fallback - Custom crystal app icon
15 lines
560 B
Markdown
15 lines
560 B
Markdown
# Canonical Data Model
|
|
|
|
See [../../docs/data-model.md](../../docs/data-model.md) for the full data model documentation.
|
|
|
|
## Pipeline Version Tracking
|
|
|
|
Every derived artifact stores:
|
|
- `pipeline_version` - Overall pipeline version (e.g., "v1.0")
|
|
- `model_id` - LM Studio model used (for annotations/concepts)
|
|
- `prompt_id` + `prompt_version` - Prompt template version (for annotations)
|
|
|
|
This enables:
|
|
- Re-running with updated models/prompts without losing previous results
|
|
- A/B comparison of different model outputs
|
|
- Audit trail of how insights were derived
|