Sangeetha-Grantha

Metadata	Value
Status	Active
Version	1.0.0
Last Updated	2026-09-10
Author	Sangita Grantha Architect
Document Type	Evidence record

Implementation Summary: Sourcing Infrastructure & Backend API (TRACK-045)

---

[!NOTE] Historical evidence: results, counts, commands, and observations below belong to the original work described here. The editorial update date is not a new test or corpus verification. For present behavior, use current quality checks.

Purpose

This changeset implements the foundational database tables, DAL repositories, and Ktor REST API endpoints required for the Multi-Source Sourcing & Extraction Monitoring system. It enables tracking the provenance of composition data through source evidence and manages the database-backed extraction queue.

Changes

Database (Migrations)

• database/migrations/28__extraction_ingested_status.sql: Added INGESTED status to the extraction queue to track downstream processing completion.
• database/migrations/29__extraction_variant_support.sql: Added support for language variants, extraction intents (PRIMARY/ENRICH), and related extraction IDs.
• database/migrations/30__fix_entity_resolution_cache_schema.sql: Added updated_at column to the resolution cache.

DAL (Data Access Layer)

• modules/backend/dal/.../tables/SourcingTables.kt: Defined Exposed tables for ExtractionQueue, KrithiSourceEvidence, StructuralVoteLog, and VariantMatch.
• modules/backend/dal/.../repositories/ExtractionQueueRepository.kt: CRUD operations for the polling queue.
• modules/backend/dal/.../repositories/SourceEvidenceRepository.kt: Manages composition provenance records.
• modules/backend/dal/.../repositories/SourceRegistryRepository.kt: CRUD for authoritative sources.
• modules/backend/dal/.../repositories/StructuralVotingRepository.kt: Logic for multi-source structure consensus.
• modules/backend/dal/.../repositories/VariantMatchRepository.kt: Tracking matches between language variants.
• modules/backend/dal/.../repositories/QualityDashboardRepository.kt: Aggregation queries for quality KPIs.

API & Services

• modules/backend/api/.../routes/SourcingRoutes.kt: 25+ endpoints for Source Registry, Extraction Monitoring, and Quality metrics.
• modules/backend/api/.../services/SourcingService.kt: Orchestration logic for sourcing entities with audit logging.
• modules/backend/api/.../services/ExtractionResultProcessor.kt: Worker service that polls DONE extraction tasks and ingests them into Krithis.
• modules/backend/api/.../services/ExtractionWorker.kt: Periodic job for queue processing.
• modules/backend/api/.../routes/RemediationRoutes.kt: Endpoints for bulk data cleanup and audit runs.
• modules/backend/api/.../services/RemediationService.kt: Logic for merging duplicates and structural alignment.
• modules/backend/api/.../services/AuditRunnerService.kt: Background task for identifying data quality gaps.

Shared Domain

• modules/shared/domain/.../model/SourcingDtos.kt: Serializable DTOs for all sourcing entities.

Verification Results

• API Tests: Verified all endpoints return correct status codes and payloads.
• Audit Logs: Mutation actions (Create/Update Source) correctly trigger audit entries.
• Queue Flow: Verified PENDING -> DONE -> INGESTED transition cycle.

Commit Reference

Ref: application_documentation/07-quality/track-045-sourcing-infrastructure-implementation.md

---

Section index · Documentation home · Feature status