marmar-context / web / context / demo-patients / VALIDATION.md
VALIDATION.md
Raw

Validation notes

All inputs are fictional. These are software demonstration checks, not clinical validation.

Separate source records

Case Passed Model calls Model extraction time
mariam-showcase True 1 4300 ms
eric-family-history True 1 5105 ms
asha-reconciliation True 1 3779 ms

Checks covered exact source quotes, required and prohibited facts, review gates, acknowledgement, reconciliation, expected rule findings, evidence export and rejection of changed sources.

The original Asha extraction deliberately withholds ambiguous Amlodipine. The recording guide supplies a fictional verification basis for adding its clarification. Live validation of the original three-record case resolved the Metformin conflict by excluding the outdated 500 mg entry; it did not treat the ambiguous Amlodipine as usable medication data.

Exact single-upload files

3/3 passed against the hosted live model on 25 October 2026, with three fresh provider calls. The complete TXT files, including their synthetic-data label, were used as the source text. Mariam was explicitly checked for both the renal and Penicillin-allergy rule. Eric was checked for absence of the mother's allergy, Warfarin and eGFR. Asha was blocked on conflicting strengths, then completed after the outdated 500 mg fact was excluded.

All 12 TXT files meet the app's 12,000-character / 48,000-byte import limits. Model wording and timing can vary; review the evidence each time.