SIH26047SoftwareMedTech / BioTech / HealthTech
₹1,50,000 Prize (₹75k Joint)
•
Deadline: 20 September 2026
•
Submitted Ideas: 0/500

Patient Case-Taking Software

Ministry / Organization: Ministry of Ayush
Department: All India Institute of Ayurveda
Technical Complexity
8/10
Dataset Accessibility
7/10
36h Hackathon Viability
9/10
Step 0 • Zero-Jargon Layman Summary

“Indian government hospitals are overcrowded, giving doctors only 2 to 5 minutes per patient, which leads to rushed medical history collection. This software creates a self-service digital kiosk where patients can speak or tap out their symptoms in their native language and scan old medical papers before seeing a doctor, saving valuable time.”

The DecodeX PS Decoder™

Deconstructed Problem Blueprint

Step 1

WHAT TO BUILD?

An AI-powered patient-facing medical history and document digitization kiosk software platform (MediKiosk) that integrates with hospital information systems and the Ayushman Bharat Digital Mission (ABDM).

Step 2

WHO IS IT FOR?

Primary beneficiaries are patients in overburdened public hospitals and All India Institute of Ayurveda (Ayush) institutions. Users include patients (low-literacy, elderly, and general public) and doctors/triage nurses.

Step 3

WHY DOES IT EXIST?

Extreme patient-to-doctor ratios in public hospitals force consultations down to 2-5 minutes, leading to incomplete medical histories, missed comorbidities, and severe documentation fragmentation across unstructured paper records.

Step 4

INPUT → PROCESS → OUTPUT ARCHITECTURE PIPELINE

01 • Inputs & Telemetry

Patient voice speech in regional Indian languages, touch-screen interactions, ABHA ID or Aadhaar details, physical/scanned medical prescriptions, lab reports, and discharge summaries.

02 • Processing & AI Core

ASR transcription, NLP dialogue management using clinical ontologies, OCR for multilingual/handwritten documents, clinical entity extraction, chronology ordering, AI summarization into standard medical formats (including Dashavidha Pariksha for Ayush), and ABDM/FHIR compliant data packaging.

03 • Actionable Deliverables

A structured, physician-ready clinical history summary displayed on the doctor's consultation screen, priority red-flag alerts for emergency triage, and synced records in the patient's ABHA / hospital HIS ecosystem.

Step 5

CONSTRAINTS

  • Must handle noisy hospital environments for accurate speech recognition across multiple Indian accents and regional languages.
  • Must be extremely intuitive for elderly and low-literacy users with zero tech background.
  • Strict compliance with Digital Personal Data Protection (DPDP) Act 2023 and ABDM consent/security frameworks.
  • Must support specialized Ayurvedic medical parameters (Dashavidha Pariksha) alongside modern allopathic history frameworks.
Step 6

JURY METRICS

  • End-to-end patient session completion time under 3 minutes.
  • ASR Word Error Rate (WER) and OCR extraction accuracy for handwritten prescriptions.
  • Physician satisfaction score regarding the relevance and conciseness of the generated clinical summary.
  • Seamlessness of ABDM FHIR API integration and consent verification latency.
Step 7

CORE BOTTLENECK

Building an accurate, robust OCR and entity-extraction pipeline for messy, multilingual, handwritten Indian medical prescriptions combined with real-time conversational ASR in noisy kiosk environments.

Why You Should Choose This PS (Pros)

  • Extremely high social impact addressing a massive, visible national healthcare bottleneck in public and Ayush hospitals.
  • Clear alignment with national digital health initiatives (ABDM, ABHA ecosystem).
  • Great 'wow factor' for a Grand Finale demo by showcasing live multilingual voice-to-structured-clinical-summary conversion.

Challenges & Risks to Watch (Cons)

  • High integration complexity with legacy Hospital Information Systems (HIS).
  • Handling edge cases in vernacular dialects and medical terminology mapping can be unpredictable during live judging.
  • Strict data privacy regulations require robust local session handling and tokenized consent.
Hackathon Blueprint

Recommended Tech Stack & Grand Finale Features

Frontend & Mobile
React.js / Next.js (for web-based kiosk touch interface)Flutter (optional cross-platform tablet/mobile version)
Backend & APIs
FastAPI (Python-based high-performance asynchronous API for AI/ML pipelines)Node.js
AI / ML & Models
Bhashini / AI4Bharat IndicWhisper (for multilingual ASR)PaddleOCR or fine-tuned LayoutLMv3 (for handwritten/printed medical document OCR)Llama-3 or Mistral fine-tuned with clinical guidelines (for dialogue management and summarization)
Database & Cloud
PostgreSQL (relational data)Redis (session management and temporary data caching)MinIO / AWS S3 (secure encrypted storage for scanned medical documents)

Killer Features to Impress the SIH Jury

Dual-Mode Adaptive Interface: Seamlessly switch between voice conversation and large icon-driven touch inputs for non-tech-savvy users.
Ayush & Allopathy Dual-Engine: Automatically switches clinical ontology between standard SOAP/SOCRATES format and Ayurvedic Dashavidha Pariksha based on the selected OPD department.
Instant Emergency Red-Flag Interceptor: Real-time keyword and symptom analysis that flags cardiac or stroke symptoms, instantly overriding the queue and alerting triage nurses.
Smart Document Chronology Timeline: Automatically ingests messy paper uploads, extracts values, normalizes units, and plots a chronological graph of past treatments and lab results for the doctor.
View Official SIH 2026 Portal Raw Text
▼
BACKGROUND

1.1 The Clinical History-Taking Bottleneck in Indian Hospitals History taking — the structured elicitation of a patient's presenting complaints, history of present illness, past medical and surgical history, drug and allergy history, family and personal history, and a review of systems — is the single most important diagnostic activity in clinical medicine. Classical teaching holds that a well-conducted history yields the correct diagnosis in 70–80% of cases, even before examination or investigation. Yet in India's overburdened public hospital outpatient departments (OPDs), the time available for this critical interaction has collapsed to unsustainable levels.

India operates one of the most patient-dense healthcare systems in the world. Tertiary government hospitals and apex institutions routinely register 4,000–10,000 OPD patients per day, with a doctor-to-patient consultation time frequently reported between 2 and 5 minutes — among the shortest globally (study published in BMJ Open, 2017, across 67 countries placed India's average primary-care consultation at just over 2 minutes). Within this window, the physician must simultaneously elicit history, examine the patient, review prior records, formulate a diagnosis, counsel, and prescribe. The result is systematic under-elicitation of history, missed comorbidities, repeated questioning across visits, and diagnostic error.

AYUSH institutions face an additional layer of complexity. Ayurvedic history taking (Trividha, Ashtavidha, and Dashavidha Pariksha) requires detailed assessment of Prakriti (constitution), Vikriti (current imbalance), Agni (digestive capacity), Koshtha (bowel nature), Ahara-Vihara (diet and lifestyle), Nidana (causative factors), and Samprapti (pathogenesis) — a far more extensive history framework than allopathic intake. Capturing this depth manually within OPD time constraints is effectively impossible, forcing practitioners to abbreviate the very assessment that defines personalized Ayurvedic care.

1.2 The Documentation and Records Fragmentation Problem Compounding the time problem is the fragmentation of patient records. Patients in India typically carry physical paper prescriptions, laboratory reports, discharge summaries, and imaging films from multiple prior providers. During consultation, the physician must manually scan through these unstructured documents — often handwritten, in varying languages, and chronologically disordered — consuming a significant fraction of the already-scarce consultation time. There is no point-of-entry mechanism to digitize, structure, and chronologically organize a patient's prior medical documents before they reach the consultation room.

The Ayushman Bharat Digital Mission (ABDM) has established the national digital health infrastructure — ABHA (Ayushman Bharat Health Account) IDs, the Health Information Exchange, and FHIR-based interoperability standards. However, the 'first-mile' problem remains unsolved: there is no efficient, patient-facing software platform that captures structured history and digitizes documents into the ABDM ecosystem before the clinical encounter begins.

1.3 The Opportunity: AI-Powered Digital Clinical Intake Platform Self-service kiosks have transformed high-throughput service industries — ATMs in banking, self-check-in terminals in aviation, and ordering kiosks in quick-service restaurants — by offloading structured data-entry tasks from human staff to the user, dramatically improving throughput and accuracy. In healthcare, patient check-in kiosks are now widespread in developed-country hospitals, but these are limited to administrative check-in. None perform deep, AI-driven, multimodal clinical history acquisition with medical document digitization.

The convergence of mature enabling technologies — robust automatic speech recognition (ASR) for Indian languages and accents (Bhashini / AI4Bharat models), large language models for conversational clinical history elicitation, high-accuracy OCR for handwritten and printed medical documents, and ABDM's FHIR interoperability — now makes it feasible to build an AI-powered clinical history software platform.

DESCRIPTION

2.1 The Problem in Precise Terms There is no purpose-built, patient-facing software platform that enables patients to independently and comprehensively record their medical history — through both natural spoken conversation and guided touchscreen interaction — and simultaneously digitize their existing physical medical documents, generating a structured, physician-ready clinical history summary that integrates with the hospital information system and the ABDM ecosystem before the patient enters the consultation room.

2.2 Why Existing Solutions Fall Short

•Existing hospital registration systems (currently deployed in some Indian hospitals) capture only demographic and appointment data — name, age, department, token number. They do not elicit any clinical history or process medical documents.
•Mobile health apps and tele-triage chatbots require smartphone literacy, stable connectivity, and patient enrolment ahead of the visit — excluding the large elderly, rural, low-literacy, and first-visit patient populations who form the bulk of government hospital OPD load.
•Manual nurse-led triage / history desks are themselves human-resource-limited, do not scale to 5,000+ daily patients, and reintroduce the same time and transcription bottleneck the system is trying to eliminate.
•Generic document scanners digitize images but do not extract, structure, or chronologically organize clinical content, nor link it to a structured history or ABHA record.

2.3 Specific Challenges a Solution Must Overcome

•Multilingual, multi-accent voice capture in noisy hospital environments across Hindi, English, and major regional languages, for patients of varying literacy and digital comfort.
•Accessibility for low-literacy and elderly users through intuitive icon-driven UI, audio prompts, and conversational guidance — the software platform must be usable by a first-time, non-tech-savvy patient with zero training.
•Accurate clinical history structuring converting free-form patient narration into a standardized, physician-readable history (chief complaint, HPI, past history, drug/allergy, family, personal, review of systems) — and, for AYUSH settings, Dashavidha Pariksha parameters.
•Reliable medical document digitization OCR of handwritten and printed prescriptions, lab reports, and discharge summaries in multiple languages, with intelligent extraction of diagnoses, medications, and investigation values.
•Privacy, consent, and data security compliance with the Digital Personal Data Protection Act 2023 and ABDM consent framework — handling sensitive health data within a secure software environment.
EXPECTED SOLUTION

3.1 Solution Overview — 'MediKiosk' AI Clinical History Software Platform The proposed solution — tentatively designated MediKiosk — a software platform for an AI-powered clinical history software platform that allows any patient to record a comprehensive medical history through natural voice conversation and guided touchscreen interaction, scan and digitize their existing physical medical documents, and generate a structured, physician-ready clinical history summary that is pushed to the hospital information system (HIS) and linked to the patient's ABHA record — all completed before the consultation, with minimal staff assistance required.

•Insert Table*3.2 3.3 Software & AI Stack (Integrated)

Module A — Conversational Multimodal History Engine A conversational AI engine that conducts a structured clinical history interview through both voice and touch. The patient speaks naturally in their preferred language; the engine asks intelligent follow-up questions (e.g., on stating 'chest pain', it probes onset, character, radiation, aggravating/relieving factors — the SOCRATES framework) and simultaneously offers touch-based multiple-choice options for patients who prefer tapping. Built on Indian-language ASR, a dialogue manager constrained by a clinical history ontology, and text-to-speech for audio prompts.

•Adaptive questioning: dynamically branches based on chief complaint and prior answers, mirroring a physician's clinical reasoning to elicit a complete HPI and review of systems
•Dual-mode input: every question answerable by speaking OR tapping, ensuring usability across literacy and comfort levels
•AYUSH history mode: for Ayurvedic OPDs, an extended interview capturing Dashavidha Pariksha (Prakriti, Vikriti, Sara, Samhanana, Pramana, Satmya, Sattva, Ahara Shakti, Vyayama Shakti, Vaya) and Ahara-Vihara assessment
•Red-flag detection: AI flags emergency symptoms (e.g., acute chest pain with dyspnoea, stroke symptoms) and triggers immediate priority alert to triage staff rather than routine queueing Module B — Medical Document Digitization & Intelligence An integrated scanning and document-AI pipeline that allows the patient to upload prior prescriptions, lab reports, and discharge summaries. The system performs high-accuracy OCR (printed and handwritten, multilingual), then extract and structure clinical entities.
•Intelligent extraction: diagnoses, prescribed medications with dosages, investigation results with values and reference ranges, and procedure/surgery history
•Chronological organization: automatically dates and orders documents into a coherent medical timeline for the physician
•Abnormal-value highlighting: flags out-of-range lab values and potential drug interactions for physician attention Module C — Structured History Summary Generator An AI summarization engine that synthesizes the conversational history and the digitized documents into a single, concise, physician-ready clinical summary in standard format — presented on the consultation screen the moment the patient enters the room. The physician reads a complete, structured history in seconds rather than spending minutes eliciting it, and can edit/confirm before saving.
•Standard clinical format: Chief complaint ? HPI ? Past medical/surgical ? Drug & allergy ? Family ? Personal ? ROS ? Prior investigations summary
•Editable & verifiable: physician retains full control — the summary is a draft to accept, amend, or reject, never an autonomous diagnosis
•Bilingual output: patient-facing audio confirmation in local language; physician-facing summary in English/Hindi Module D — Consent, Privacy & ABDM Integration A robust consent and security layer compliant with the Digital Personal Data Protection Act 2023 and the ABDM consent framework. The patient authenticates via ABHA ID, grants explicit consent for data capture and sharing, and the structured history is pushed to the hospital HIS/EMR and linked to the ABHA Personal Health Record via FHIR APIs.
•Secure processing: voice and document AI are processed securely within the software platform
•Session termination: temporary session data is cleared immediately after submission
•Consent-first design: granular, revocable consent with audio explanation for low-literacy patients 3.4 End-to-End Patient Journey
•Step 1 — Identify: Patient logs into the software platform, enters/scans ABHA ID or Aadhaar details or registers as new; selects language; grants consent (audio-guided)
•Step 2 — Converse: AI conducts adaptive voice + touch history interview, capturing chief complaint, HPI, and full history; red flags trigger priority triage
•Step 3 — Scan: Patient uploads prior prescriptions, lab reports, and discharge summaries; AI digitizes, structures, and timelines them
•Step 4 — Summarize & Route: AI generates structured history summary, links to ABHA, pushes to HIS, updates the patient's digital record; summary appears on physician's screen at consultation
•Step 5 — Consult: Physician reviews complete history in seconds, edits/confirms, and devotes the full consultation to examination, reasoning, and counselling