AR-Based Vocational Training Simulator for Industrial Safety in Jharkhand's Mining & Manufacturing Sector
“We need to build a mobile app that uses Augmented Reality on regular Android phones to teach safety rules to young industrial workers in Jharkhand. The app will simulate dangers like fires or gas leaks right through the phone camera and will support regional languages like Hindi and Santali. It will also track who passes the training and issue verifiable digital certificates using QR codes.”
Deconstructed Problem Blueprint
WHAT TO BUILD?
An offline-first Android mobile application featuring markerless AR training simulations, localized voice/text guidance, interactive safety quizzes, secure QR-based certification, and a web-based administrative dashboard for factory/mine compliance management.
WHO IS IT FOR?
Primary beneficiaries are young tribal recruits, contract workers, and miners in Jharkhand. End users are workers undergoing safety drills. System administrators include safety officers, factory owners, and officials from DGMS (Directorate General of Mines Safety) and the Department of Higher & Technical Education, Jharkhand.
WHY DOES IT EXIST?
Traditional classroom training has poor retention rates below 20%, physical live drills disrupt industrial operations, and VR headsets are too expensive for small-scale mines. Furthermore, standard training lacks regional language support and fails to verify if workers actually understood the safety protocols.
INPUT → PROCESS → OUTPUT ARCHITECTURE PIPELINE
Smartphone camera feed, user touch gestures/interactions, offline question bank responses, worker identity details (Name, Aadhaar ID/Worker ID), and localized audio/text assets.
Plane detection and surface tracking using ARCore/AR Foundation, rendering 3D safety simulation overlays (fire, smoke, gas zones) onto the camera stream, evaluating safety decision logic via an in-app assessment engine, and generating cryptographically signed verification tokens.
Interactive AR simulation overlays, real-time audio guidance in Hindi/Santali, immediate pass/fail assessment scorecards, unique verifiable digital certificates with QR codes, and compliance metrics synced to the web admin dashboard.
CONSTRAINTS
- Must run smoothly on mid-range Android smartphones running Android 10+ without requiring external VR/AR hardware.
- Must be completely functional offline since remote mines and manufacturing plants lack reliable internet connectivity.
- Must support regional languages, specifically Hindi and Santali, through localized UI and audio prompts.
- AR tracking must remain stable in low-light, dusty, or underground industrial environments.
JURY METRICS
- AR tracking stability and frame rate (maintaining 30+ FPS on mid-range devices)
- Comprehension retention accuracy and assessment score tracking
- Sync efficiency and data integrity during offline-to-online transitions
- UX simplicity and accessibility for low-literacy or first-time smartphone users
CORE BOTTLENECK
Achieving stable markerless AR tracking and rendering 3D simulation effects (like fire and gas plumes) smoothly on budget or mid-range Android devices without causing heavy battery drain or app crashes.
Why You Should Choose This PS (Pros)
- Extremely high social impact addressing a critical state-level safety crisis in Jharkhand's mining sector.
- Clear, tangible deliverables requested by the government department making it easy to scope for a hackathon.
- Strong 'wow factor' during live judging when projecting 3D interactive hazards through a mobile phone camera.
- Direct alignment with national digital governance and safety compliance mandates.
Challenges & Risks to Watch (Cons)
- Developing 3D assets and AR simulation logic within a tight hackathon timeframe can be resource-heavy.
- Translating complex technical safety manuals accurately into Santali requires specialized linguistic validation.
- Managing device fragmentation across various mid-range Android chipsets can introduce unexpected AR rendering bugs.
Recommended Tech Stack & Grand Finale Features
Killer Features to Impress the SIH Jury
View Official SIH 2026 Portal Raw Text▼
Jharkhand is lndia's leading mineral-producing state, with coal mines, steel plants, and mica processing units employing hundreds of thousands of workers many of them young tribal recruits with no prior industrial exposure. Classroom-based safety training using static manuals has documented retention rates below 20% after one week. Live drills are operationally disruptive, and VR headset simulators are inaccessible to small-scale mines and contract workers.. The DGMS, Dhanbad, recorded 48 fatal mine accidents in Jharkhand in 2022-23, a large share involving workers with under 30 days of orientation. The Factories Act, 1948 and Mines Act, 1952 mandate periodic safety certification, yet no standardised digital training platform exists in regional languages, and physical certificates have no mechanism to verify comprehension.
Design and develop a mobile AR-based vocational training and safety certification platform running on mid-range Android smartphones (Android 10+, no external headset required), accessible to workers across Jharkhand's mining, steel, and mica sectors. The platform must deliver interactive AR training modules covering five industrial safety domains: (l) Fire & Explosion Response-exit identification, extinguisher use, and evacuation sequencing overlaid on real surroundings via phone camera; (2) Gas Leak & Confined Space Protocol-hazard zone recognition, PPE selection, and buddy-system procedures simulated in AR; (3) Machinery.
A working Android APK demonstrating at least two complete AR training modules, an assessment engine, QR-based certificate generation and verification, Hindi and Santali localisation, offline functionality, and a web admin compliance dashboard- submitted with a demo video and public GitHub repository.