SIH26007HardwareSmart Automation
₹1,50,000 Prize (₹75k Joint)
•
Deadline: 20 September 2026
•
Submitted Ideas: 0/500

Safe and Efficient Operation of Mine Vehicles in Fog and Low-Visibility Conditions in Open Cast Iron Ore Mines.

Ministry / Organization: Ministry of Steel
Department: NMDC
Technical Complexity
8/10
Dataset Accessibility
7/10
36h Hackathon Viability
9/10
Step 0 • Zero-Jargon Layman Summary

“Mine vehicles struggle to operate safely and efficiently in dense fog, causing delays and accidents. We need a smart system to help drivers see better, avoid crashes, and keep operations running smoothly even when visibility is very low.”

The DecodeX PS Decoder™

Deconstructed Problem Blueprint

Step 1

WHAT TO BUILD?

We are asked to build an integrated hardware-software system for heavy mine vehicles (dumpers) and mine infrastructure. This system should provide real-time situational awareness, advanced driver assistance (guidance, collision avoidance), and a centralized monitoring platform for control room operators, specifically designed for extremely low-visibility conditions.

Step 2

WHO IS IT FOR?

The primary beneficiaries are dumper operators (drivers) who face direct safety risks, mine supervisors, and control room personnel responsible for operational efficiency and safety. The solution will be used by NMDC, a major public sector undertaking under the Ministry of Steel, to improve productivity and safety in their open-cast iron ore mines.

Step 3

WHY DOES IT EXIST?

This problem exists because current visibility aids are ineffective in the severe monsoon fog (3-5 meters visibility) experienced in the Bailadila region. This leads to systemic failures like reduced vehicle speeds, operational halts, increased accident risks, and significant production losses for NMDC. The lack of advanced, fog-penetrating sensing and communication infrastructure for mine vehicles and roads is a key infrastructural gap, forcing reliance on human judgment alone which is insufficient and unsafe in such extreme conditions.

Step 4

INPUT → PROCESS → OUTPUT ARCHITECTURE PIPELINE

01 • Inputs & Telemetry

LiDAR point clouds, Radar data (distance, velocity), Thermal camera feeds (heat signatures), GPS/DGPS coordinates (precise location), Inertial Measurement Unit (IMU) data, wheel speed sensor data, V2V/V2I communication signals from other vehicles and roadside units, real-time local weather data (fog density, rainfall), digital mine layout maps, vehicle telemetry (speed, load status).

02 • Processing & AI Core

Multi-modal sensor data fusion for robust environmental perception; AI/ML-based object detection and tracking (vehicles, obstacles, personnel) in low visibility; real-time path planning and guidance generation; predictive collision detection and avoidance algorithms; intuitive situational awareness generation for operators; secure V2V/V2I communication protocols; AI/ML analytics for operational optimization and anomaly detection; Digital Twin synchronization for real-time mine environment updates; data logging and analytics for performance monitoring.

03 • Actionable Deliverables

In-cabin augmented reality display for operators (3D map of surroundings, obstacle overlays, guidance cues, speed recommendations); audible and haptic collision/proximity alerts; centralized control room dashboard (real-time vehicle tracking, status, fog overlays, incident alerts, productivity metrics); automated operational efficiency and safety reports; SMS/push notifications for critical events; potential automated emergency braking or speed limiting (driver-assistance features).

Step 5

CONSTRAINTS

  • Must operate reliably in extreme environmental conditions (dense fog, heavy rain, dust, high humidity, vibrations, temperature variations).
  • Real-time performance with ultra-low latency for safety-critical perception and alerts.
  • High precision for localization (DGPS) and object detection (sub-meter accuracy).
  • Hardware must be ruggedized (IP67/IP68) and energy-efficient for on-vehicle deployment.
  • Scalable solution for large fleets and multiple mine sites.
  • Robust communication (V2V/V2I) with resilience to intermittent network connectivity (edge processing required).
  • Cost-effective for large-scale deployment by NMDC.
  • Intuitive and low-distraction user interface for dumper operators.
  • Adherence to mining safety standards and regulations.
Step 6

JURY METRICS

  • Percentage reduction in haul cycle time during foggy conditions.
  • Percentage reduction in operational halts and slowdowns due to low visibility.
  • Percentage reduction in collision risks and operational accidents.
  • Improvement in fleet utilization and continuity of operations during monsoon.
  • Accuracy (precision, recall, F1-score) of object detection and tracking in dense fog.
  • False alarm rate for collision warnings.
  • End-to-end system latency (sensor input to operator alert/display update).
  • Mean Time Between Failures (MTBF) for hardware components.
  • Cost per vehicle for solution deployment and maintenance.
  • Operator feedback and satisfaction score for the in-cabin system.
Step 7

CORE BOTTLENECK

The single hardest engineering challenge is achieving robust, real-time environmental perception and accurate object differentiation (vehicles, personnel, small obstacles) in *extremely* dense fog (3-5 meters visibility). This requires sophisticated multi-modal sensor fusion that can reliably overcome the limitations of individual sensors (e.g., LiDAR scattering, radar clutter, thermal ambiguities) under dynamic, harsh, and unpredictable mine conditions, while maintaining ultra-low false alarm rates for safety-critical functions.

Why You Should Choose This PS (Pros)

  • High social impact: Directly enhances safety for mine workers, potentially saving lives and preventing injuries.
  • Clear economic impact: Addresses significant production losses and operational inefficiencies for a major PSU (NMDC).
  • Strong 'wow' factor: Involves cutting-edge autonomous/driver-assistance technologies in a challenging industrial environment.
  • Hardware category: Appeals to teams with expertise in robotics, embedded systems, and IoT.
  • Scalability potential: Solution can be replicated across other open-cast mines in India and globally.
  • Direct industry problem: NMDC is a direct stakeholder, indicating strong potential for real-world implementation and support.

Challenges & Risks to Watch (Cons)

  • Expensive hardware requirement: LiDAR, Radar, and Thermal cameras are costly, making full-scale prototyping difficult for hackathon teams.
  • Complex system integration: Integrating diverse sensor types, communication protocols, and software stacks is highly challenging.
  • Harsh environment testing: Difficult to simulate or test in realistic mine conditions during a hackathon timeframe.
  • Safety-critical system: Requires extremely high reliability and rigorous validation, which is hard to demonstrate in a short period.
  • Data scarcity: Real-world low-visibility mine data is proprietary; teams will need to rely on synthetic data or adapt public datasets.
  • Power constraints: Integrating new hardware into HEMM vehicles requires careful consideration of power consumption and vehicle electrical systems.
Hackathon Blueprint

Recommended Tech Stack & Grand Finale Features

Frontend & Mobile
Qt/QML (for embedded in-cabin display, C++ backend for performance)Flutter (for cross-platform control room dashboard and mobile alerts)React/Next.js (for web-based, rich UI control room dashboard)
Backend & APIs
C++ (for performance-critical on-vehicle perception and sensor fusion, leveraging ROS/ROS2 framework)Python (for AI/ML inference, data logging, and higher-level logic on vehicle)FastAPI (Python, for centralized API services and real-time data processing)Node.js (for real-time communication via WebSockets for control room updates)
AI / ML & Models
YOLOv8/v9/v10 (for object detection on thermal/visible light, adapted for point clouds)PointNet/PointRCNN (for 3D object detection on LiDAR point clouds)Kalman Filters/Extended Kalman Filters (EKF)/Unscented Kalman Filters (UKF) for sensor fusion and object trackingDeep learning-based sensor fusion networks (e.g., TransFusion, PointPillars)Semantic Segmentation models (e.g., U-Net, DeepLabV3+) for road/terrain classification using LiDAR intensity or thermal data
Database & Cloud
InfluxDB (for time-series sensor data and vehicle telemetry)PostgreSQL + PostGIS (for spatial data like mine maps, vehicle locations, and geofencing)MongoDB (for flexible storage of logs, configuration, and non-time-series data)SQLite (for robust on-vehicle local data logging and configuration)

Killer Features to Impress the SIH Jury

Multi-Modal Adaptive Sensor Fusion: A system that intelligently and dynamically weights inputs from LiDAR, Radar, and Thermal cameras based on real-time fog density and environmental conditions, ensuring the most reliable perception in varying visibility.
Augmented Reality 'Super-Vision' Display: An in-cabin display that overlays processed sensor data (e.g., thermal outlines of vehicles, LiDAR-derived road edges, predicted paths) directly onto a live (or simulated) camera feed, giving the operator an intuitive 'X-ray vision' through the fog.
Predictive Collision Avoidance with 'Ghost' Tracking: Not just detecting current obstacles, but predicting future paths of obscured vehicles and potential collision points using V2V data and historical movement patterns, displaying 'ghost' outlines of hidden threats to the operator.
Digital Twin Integration with Real-time Anomaly Detection: A comprehensive digital twin of the mine, updated in real-time, that can simulate potential hazards, identify deviations from optimal paths, and flag unusual vehicle behavior or environmental changes to the control room, enabling proactive decision-making.
View Official SIH 2026 Portal Raw Text
▼
BACKGROUND

NMDC Limited is India’s largest Iron Ore producer, currently producing approximately 53 Million Tonnes Per Annum (MTPA) from its three fully mechanized mining complexes, namely BIOM-Kirandul Complex, BIOM-Bacheli Complex in Chhattisgarh, and Donimalai Complex in Karnataka. The Bailadila Region alone contributes nearly 37 MTPA of Iron Ore production. In line with the National Steel Policy, NMDC has set a target of achieving 100 MT production capacity by 2030, with approximately 80 MT expected from the Bailadila Sector.

The Bailadila mining region experiences severe monsoon conditions from June to October, including heavy rainfall, strong winds, high humidity, dense clouds, and thick fog. During this period, visibility on mine haul roads, particularly in hilltop mining areas, often reduces to as low as 3–5 meters. These conditions significantly affect the safe and efficient movement of Heavy Earth Moving Machinery (HEMM), especially dumpers engaged in ore transportation.

PROBLEM DESCRIPTION

Dense fog and extremely low visibility during the monsoon season create major operational and safety challenges in the Bailadila iron ore mines. Poor visibility restricts dumper movement, forcing operators to reduce speed or temporarily halt operations to avoid accidents and unsafe conditions.This results in increased haul cycle times, reduced fleet productivity, lower ore evacuation, and production losses. The risk of vehicle collision, road accidents, and operational disruptions also increases substantially during such conditions. Existing visibility aids and operational controls have limited effectiveness in dense fog environments.There is a need for an intelligent, reliable, and technology-driven solution that can enable safe and efficient movement of mine vehicles under low-visibility conditions while ensuring continuity of operations and maintaining production levels.

EXPECTED SOLUTION

The proposed solution should improve operator situational awareness, assist in vehicle guidance and collision avoidance, and support real-time monitoring and decision-making for safe haul road operations during adverse weather conditions.

The solution may leverage technologies such as:

•AI/ML-based analytics
•Computer vision and thermal imaging
•LiDAR and radar-based sensing
•GPS/DGPS-based vehicle tracking
•Vehicle-to-Vehicle (V2V) and Vehicle-to-Infrastructure (V2I) communication
•Autonomous or driver-assistance systems
•IoT-enabled monitoring systems
•Centralized command and control platforms
•Digital Twin-based operational monitoring Expected Outcomes
•Improved safety of dumper operations during foggy conditions
•Reduction in collision risks and operational accidents
•Improved haulage efficiency and reduced cycle times
•Enhanced fleet utilization and continuity of mining operations during monsoon
•Reduction in production losses caused by low visibility
•Real-time monitoring and decision support for operators and control rooms
•Scalable and deployable solution for large-scale mechanized open cast mines