Ortho-Fuse

Orthomosaic Generation for Sparse High-Resolution AI-driven Health Maps through Optical Flow Estimation

Authors

Rugved Katole, Christopher Stewart

Links

Paper | Code | Dataset

Abstract

AI-driven crop health mapping systems offer substantial advantages over conventional monitoring approaches through accelerated data acquisition and cost reduction. However, widespread farmer adoption remains constrained by technical limitations in orthomosaic generation from sparse aerial imagery datasets. Traditional photogrammetric reconstruction requires 70-80% inter-image overlap to establish sufficient feature correspondences for accurate geometric registration. AI-driven systems operating under resource-constrained conditions cannot consistently achieve these overlap thresholds, resulting in degraded reconstruction quality that undermines user confidence in autonomous monitoring technologies.

In this paper we present Ortho-Fuse, an optical flow-based framework that enables reliable orthomosaic generation with reduced overlap requirements. Our approach employs intermediate flow estimation to synthesize transitional imagery between consecutive aerial frames, artificially augmenting feature correspondences for improved geometric reconstruction. Experimental validation demonstrates a 20% reduction in minimum overlap requirements. We further analyze adoption barriers in precision agriculture to identify pathways for enhanced integration of AI-driven monitoring systems.

RIFE Pipeline Architecture

RIFE Pipeline: Real-time Intermediate Flow Estimation for synthetic frame generation

Approach

Our approach leverages the Real-time Intermediate Flow Estimation (RIFE) model to generate synthetic intermediate frames between consecutive aerial images. This process artificially increases the effective overlap between images, enabling standard orthomosaic reconstruction pipelines to operate successfully with reduced initial overlap requirements.

The framework consists of four key components: (1) Optical Flow Estimation using RIFE for synthetic frame generation, (2) Feature Enhancement to augment correspondences between sparse images, (3) Hybrid Reconstruction combining original and synthetic images, and (4) Quality Preservation maintaining visual fidelity essential for agricultural analysis.

Ortho-Fuse Framework Overview

Framework Overview: Ortho-Fuse optical flow-based orthomosaic generation

Results

Experimental validation demonstrates superior reconstruction quality with our hybrid approach. The Ground Sample Distance (GSD) improved from 1.55cm (original) to 1.47cm (hybrid), while maintaining analytical accuracy for crop health assessment through NDVI analysis. Our method achieves a 20% reduction in minimum overlap requirements while preserving the visual reliability essential for farmer adoption.

Orthomosaic Quality Comparison

Comparative orthomosaic quality: (a) Original 50% overlap, (b) Synthetic frames only, (c) Hybrid approach

NDVI Health Map Comparison

NDVI crop health maps: (a) Original orthomosaic NDVI, (b) Synthetic orthomosaic NDVI, (c) Hybrid orthomosaic NDVI

BibTeX

@article{katole2025orthofuse,
  title={Ortho-Fuse: Orthomosaic Generation for Sparse High-Resolution AI-driven Health Maps through Optical Flow Estimation},
  author={Katole, Rugved and Stewart, Christopher},
  journal={Under Review},
  year={2025}
}