The power of fusion: LiDAR meets hyperspectral imaging in a new era of exploration

https://doi.org/10.1016/j.optlastec.2025.114080Get rights and content

Abstract

In recent times, Light Detection and Ranging (LiDAR) technology has emerged as a pioneering force within laser scanning, remote sensing, and object recognition systems due to its exceptional precision in pinpointing structures and zones of interest with millimeter-level detail. Beyond mere identification, LiDAR excels in revealing subtle distinctions and abnormalities, such as surface degradation and vegetation growth, providing invaluable insights across various applications. Combining LiDAR with hyperspectral imaging enhances environmental monitoring and resource management capabilities by offering a comprehensive view of landscapes, enabling precise 3D mapping of terrain features while capturing detailed spectral signatures. This review encompasses an in-depth exploration of LiDAR systems, their applications, the integration of hyperspectral imaging, and methods for processing hyperspectral data, as well as discussing challenges and future perspectives within the field of LiDAR technology.

Introduction

LiDAR systems have developed as a pivotal technology in the contemporary landscape, revolutionizing various fields ranging from autonomous vehicles to environmental monitoring and urban planning [1,2]. These systems operate by emitting laser pulses and determining the time it takes for them to return after bouncing off objects, thereby creating highly accurate three-dimensional representations of the surrounding environment [3]. The significance of LiDAR in modern times lies in its remarkable ability to capture detailed spatial data with precision and speed, supporting highly accurate analysis and deeper insights [4,5]. From enhancing the safety and efficiency of transportation networks to aiding in conserving natural resources and cultural heritage sites, LiDAR systems have become indispensable tools for researchers, engineers, and policymakers alike. As advancements continue to refine the technology and expand its applications, the influence of LiDAR on shaping the future of various industries and scientific endeavours only continues to grow [6].
LiDAR is a vital tool thanks to its exceptional ability to provide highly accurate and comprehensive spatial data, supporting a wide range of applications. In contrast to conventional surveying methods, which often entail significant time and labour investments, LiDAR enables swift data acquisition over extensive areas with unmatched accuracy. This capability holds immense importance in diverse tasks such as urban planning terrain mapping, ecological studies involving monitoring changes in forest canopy height, and the development of intricate 3D models for infrastructure projects. Furthermore, LiDAR's unique ability to penetrate dense foliage and adverse atmospheric conditions renders it particularly invaluable in fields like forestry, agriculture, and disaster management [[7], [8], [9]]. Its pivotal role extends to cutting-edge technologies like autonomous vehicles, where its precise mapping functionalities are fundamental for navigation and obstacle avoidance [10]. In essence, LiDAR's necessity stems from its provision of detailed spatial information, essential for addressing multifaceted challenges across various domains, thereby propelling innovation and advancement in countless sectors [11].
While LiDAR excels in delivering high-resolution three-dimensional structural information, it lacks the spectral richness needed to capture biochemical and material properties. Hyperspectral imaging (HSI), by contrast, provides fine-grained spectral detail that enables identification of vegetation health, mineral composition, and surface materials, but typically at lower spatial resolution [12,13]. When combined, LiDAR and HSI offer synergistic benefits: improved land cover classification, enhanced detection of vegetation stress, and more comprehensive analysis of environmental and geological features. However, integration also presents challenges [13,14]. Differences in spatial and spectral resolution, acquisition geometry, and sensor alignment often introduce registration errors and geometric mismatches. Additionally, the high dimensionality of HSI combined with dense LiDAR point clouds increases computational complexity and the risk of overfitting in machine learning models, particularly when annotated training datasets are limited. These trade-offs underscore the need for careful fusion strategies and set the stage for exploring both the promise and limitations of LiDAR-HSI integration [15,16]. These considerations make it essential to evaluate fusion strategies carefully, and this review aims to highlight both the current capabilities and the future prospects of LiDAR–HSI integration.
While conventional LiDAR provides precise 3D structural information, it lacks the spectral richness needed to identify biochemical or material properties. Integrating LiDAR with HSI bridges this gap by combining geometric accuracy with detailed spectral signatures, enabling more accurate land-cover classification, early vegetation stress detection, and comprehensive environmental analysis. The evolution of LiDAR systems marks a fascinating journey of technological advancement and innovation. Originating in the early 1960s primarily for military applications, LiDAR systems have undergone significant transformations over the decades. Initially bulky and expensive, early LiDAR systems were limited in their capabilities and largely confined to specialized use cases. However, with advancements in laser technology, computing power, and miniaturization, LiDAR systems have become more compact, affordable, and versatile. Table 1 provides information on the evolution of LiDAR systems over time [17]. The integration of solid-state lasers, photodetectors, and sophisticated algorithms has enabled LiDAR to evolve into a mainstream technology with widespread applications across industries. Moreover, developments in software algorithms have enhanced data processing capabilities, allowing for more efficient and accurate interpretation of LiDAR-generated 3D point clouds (PCs). As LiDAR continues to evolve, ongoing research and development efforts focus on improving resolution, increasing range, reducing costs, and expanding functionality, thereby unlocking new possibilities for its use in fields such as autonomous vehicles, urban planning, environmental monitoring, and archaeology [[18], [19], [20]]. The most advanced development in current LiDAR technology is hyperspectral LiDAR [21]. This technology was introduced to address the challenges of integrating LiDAR with hyperspectral imagery and to eliminate matching errors that typically occur during the fusion process. Hyperspectral LiDAR can simultaneously acquire a three-dimensional hyperspectral point cloud, combining both structural and spectral information of the target. This allows for precise characterization of the target’s three-dimensional physiological and biochemical parameters [22]. Moreover, because all spectral bands share a unified emission and reception channel, it fundamentally avoids the geometric mismatches that arise when separately aligning LiDAR data with hyperspectral images.
The paper is structured as follows: Section 2 delves into the operational mechanisms of LiDAR systems. Section 3 comprehensively explores the various types and attributes of LiDAR systems, encompassing airborne, terrestrial, mobile, and spaceborne platforms. In Section 4, a detailed examination of the applications of both LiDAR systems and hyperspectral imaging (HSI) is presented. Section 5 addresses the processing methods of HSI data, including pre-processing techniques, empirical relationships, radiative transfer modelling, and applications of machine learning and deep learning. Section 6 elucidates the challenges and prospects inherent in LiDAR systems. Finally, concluding remarks are provided in Section 7 to wrap up the discussion.

Access through your organization

Check access to the full text by signing in through your organization.

Access through your organization

Section snippets

Working mechanism of LiDAR system

Fig. 1 elucidates the operational mechanism of a LiDAR-based system. As shown, when photons of light energy emitted by LiDAR systems (for example, airborne LiDAR) encounter various objects such as roads, structures, foliage, bridges, etc., a fraction of the light reflects back to the sensor. Depending on the size of the objects and the surrounding context, some light penetrates and reaches the ground, leading to multiple reflections. These reflections generate a waveform representing the

Types of LiDAR systems

Various types of LiDAR systems exist, each designed for specific applications (Fig. 2) [67]. Airborne LIDAR employs sensors mounted on aircraft or drones, providing high-resolution topographic data for mapping terrain, forestry management, and urban planning [68]. Terrestrial LIDAR operates from ground-based stations, capturing detailed 3D images of structures, archaeological sites, and infrastructure [69,70]. Mobile LIDAR, often mounted on vehicles, offers rapid data collection for urban

Applications of LiDAR and HSI

Before discussing applications, it is useful to briefly outline the theoretical basis of HSI. HSI captures reflectance across hundreds of narrow, contiguous spectral bands, generating a three-dimensional data cube (two spatial dimensions plus one spectral dimension). This rich spectral information provides distinctive material ‘fingerprints’ that allow discrimination of vegetation health, mineral composition, and surface materials. Unlike multispectral sensors with only a few broad bands, HSI

Methods for processing HSI

Hyperspectral images obtained from various platforms and sensors usually arrive in an unprocessed format (for instance, digital numbers), necessitating preliminary treatments (like atmospheric, radiometric, and spectral adjustments) to ensure precise spectral extraction. After preprocessing, a variety of approaches can be employed to analyze hyperspectral data and examine agricultural attributes (such as crop and soil characteristics). Commonly utilized methodologies include linear regression,

Multi-level fusion strategies

The integration of LiDAR and HSI data can be performed at various levels depending on the application, computational resources, and accuracy requirements [205]. Broadly, data fusion techniques fall into three categories: data-level, feature-level, and decision-level fusion [[206], [207], [208]]. Data-level fusion, also known as early fusion, involves the direct concatenation of raw or pre-processed data from both LiDAR and HSI into a unified input space [209]. For instance, LiDAR-derived

Navigating the research gap, challenges and embracing future prospects of LiDAR systems

The integration of LiDAR and HSI technologies has opened new frontiers in remote sensing applications by combining the geometric precision of LiDAR with the rich spectral information provided by HIS [15]. However, despite significant progress, several critical research gaps persist that impede the full realization of this fusion's potential. A primary limitation lies in the spatial and spectral resolution mismatch between the two modalities [239]. LiDAR data typically possess high spatial

Final remarks

In this review paper, a comprehensive examination of the applications of LiDAR and HSI across diverse domains is conducted. Furthermore, the challenges faced by LiDAR systems aswell as the promising prospects that lie ahead for these technologies are discussed. Throughout the paper, it has become evident that LiDAR and HSI technologies offer exceptional capabilities in capturing detailed and precise data about the Earth's surface and its features. In ecological monitoring and bio-diversity

CRediT authorship contribution statement

Nikolay Lvovich Kazanskiy: . Leonid Leonidovich Doskolovich: Writing – review & editing, Writing – original draft, Supervision, Software, Resources, Project administration, Methodology, Investigation. Nikita Vladimirovich Golovastikov: Writing – review & editing, Writing – original draft, Supervision, Software, Resources, Project administration, Methodology, Investigation, Funding acquisition. Svetlana Nikolaevna Khonina: .

Funding

This work was performed within the State assignment for scientific research to Samara University (project FSSS-2024-0016) (review of types of LiDAR systems and their applications), and within the state assignment of the National Research Center “Kurchatov Institute” (review of methods for processing LiDAR and HSIdata).

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References (259)

  • J. Bai et al.

    A theoretical demonstration on the independence of distance and incidence angle effects for small-footprint hyperspectral LiDAR: basic physical concepts

    Remote Sens. Environ.

    (2024)
  • M. Liu et al.

    Tree species classification of LiDAR data based on 3D deep learning

    Measurement

    (2021)
  • L. Janowski et al.

    Automatic classification and mapping of the seabed using airborne LiDAR Bathymetry

    Eng. Geol.

    (2022)
  • R. Blatrix et al.

    Interpreting landscapes of pre-columbian raised-field agriculture using high-resolution LiDAR topography

    J. Archaeol. Sci. Rep.

    (2022)
  • M.-P. Kwan et al.

    LiDAR assisted emergency response: detection of transport network obstructions caused by major disasters

    Comput. Environ. Urban Syst.

    (2010)
  • J. Bai et al.

    An exploration, analysis, and correction of the distance effect on terrestrial hyperspectral LiDAR data

    ISPRS J. Photogramm. Remote Sens.

    (2023)
  • C.J. Lowe

    Spacecraft and optics design considerations for a spaceborne Lidar mission with spatially continuous global coverage

    Acta Astronaut.

    (2024)
  • M.J. Campbell et al.

    Evaluating the performance of airborne and spaceborne Lidar for mapping biomass in the United States’ largest dry woodland ecosystem

    Remote Sens. Environ.

    (2024)
  • G.U. Sikakwe

    Mineral exploration employing drones, contemporary geological satellite remote sensing and geographical information system (GIS) procedures: a review

    Remote Sens. Appl.: Soc. Environ.

    (2023)
  • J. Toivonen et al.

    Assessing biodiversity using forest structure indicators based on airborne laser scanning data

    For. Ecol. Manage.

    (2023)
  • C.M.C.S. Listopad et al.

    Structural diversity indices based on airborne LiDAR as ecological indicators for managing highly dynamic landscapes

    Ecol. Ind.

    (2015)
  • R. Rashdi

    Comparative evaluation of LiDAR systems for transport infrastructure: case studies and performance analysis

    Eur. J. Remote Sensing

    (2024)
  • D. Liang et al.

    Evolution of laser technology for automotive LiDAR, an Industrial viewpoint

    Nat. Commun.

    (2024)
  • T. Raj et al.

    A survey on LiDAR scanning mechanisms

    Electronics

    (2020)
  • H. Wu et al.

    Moving event detection from LiDAR point streams

    Nat. Commun.

    (2024)
  • S. Royo et al.

    An overview of lidar imaging systems for autonomous vehicles

    Appl. Sci.

    (2019)
  • K. Luo et al.

    3D point cloud-based place recognition: a survey

    Artif. Intell. Rev.

    (2024)
  • B. Lu et al.

    Recent advances of hyperspectral imaging technology and applications in agriculture

    Remote Sens. (Basel)

    (2020)
  • Tusa, E.; Laybros, A.; Monnet, J.-M.; Dalla Mura, M.; Barré, J.-B.; Vincent, G.; Dalponte, M.; Féret, J.-B.; Chanussot,...
  • Y. Tian et al.

    Mangrove Biodiversity Assessment using UAV Lidar and Hyperspectral Data in China’s Pinglu Canal Estuary

    Remote Sens. (Basel)

    (2023)
  • Q. Wang et al.

    Joint classification of hyperspectral images and LiDAR data based on dual-branch transformer

    Sensors

    (2024)
  • J. Bai et al.

    Toward an advanced method for full-waveform hyperspectral LiDAR data processing

    IEEE Trans. Geosci. Remote Sens.

    (2024)
  • S. Abdollahi et al.

    Agile THz-range spectral multiplication of frequency combs using a multi-wavelength laser

    Nat. Commun.

    (2024)
  • M. Latella et al.

    Short-term biogeomorphology of a gravel-bed river: integrating remote sensing with hydraulic modelling and field analysis

    Earth Surf. Proc. Land.

    (2024)
  • N. Singh et al.

    Assembling a High Energy Pulse Lidar (HEPL) system: preliminary results from an astronomical site in the central Himalayan region

    Ind. J. Pure Appl. Phys. (IJPAP)

    (2024)
  • J. Bai et al.

    A Novel algorithm for leaf incidence angle effect correction of hyperspectral LiDAR

    IEEE Trans. Geosci. Remote Sens.

    (2022)
  • J.C. Fernandez-Diaz et al.

    Now you see it… now you don’t: understanding airborne mapping LiDAR collection and data product generation for archaeological research in mesoamerica

    Remote Sens. (Basel)

    (2014)
  • Sliney, D.; Wolbarsht, M. Laser Hazards in Outdoor Applications: Military and Lidar. In Safety with Lasers and Other...
  • J. Roiha

    Precision forestry versus non-precision archaeology—integrating forest management and archaeological site protection

    Forests

    (2024)
  • G. Vinci et al.

    LiDAR applications in archaeology: a systematic review

    Archaeol. Prospect.

    (2025)
  • C. Askar et al.

    Use of smartphone lidar technology for low-cost 3D building documentation with iPhone 13 pro: a comparative analysis of mobile scanning applications

    Geomatics

    (2023)
  • D. Lee et al.

    LiDAR odometry survey: recent advancements and remaining challenges

    Intel Serv Robot.

    (2024)
  • Z. Dai et al.

    enhanced object detection in autonomous vehicles through LiDAR—camera sensor fusion

    World Electric Vehicle J.

    (2024)
  • DeSantis, D.M.; Mazur, B.M.; Notaros, M.; Notaros, J. Multi-beam solid-state LiDAR using star-coupler-based optical...
  • D. Wang et al.

    MEMS mirrors for LiDAR: a review

    Micromachines

    (2020)
  • Cheng, J.; Xiang, Z.; Cao, T.; Liu, J. Robust Vehicle Detection Using 3D Lidar under Complex Urban Environment. In...
  • P. Wang

    Research on comparison of LiDAR and camera in autonomous driving

    J. Phys. Conf. Ser.

    (2021)
  • Y. Li et al.

    Lidar for autonomous driving: the principles, challenges, and trends for automotive lidar and perception systems

    IEEE Signal Process Mag.

    (2020)
  • Z. Dai

    Requirements for automotive LiDAR systems

    Sensors

    (2022)
  • K.-Y. Huang et al.

    Scheme of flash LiDAR employing glass aspherical microlens array with large field of illumination for autonomous vehicles

    Opt. Express, OE

    (2024)
  • Cited by (3)

    • Impact of TiS3 Integration on Porous Silicon Photodetector Performance

      2025, Optical Memory and Neural Networks Information Optics
    View full text