高级检索

    基于多模态大模型语义引导的高分辨率无人机图像中小尺度电网部件缺陷检测

    High-Resolution UAV Image-Based Tiny Power Grid Component Defect Detection Guided by Multimodal Large Model Semantics

    • 摘要: 电网线路巡检是电力系统运维的核心环节,无人机技术和目标检测智能算法的融合显著提升了巡检效率和安全性,在我国电力系统中得到广泛应用。然而,高分辨率无人机图像中的电网小尺度部件(如小金具)缺陷检测面临目标尺度微小、空间分布稀疏等问题,直接在全图应用检测模型会导致召回率不足和推理效率低下,难以适应实际巡检需求。针对这一问题,提出了一种基于多模态大模型语义引导的小尺度电网部件缺陷检测方法。该方法首先构建目标潜在区域检测网络, 在监督训练同时通过特征对齐迁移多模态大模型知识以提升性能;随后利用置信度地图平滑优化区域定位;最后在高分辨率裁剪图像中使用轻量化模型实现缺陷的精细识别,避免目标过度缩放的问题。为验证效果,构建了专用的小金具缺陷检测数据集并进行实验。实验结果证明,所提算法在精确率和召回率上平均提升了约10%,明显优于直接在全图应用检测模型的方法。该方法具备良好的综合性能,能够有效应对高分辨率图像中小尺度部件的缺陷检测挑战。

       

      Abstract: Power line inspection is a core part of power system operation and maintenance. The integration of drone technology and object detection algorithms has significantly improved inspection efficiency and safety, and is widely applied in China's power systems. However, detecting defects in tiny grid components (such as small fittings) in high-resolution drone images faces challenges such as tiny object scale and sparse spatial distribution. Direct application of detection models on full images leads to insufficient recall rates and low inference efficiency, failing to meet practical inspection needs. To address this challenge, a defect detection method for tiny power grid components based on multi-modal large model semantic guidance is proposed in this paper. The method first constructs a potential target region detection network, which leverages supervised training along with feature alignment to transfer knowledge from the multi-modal large model to enhance performance. Then, region localization is refined by smoothing the confidence map. Finally, a lightweight model is applied to high-resolution cropped images for precise defect, avoiding issues caused by excessive scaling of objects. To verify the effectiveness of this method, a small fitting defect detection dataset and conducted experiments are constructed. Results show that the proposed algorithm improves precision and recall values by an average of about 10%, significantly outperforming methods that directly apply detection models on full images. Experimental results demonstrate that this method has good comprehensive performance and can effectively handle the challenge of defect detection in tiny components within high-resolution images.

       

    /

    返回文章
    返回