Benchmarking Deep Learning Approaches for AEC Engineering Drawing Layout Detection and Information Extraction

2026/07/21 by Tianyang Huang, Alessio Lombardi, Ahmed Elnagar +7
#cs.CV #cs.CE #cs.LG

paper · pdf

Abstract

Information Extraction (IE) from Architecture, Engineering, and Construction (AEC) drawings remains hindered by manual inefficiency, while Layout Detection, a vital 'middleware' organizing graphical and textual hierarchies, is underexplored. General document layout models, optimized for text-centric content, lack validation on engineering drawings. This study constructs a custom AEC-specific layouts dataset and benchmarks five deep learning architectures. RF-DETR achieves state-of-the-art performance with an mAP₅₀ of 0.949, while the Vision-Language Model Qwen3-VL attains a leading F1-score of 0.911. Conversely, models pre-trained on general document datasets suffer from "domain interference", causing performance degradation. This establishes a robust technical foundation for automated IE in AEC.

Related

• Automated Parsing of Engineering Drawings for Structured Information Extraction Using a Fine-tuned Document Understanding Transformer
• A Multi-Stage Hybrid Framework for Automated Interpretation of Multi-View Engineering Drawings Using Vision Language Model
• Title block detection and information extraction for enhanced building drawings search
• PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Construction
• VTLayout: Fusion of Visual and Text Features for Document Layout Analysis