Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies

2020/06/10 by Yu Huang, Yue Chen, Huang, Yu +1 · 5 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Autonomous Vehicle Technology and Safety #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Video Surveillance and Tracking Methods #cs.CV

paper · pdf · doi:10.48550/arxiv.2006.06091

openalex publication_date 2020/06/10 · arxiv created 2020/07/04 · arxiv updated 2020/07/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. Almost at the same time, deep learning has made breakthrough by several pioneers, three of them (also called fathers of deep learning), Hinton, Bengio and LeCun, won ACM Turin Award in 2019. This is a survey of autonomous driving technologies with deep learning methods. We investigate the major fields of self-driving systems, such as perception, mapping and localization, prediction, planning and control, simulation, V2X and safety etc. Due to the limited space, we focus the analysis on several key areas, i.e. 2D and 3D object detection in perception, depth estimation from cameras, multiple sensor fusion on the data, feature and task level respectively, behavior modelling and prediction of vehicle driving and pedestrian trajectories.

Citations

• Gradient-based learning applied to document recognition
• ImageNet classification with deep convolutional neural networks
• Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
• End to End Learning for Self-Driving Cars
• Learning a Driving Simulator
• Efficient Processing of Deep Neural Networks: A Tutorial and Survey
• SfM-Net: Learning of Structure and Motion from Video
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal\n Networks
• A Survey of Model Compression and Acceleration for Deep Neural Networks
• Deep Learning: A Critical Appraisal
• Pyramid Stereo Matching Network
• Orthographic Feature Transform for Monocular 3D Object Detection
• Survey on semantic segmentation using deep learning techniques
• A Survey on Neural Architecture Search
• Object Detection in 20 Years: A Survey
• StarNet: Pedestrian Trajectory Prediction using Deep Neural Network in Star Topology
• PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
• A Hierarchical Architecture for Sequential Decision-Making in Autonomous Driving using Deep Reinforcement Learning
• Xception: Deep Learning with Depthwise Separable Convolutions
• A Survey of Autonomous Driving: Common Practices and Emerging Technologies
• Voxel-FPN: multi-scale voxel feature aggregation in 3D object detection from point clouds
• Deep Learning With Edge Computing: A Review
• STD: Sparse-to-Dense 3D Object Detector for Point Cloud
• PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
• Class-specific Anchoring Proposal for 3D Object Recognition in LIDAR and RGB Images
• Multi-Sensor 3D Object Box Refinement for Autonomous Driving
• Self-Supervised Learning of Depth and Ego-motion with Differentiable Bundle Adjustment
• RefinedMPL: Refined Monocular PseudoLiDAR for 3D Object Detection in Autonomous Driving
• Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Network
• EfficientDet: Scalable and Efficient Object Detection
• Bridging the Gap Between Anchor-Based and Anchor-Free Detection via Adaptive Training Sample Selection
• Deep Learning for 3D Point Clouds: A Survey
• Advances and Open Problems in Federated Learning

Cited by

• Scalpel: Automotive Deep Learning Framework Testing via Assembling Model Components
• GPU Temperature Simulation-Based Testing for In-Vehicle Deep Learning Frameworks
• SKGE-SWIN: End-To-End Autonomous Vehicle Waypoint Prediction and Navigation Using Skip Stage Swin Transformer
• Deep Deterministic Uncertainty for Semantic Segmentation
• From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous Driving

Related

• A survey of deep learning techniques for autonomous driving
• Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Survey
• Research on the Application of Computer Vision Based on Deep Learning in Autonomous Driving Technology
• Advancing Autonomous Driving Perception: Analysis of Sensor Fusion and Computer Vision Techniques
• An Overview about Emerging Technologies of Autonomous Driving