Deep Learning With Edge Computing: A Review
2019/07/15 by Jiasi Chen, Xukan Ran · 50 citations
Computer Science · #IoT and Edge/Fog Computing #Advanced Neural Network Applications #Context-Aware Activity Recognition Systems
paper · doi:10.1109/jproc.2019.2921977
Abstract
Deep learning is currently widely used in a variety of applications, including computer vision and natural language processing. End devices, such as smartphones and Internet-of-Things sensors, are generating data that need to be analyzed in real time using deep learning or used to train deep learning models. However, deep learning inference and training require substantial computation resources to run quickly. Edge computing, where a fine mesh of compute nodes are placed close to end devices, is a viable way to meet the high computation and low-latency requirements of deep learning on edge devices and also provides additional benefits in terms of privacy, bandwidth efficiency, and scalability. This paper aims to provide a comprehensive review of the current state of the art at the intersection of deep learning and edge computing. Specifically, it will provide an overview of applications where deep learning is used at the network edge, discuss various approaches for quickly executing deep learning inference across a combination of end devices, edge servers, and the cloud, and describe the methods for training deep learning models across multiple edge devices. It will also discuss open challenges in terms of systems performance, network technologies and management, benchmarks, and privacy. The reader will take away the following concepts from this paper: understanding scenarios where deep learning at the network edge can be useful, understanding common techniques for speeding up deep learning inference and performing distributed training on edge devices, and understanding recent trends and opportunities.
Citations
Cited by
- Trusted AI in Multiagent Systems: An Overview of Privacy and Security for Distributed Learning
- Task-Oriented Communication with Hybrid-Precision Models
- A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inference
- FedMPDD: Communication-Efficient Federated Learning with Privacy Preservation Attributes via Projected Directional Derivative
- Robust Geospatial Coordination of Multi-Agent Communications Networks Under Attrition
- Post-hoc Models for Performance Estimation of Machine Learning Inference
- 3D Point Cloud Object Detection on Edge Devices for Split Computing
- Sparse Optimization for Green Edge AI Inference
- Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
- SLIP-SEC: Formalizing Secure Protocols for Model IP Protection
- Kelle: Co-design KV Caching and eDRAM for Efficient LLM Serving in Edge Computing
- Progressive Weight Loading: Accelerating Initial Inference and Gradually Boosting Performance on Resource-Constrained Environments
- Fulcrum: Optimizing Concurrent DNN Training and Inferencing on Edge Accelerators
- Characterizing the Performance of Accelerated Jetson Edge Devices for Training Deep Learning Models
- Flexible nanogenerators for intelligent robotics: design, manufacturing, and applications
- Confidence-gated training for efficient early-exit neural networks
- Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception
- Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies
- Deep learning in automated ultrasonic NDE – Developments, axioms and opportunities
- Performance Prediction for Convolutional Neural Networks in Edge Devices
- Implementing Neural Networks Over-the-Air via Reconfigurable Intelligent Surfaces
- Edge-Based Multimodal Sensor Data Fusion with Vision Language Models (VLMs) for Real-time Autonomous Vehicle Accident Avoidance
- ProGMLP: A Progressive Framework for GNN-to-MLP Knowledge Distillation with Efficient Trade-offs
- edge-SR: Super-Resolution For The Masses
- Alleviating Textual Reliance in Medical Language-guided Segmentation via Prototype-driven Semantic Approximation
- Edge Machine Learning for AI-Enabled IoT Devices: A Review. [europepmc]
- Distributed Artificial Intelligence-as-a-Service (DAIaaS) for Smarter IoE and 6G Environments. [europepmc]
- A Generalization Performance Study Using Deep Learning Networks in Embedded Systems. [europepmc]
- Optimising Deep Learning at the Edge for Accurate Hourly Air Quality Prediction. [europepmc]
- An Overview of Machine Learning within Embedded and Mobile Devices-Optimizations and Applications. [europepmc]
- Wearable Edge AI Applications for Ecological Environments. [europepmc]
- Improved Environment-Aware-Based Noise Reduction System for Cochlear Implant Users Based on a Knowledge Transfer Approach: Development and Usability Study. [europepmc]
- Highly-Optimized Radar-Based Gesture Recognition System with Depthwise Expansion Module. [europepmc]
- Domain-Aware Neural Architecture Search for Classifying Animals in Camera Trap Images. [europepmc]
- Global impact of COVID-19 on agriculture: role of sustainable agriculture and digital farming. [europepmc]
- Imtidad: A Reference Architecture and a Case Study on Developing Distributed AI Services for Skin Disease Diagnosis over Cloud, Fog and Edge. [europepmc]
- Applications and Techniques for Fast Machine Learning in Science. [europepmc]
- Real-Time Fault Detection and Condition Monitoring for Industrial Autonomous Transfer Vehicles Utilizing Edge Artificial Intelligence. [europepmc]
- Machine Learning for Intelligent-Reflecting-Surface-Based Wireless Communication towards 6G: A Review. [europepmc]
- E-prop on SpiNNaker 2: Exploring online learning in spiking RNNs on neuromorphic hardware. [europepmc]
- Machine learning at the edge for AI-enabled multiplexed pathogen detection. [europepmc]
- Intelligent Video Analytics for Human Action Recognition: The State of Knowledge. [europepmc]
- Indoor Scene Recognition Mechanism Based on Direction-Driven Convolutional Neural Networks. [europepmc]
- Human-centred artificial intelligence for mobile health sensing: challenges and opportunities. [europepmc]
- An intriguing vision for transatlantic collaborative health data use and artificial intelligence development. [europepmc]
- deepPGSegNet: MRI-based pituitary gland segmentation using deep learning. [europepmc]
- A deep learning method for empirical spectral prediction and inverse design of all-optical nonlinear plasmonic ring resonator switches. [europepmc]
- Cost, Usability, Credibility, Fairness, Accountability, Transparency, and Explainability Framework for Safe and Effective Large Language Models in Medical Education: Narrative Review and Qualitative Study. [europepmc]
- Nanophotonic structure inverse design for switching application using deep learning. [europepmc]
- Real-time augmentation of diagnostic nasal endoscopy video using AI-enabled edge computing. [europepmc]
Related