An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
2018/03/04 by Shaojie Bai, J. Zico Kolter, Bai, Shaojie +3 · 3 voices · 276 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Music and Audio Processing
paper · pdf · doi:10.48550/arxiv.1803.01271
Abstract
For most deep learning practitioners, sequence modeling is synonymous with recurrent networks. Yet recent results indicate that convolutional architectures can outperform recurrent networks on tasks such as audio synthesis and machine translation. Given a new sequence modeling task or dataset, which architecture should one use? We conduct a systematic evaluation of generic convolutional and recurrent architectures for sequence modeling. The models are evaluated across a broad range of standard tasks that are commonly used to benchmark recurrent networks. Our results indicate that a simple convolutional architecture outperforms canonical recurrent networks such as LSTMs across a diverse range of tasks and datasets, while demonstrating longer effective memory. We conclude that the common association between sequence modeling and recurrent networks should be reconsidered, and convolutional networks should be regarded as a natural starting point for sequence modeling tasks. To assist related work, we have made code available at http://github.com/locuslab/TCN .
Citations
Cited by
- DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
- Pretraining Recurrent Networks without Recurrence
- Climate-resilient electric vehicle charging infrastructure for sustainable cities: An interpretable causal-ensemble framework for preventive maintenance and low-carbon mobility
- Real-Time Detection of Charge Jumps in Superconducting Qubits with a Convolutional Neural Network
- Twoblock clustering trees with coskewness-based dimension reduction: recovering piecewise multivariate linear regimes
- Deep learning-based prediction of time-resolved adhesive forces in viscoelastic Hertzian contacts
- Visual Semantic Decoding of Electrocorticography from Video Stimuli using End-to-End Deep Learning
- Lightweight Wrappers for Adapting Time Series Foundation Models to Regional Drought Forecasting
- Fourier Geometric Wind Power Forecasting with Numerical Weather Prediction
- EdgeCoInfer: Hierarchical Collaborative Inference for On-Device Multimodal Large Models
- A Framework for Early Sepsis Prediction via Self-Supervised (JEPA) and Federated Representation Learning
- HyBDM: Multi-Scale Hybrid Experts for Time Series Forecasting with Bidirectional Dependency Modeling
- Knowledge-Assisted Multi-Graph Dependency Learning for Multivariate Time Series Anomaly Detection in Multi-Stage Industrial Processes
- Structured Latent Space Modeling over Multi-Scale Temporal Patches for Multivariate Time Series Forecasting
- Beyond Output-Space Calibration: Spectral Evidence Bundling for Selective Reliability Estimation in Time-Series Classification
- Trajectory-Aware Clinical Risk Prediction via Severity-Grounded Knowledge Graphs and Retrieval-Augmented Generation
- Chameleon: A Multiplier-Free Temporal Convolutional Network Accelerator for End-to-End Few-Shot and Continual Learning from Sequential Data
- A new adaptive two-layer model for opinion spread in hypergraphs: parameter sensitivity and estimation
- A Neural Network-Based Real-time Casing Collar Recognition System for Downhole Instruments
- What Matters in Deep Learning for Time Series Forecasting?
- SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completion
- Every Client Is an Environment: Federated De-confounding for Spatio-Temporal Forecasting
- Label-free Industrial Fault Detection via Adversarial Inverse Reinforcement Learning: A System for Run-to-Failure Prognostics
- Inferring Missing Trajectory Data with Temporal Convolutional Networks
- Deep Label-Wise Attentive Temporal Convolutional Networks Improve Medical Coding
- Explainable Multimodal Regression via Information Decomposition
- Deep Generative Spatiotemporal Engression for Probabilistic Forecasting of Epidemics
- Spatiotemporal Feature Alignment and Weighted Fusion in Collaborative Perception Enabled by Network Synchronization and Age of Information
- Dual-Prototype Disentanglement: A Context-Aware Enhancement Framework for Time Series Forecasting
- RIPCN: A Road Impedance Principal Component Network for Probabilistic Traffic Flow Forecasting
- RP-CATE: Recurrent Perceptron-based Channel Attention Transformer Encoder for Industrial Hybrid Modeling
- Few-Shot Specific Emitter Identification via Integrated Complex Variational Mode Decomposition and Spatial Attention Transfer
- Concurrence: A dependence criterion for time series, applied to biological data
- BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activity
- Assessing Neuromorphic Computing for Fingertip Force Decoding from Electromyography
- Augmented Neural Ordinary Differential Equations for Power System Identification
- In-Context and Few-Shots Learning for Forecasting Time Series Data based on Large Language Models
- Hybrid Quantum-Classical Ensemble Learning for S&P 500 Directional Prediction
- Exploiting Spatiotemporal Properties for Efficient Event-Driven Human Pose Estimation
- Physics-Informed Neural Koopman Machine for Interpretable Longitudinal Personalized Alzheimer's Disease Forecasting
- STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions
- Comparison of neural network training strategies for the simulation of dynamical systems
- Reasoning-Aware Multimodal Fusion for Hateful Video Detection
- Cuffless Blood Pressure Estimation from Six Wearable Sensor Modalities in Multi-Motion-State Scenarios
- Neonatal seizure detection from raw multi-channel EEG using a fully convolutional architecture
- Privacy-Preserving Generative Modeling and Clinical Validation of Longitudinal Health Records for Chronic Disease
- Spoken Speech Enhancement using EEG
- A Physics-Informed U-net-LSTM Network for Data-Driven Seismic Response Modeling of Structures
- MSTN: Fast and Efficient Multivariate Time Series Prediction Model
- Causal Feature Selection for Weather-Driven Residential Load Forecasting
- Leveraging Spatiotemporal Graph Neural Networks for Multi-Store Sales Forecasting
- Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks
- Fast Adaptive Neural Control of Resonant Extraction at Fermilab
- Online Multi-Agent Forecasting with Interpretable Collaborative Graph Neural Network
- Autonomous Docking of Multi-Rotor UAVs on Blimps under the Influence of Wind Gusts
- Deep Learning Analysis of Ions Accelerated at Shocks
- Memory-DD: A Low-Complexity Dendrite-Inspired Neuron for Temporal Prediction Tasks
- Physics-Guided Inductive Spatiotemporal Kriging for PM2.5 with Satellite Gradient Constraints
- Transparent Early ICU Mortality Prediction with Clinical Transformer and Per-Case Modality Attribution
- HiPPO: Recurrent Memory with Optimal Polynomial Projections
- A Quantum Tensor Network-Based Viewpoint for Modeling and Analysis of Time Series Data
- Sequential Deep Learning for Credit Risk Monitoring with Tabular\n Financial Data
- Assessing Generalization in Deep Reinforcement Learning
- DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement
- Gas-insulated switch-gear mechanical fault detection based on acoustic using feature fused neural network
- VitalBench: A Rigorous Multi-Center Benchmark for Long-Term Vital Sign Prediction in Intraoperative Care
- SurvBench: A Standardised Preprocessing Pipeline for Multi-Modal Electronic Health Record Survival Analysis
- X-IONet: Cross-Platform Inertial Odometry Network with Dual-Stage Attention
- Versatile and Risk-Sensitive Cardiac Diagnosis via Graph-Based ECG Signal Representation
- LAD-BNet: Lag-Aware Dual-Branch Networks for Real-Time Energy Forecasting on Edge Devices
- MARAuder's Map: Motion-Aware Real-time Activity Recognition with Layout-Based Trajectories
- Temporal convolutional and fusional transformer model with Bi-LSTM encoder-decoder for multi-time-window remaining useful life prediction
- Predicting Grain Growth in Polycrystalline Materials Using Deep Learning Time Series Models
- A Hybrid Deep Learning based Carbon Price Forecasting Framework with Structural Breakpoints Detection and Signal Denoising
- UnCLe: Towards Scalable Dynamic Causal Discovery in Non-linear Temporal Systems
- Smartphone User Fingerprinting on Wireless Traffic
- Efficient Linear Attention for Multivariate Time Series Modeling via Entropy Equality
- Applying Time Series Deep Learning Models to Forecast the Growth of Perennial Ryegrass in Ireland
- Functional embeddings enable Aggregation of multi-area SEEG recordings over subjects and sessions
- Discovering EV Charging Site Archetypes Through Few Shot Forecasting: The First U.S.-Wide Study
- Towards a predictive spatio-temporal representation of brain data
- DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment
- AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search
- A Multi-Task Learning Framework for Extracting Drugs and Their Interactions from Drug Labels
- Human-Centered Emotion Recognition in Animated GIFs
- Tdcgan: Temporal Dilated Convolutional Generative Adversarial Network for End-to-end Speech Enhancement
- Spotting insects from satellites: modeling the presence of Culicoides\n imicola through Deep CNNs
- Online Handwriting Trajectory Reconstruction from Kinematic Sensors using Temporal Convolutional Network
- Deep learning for pedestrians: backpropagation in CNNs
- T-Rep: Representation Learning for Time Series using Time-Embeddings
- Deep learning: new computational modelling techniques for genomics
- Divide and Conquer: A Deep CASA Approach to Talker-independent Monaural Speaker Separation
- Improving EEG based Continuous Speech Recognition
- Machine Learning Featurizations for AI Hacking of Political Systems
- Distance-aware Soft Prompt Learning for Multimodal Valence-Arousal Estimation
- Temporal Graph Convolutional Networks for Automatic Seizure Detection
- Channel Relationship Prediction with Forget-Update Module for Few-shot Classification
- Exploring the Best Loss Function for DNN-Based Low-latency Speech Enhancement with Temporal Convolutional Networks
- Driver2vec: Driver Identification from Automotive Data
- On the Importance of Attention in Meta-Learning for Few-Shot Text Classification
- TPCN: Temporal Point Cloud Networks for Motion Forecasting
- Voice Activity Detection in presence of background noise using EEG
- Learning a Proposal Classifier for Multiple Object Tracking
- Improving the Gating Mechanism of Recurrent Neural Networks
- Compositionality decomposed: how do neural networks generalise?
- Parallel BiLSTM-Transformer networks for forecasting chaotic dynamics
- Sustainable NARMA-10 Benchmarking for Quantum Reservoir Computing
- SARNet: A Spike-Aware consecutive validation Framework for Accurate Remaining Useful Life Prediction
- Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting
- Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separation
- Enhancing WiFi CSI Fingerprinting: A Deep Auxiliary Learning Approach
- Error Adjustment Based on Spatiotemporal Correlation Fusion for Traffic Forecasting
- Audio-Linguistic Embeddings for Spoken Sentences
- Elementary, My Dear Watson: Non-Invasive Neural Keyword Spotting in the LibriBrain Dataset
- Comparison of Deep learning models on time series forecasting : a case study of Dissolved Oxygen Prediction
- InvDec: Inverted Decoder for Multivariate Time Series Forecasting with Separated Temporal and Variate Modeling
- SynTSBench: Rethinking Temporal Pattern Learning in Deep Learning Models for Time Series
- Unsupervised Anomaly Prediction with N-BEATS and Graph Neural Network in Multi-variate Semiconductor Process Time Series
- Tune-In: Training Under Negative Environments with Interference for Attention Networks Simulating Cocktail Party Effect
- RatioWaveNet: A Learnable RDWT Front-End for Robust and Interpretable EEG Motor-Imagery Classification
- CKConv: Continuous Kernel Convolution For Sequential Data
- Online Kernel Dynamic Mode Decomposition for Streaming Time Series Forecasting with Adaptive Windowing
- Online Time Series Forecasting with Theoretical Guarantees
- SqueezeCall: nanopore basecalling using a Squeezeformer network
- Xihe: Scalable Zero-Shot Time Series Learner Via Hierarchical Interleaved Block Attention
- Renaissance of RNNs in Streaming Clinical Time Series: Compact Recurrence Remains Competitive with Transformers
- Long Expressive Memory for Sequence Modeling
- Learning to Recognize Correctly Completed Procedure Steps in Egocentric Assembly Videos through Spatio-Temporal Modeling
- SDGraph: Multi-Level Sketch Representation Learning by Sparse-Dense Graph Architecture
- TFGA-Net: Temporal-Frequency Graph Attention Network for Brain-Controlled Speaker Extraction
- U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging
- Actor-Enriched Time Series Forecasting of Process Performance
- Vision-LLMs for Spatiotemporal Traffic Forecasting
- Multi-Agent Regime-Conditioned Diffusion (MARCD) for CVaR-Constrained Portfolio Decisions
- Interactive Atmospheric Composition Emulation for Next-Generation Earth System Models
- CauchyNet: Compact and Data-Efficient Learning using Holomorphic Activation Functions
- A Unified Frequency Domain Decomposition Framework for Interpretable and Robust Time Series Forecasting
- Real-time 3D Deep Multi-Camera Tracking
- Bidirectional Time-Frequency Pyramid Network for Enhanced Robust EEG Classification
- Extreme value forecasting using relevance-based data augmentation with deep learning models
- Variability Aware Recursive Neural Network (VARNN): A Residual-Memory Model for Capturing Temporal Deviation in Sequence Regression Modeling
- Cross-dataset Multivariate Time-series Model for Parkinson's Diagnosis via Keyboard Dynamics
- STaTS: Structure-Aware Temporal Sequence Summarization via Statistical Window Merging
- IKNet: Interpretable Stock Price Prediction via Keyword-Guided Integration of News and Technical Indicators
- Spatial-Temporal Block and LSTM Network for Pedestrian Trajectories Prediction
- Beyond Sub-6 GHz: Leveraging mmWave Wi-Fi for Gait-Based Person Identification
- Adjusting for Autocorrelated Errors in Neural Networks for Time Series
- Recurrence-Complete Frame-based Action Models
- TimeGazer: Temporal Modeling of Predictive Gaze Stabilization for AR Interaction
- DPA-Net: A Dual-Path Attention Neural Network for Inferring Glycemic Control Metrics from Self-Monitored Blood Glucose Data
- Low-Latency Neural Inference on an Edge Device for Real-Time Handwriting Recognition from EEG Signals
- Improving Clinical Dataset Condensation with Mode Connectivity-based Trajectory Surrogates
- Forecasting-based Biomedical Time-series Data Synthesis for Open Data and Robust AI
- Glocal Information Bottleneck for Time Series Imputation
- Are Pre-trained Convolutions Better than Pre-trained Transformers?
- Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps
- Developing a Sequential Deep Learning Pipeline to Model Alaskan Permafrost Thaw Under Climate Change
- Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions
- Efficiently Generating Correlated Sample Paths from Multi-step Time Series Foundation Models
- Time-series forecasting with deep learning: a survey
- IR-UWB Radar-Based Contactless Silent Speech Recognition with Attention-Enhanced Temporal Convolutional Networks
- Physics-Informed Learning for Human Whole-Body Kinematics Prediction via Sparse IMUs
- Deep Learning-Based Prediction of Energy Decay Curves from Room Geometry and Material Properties
- HyMaTE: A Hybrid Mamba and Transformer Model for EHR Representation Learning
- Channel, Trend and Periodic-Wise Representation Learning for Multivariate Long-term Time Series Forecasting
- Revisiting Multivariate Time Series Forecasting with Missing Values
- Data-Driven Temperature Modelling of Machine Tools by Neural Networks: A Benchmark
- An Evaluation of Trajectory Prediction Approaches and Notes on the TrajNet Benchmark
- Causal Time Series Generation via Diffusion Models
- Why Attention Fails: The Degeneration of Transformers into MLPs in Time Series Forecasting
- DiffNator: Generating Structured Explanations of Time-Series Differences
- Long-Range Dependence in Financial Markets: Empirical Evidence and Generative Modeling Challenges
- Myosotis: structured computation for attention like layer
- TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation
- Effective Low-Cost Time-Domain Audio Separation Using Globally Attentive Locally Recurrent Networks
- Heterogeneous-Temporal Graph Convolutional Networks: Make the Community Detection Much Better
- Designing Practical Models for Isolated Word Visual Speech Recognition
- Merchant Category Identification Using Credit Card Transactions
- EPNE: Evolutionary Pattern Preserving Network Embedding
- Machine Learning-Based Performance Evaluation of a Solar-Powered Hydrogen Fuel Cell Hybrid in a Radio-Controlled Electric Vehicle
- Conv-like Scale-Fusion Time Series Transformer: A Multi-Scale Representation for Variable-Length Long Time Series
- TSGym: Design Choices for Deep Multivariate Time-Series Forecasting
- The SAGES Critical View of Safety Challenge: A Global Benchmark for AI-Assisted Surgical Quality Assessment
- Prospective Multi-Graph Cohesion for Multivariate Time Series Anomaly Detection
- Deep Learning Inductive Biases for fMRI Time Series Classification during Resting-state and Movie-watching
- Multi-Channel Differential ASR for Robust Wearer Speech Recognition on Smart Glasses
- Sequence to Point Learning Based on Bidirectional Dilated Residual Network for Non Intrusive Load Monitoring
- NORESQA: A Framework for Speech Quality Assessment using Non-Matching References
- R-Transformer: Recurrent Neural Network Enhanced Transformer
- Motion Estimation for Multi-Object Tracking using KalmanNet with Semantic-Independent Encoding
- LoadCNN: A Low Training Cost Deep Learning Model for Day-Ahead Individual Residential Load Forecasting
- Electric Vehicle Identification from Behind Smart Meter Data
- Trellis Networks for Sequence Modeling
- GTSForecaster: a novel deep learning based geodetic time series forecasting toolbox with python
- S2Transformer: Scalable Structured Transformers for Global Station Weather Forecasting
- Sandglasset: A Light Multi-Granularity Self-attentive Network For Time-Domain Speech Separation
- Towards Scalable and Structured Spatiotemporal Forecasting
- Forecasting Russian Equipment Losses Using Time Series and Deep Learning Models
- Real-E: A Foundation Benchmark for Advancing Robust and Generalizable Electricity Forecasting
- Write‐An‐Animation: High‐level Text‐based Animation Editing with Character‐Scene Interaction
- VARMA-Enhanced Transformer for Time Series Forecasting
- Masked multi-head self-attention for causal speech enhancement
- COBRA: Multimodal Sensing Deep Learning Framework for Remote Chronic Obesity Management via Wrist-Worn Activity Monitoring
- Improved memory in recurrent neural networks with sequential non-normal dynamics
- AR-KAN: Autoregressive-Weight-Enhanced Kolmogorov-Arnold Network for Time Series Forecasting
- Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors
- Improving noise robust automatic speech recognition with single-channel time-domain enhancement network
- A review of radar-based nowcasting of precipitation and applicable machine learning techniques
- Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognition
- Continuous Speech Recognition using EEG and Video
- One Size Does Not Fit All: Multi-Scale, Cascaded RNNs for Radar Classification
- Efficiently Modeling Long Sequences with Structured State Spaces
- Neural Rough Differential Equations for Long Time Series
- Mapping high-performance RNNs to in-memory neuromorphic chips
- Stable Recurrent Models
- Generative Foundation Model for Structured and Unstructured Electronic Health Records
- Time Series Based Network Intrusion Detection using MTF-Aided Transformer
- Exploring Over-stationarization in Deep Learning-based Bus/Tram Arrival Time Prediction: Analysis and Non-stationary Effect Recovery
- Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoders
- Quantum-Optimized Selective State Space Model for Efficient Time Series Prediction
- Multi-Ontology Integration with Dual-Axis Propagation for Medical Concept Representation
- Deep Generative Modelling of Human Reach-and-Place Action
- Causal Navigation by Continuous-time Neural Networks
- SincQDR-VAD: A Noise-Robust Voice Activity Detection Framework Leveraging Learnable Filters and Ranking-Aware Optimization
- ReLATE+: Unified Framework for Adversarial Attack Detection, Classification, and Resilient Model Selection in Time-Series Classification
- STDiff: A State Transition Diffusion Framework for Time Series Imputation in Industrial Systems
- Frozen in Time: Parameter-Efficient Time Series Transformers via Reservoir-Induced Feature Expansion and Fixed Random Dynamics
- IEA: Inner Ensemble Average within a convolutional neural network
- TransLLM: A Unified Multi-Task Foundation Framework for Urban Transportation via Learnable Prompting
- Organ-Agents: Virtual Human Physiology Simulator via LLMs
- Towards Practical Lipreading with Distilled and Efficient Models
- ERIS: An Energy-Guided Feature Disentanglement Framework for Out-of-Distribution Time Series Classification
- Interpreting Time Series Forecasts with LIME and SHAP: A Case Study on the Air Passengers Dataset
- Deep Relevance Ranking Using Enhanced Document-Query Interactions
- Physiology-informed layered sensing for intelligent human-exoskeleton interaction
- Improving Neural Language Models by Segmenting, Attending, and Predicting the Future
- TriForecaster: A Mixture of Experts Framework for Multi-Region Electric Load Forecasting with Tri-dimensional Specialization
- Learning from Multiple Time Series: A Deep Disentangled Approach to Diversified Time Series Forecasting
- Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention
- Spliced Binned-Pareto Distribution for Robust Modeling of Heavy-tailed\n Time Series
- Deep Determinantal Point Processes
- Comparative Analysis of Time Series Foundation Models for Demographic Forecasting: Enhancing Predictive Accuracy in US Population Dynamics
- Beyond Constant Parameters: Hyper Prediction Models and HyperMPC
- Architecture-Aware Generalization Bounds for Temporal Networks: Theory and Fair Comparison Methodology
- EnergyPatchTST: Multi-scale Time Series Transformers with Uncertainty Estimation for Energy Forecasting
- Salt-Rock Creep Deformation Forecasting Using Deep Neural Networks and Analytical Models for Subsurface Energy Storage Applications
- Supervised Dynamic Dimension Reduction with Deep Neural Network
- DeepKoopFormer: A Koopman Enhanced Transformer Based Architecture for Time Series Forecasting
- Detecting and measuring respiratory events in horses during exercise with a microphone: deep learning vs. standard signal processing
- Epi2-Net: Advancing Epidemic Dynamics Forecasting with Physics-Inspired Neural Networks
- User Trajectory Prediction Unifying Global and Local Temporal Information
- InfoSyncNet: Information Synchronization Temporal Convolutional Network for Visual Speech Recognition
- DMSC: Dynamic Multi-Scale Coordination Framework for Time Series Forecasting
- Flow Matching for Probabilistic Learning of Dynamical Systems from Missing or Noisy Data
- Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrations
- MoSSDA: A Semi-Supervised Domain Adaptation Framework for Multivariate Time-Series Classification using Momentum Encoder
- Towards Data-Driven Adaptive Exoskeleton Assistance for Post-stroke Gait
- Space-Time-Separable Graph Convolutional Network for Pose Forecasting
- Are Transformers Effective for Time Series Forecasting?
- Randomized Overdrive Neural Networks
- LiteFat: Lightweight Spatio-Temporal Graph Learning for Real-Time Driver Fatigue Detection
- RRTO: A High-Performance Transparent Offloading System for Model Inference in Mobile Edge Computing
- Measuring Dependencies between Biological Signals with Self-supervision, and its Limitations
- Diffusion Denoiser-Aided Gyrocompassing
- Adaptive Fuzzy Time Series Forecasting via Partially Asymmetric Convolution and Sub-Sliding Window Fusion
- Advances and Challenges in Deep Lip Reading
- A Simplified Fully Quantized Transformer for End-to-end Speech Recognition
- Residual Attention Net for Superior Cross-Domain Time Sequence Modeling
- Hybrid semantics-based vulnerability detection incorporating a Temporal Convolutional Network and Self-attention Mechanism
- DEEPF0: End-To-End Fundamental Frequency Estimation for Music and Speech Signals
- Zero-Shot Recommender Systems
- SPADE-S: A Sparsity-Robust Foundational Forecaster
- Beyond exploding and vanishing gradients: analysing RNN training using\n attractors and smoothness
- 3D Lip Event Detection via Interframe Motion Divergence at Multiple Temporal Resolutions
- Popularity Prediction on Social Platforms with Coupled Graph Neural Networks
- Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusion
Discussions
Related