Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

2014/01/01 by Kyunghyun Cho, Bart van Merriënboer, Çağlar Gülçehre +4 · 184 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis

paper · pdf · doi:10.3115/v1/d14-1179

openalex publication_date 2014/01/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/04

Abstract

Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.

Citations

• ADADELTA: An Adaptive Learning Rate Method
• Theano: new features and speed improvements
• Learning Semantic Representations for the Phrase Translation Model
• Long Short-Term Memory
• Distributed Representations of Words and Phrases and their Compositionality
• ImageNet classification with deep convolutional neural networks

Cited by

• Real-time structural damage assessment using LSTM networks: regression and classification approaches
• Sphere Retraction Normalizations
• A Self-Correcting Deep Learning Approach to Predict Acute Conditions in Critical Care
• On Subquadratic Architectures: From Applications to Principles
• The Differentiable Cross-Entropy Method
• Reconstructing and forecasting disease trajectories of patients with Alzheimer's disease using routine data in resource-constrained settings
• Hybrid Hidden Markov Model for Modeling Equity Excess Growth Rate Dynamics: A Discrete-State Approach with Jump-Diffusion
• Hop-Hop Relation-aware Graph Neural Networks
• Online Sequence Training of Recurrent Neural Networks with Connectionist Temporal Classification
• Conversational Response Re-ranking Based on Event Causality and Role Factored Tensor Event Embedding
• COMIC: Toward A Compact Image Captioning Model With Attention
• Fully Bayesian Recurrent Neural Networks for Safe Reinforcement Learning
• Constructing Gradient Controllable Recurrent Neural Networks Using Hamiltonian Dynamics
• Scyclone: High-Quality and Parallel-Data-Free Voice Conversion Using Spectrogram and Cycle-Consistent Adversarial Networks
• Introduction to Neural Network based Approaches for Question Answering over Knowledge Graphs
• FastFusionNet: New State-of-the-Art for DAWNBench SQuAD
• Rethinking Time Encoding via Learnable Transformation Functions
• Parallelizing Word2Vec in Shared and Distributed Memory
• A Miniature Brain Transformer: Thalamic Gating, Hippocampal Lateralization, Amygdaloid Salience, and Prefrontal Working Memory in Attention-Coupled Latent Memory
• Market Informedness and Market-Maker Profitability: The Trade-Off Between Adverse Selection and Price Discovery
• Code Representation Learning with Prüfer Sequences
• Multitask Adaptation by Retrospective Exploration with Learned World Models
• Language coverage and generalization in RNN-based continuous sentence embeddings for interacting agents
• Fast Transient Simulation of High-Speed Channels Using Recurrent Neural Network
• Automated labeling of bugs and tickets using attention-based mechanisms in recurrent neural networks
• Unsupervised Bilingual Lexicon Induction Across Writing Systems
• Deep segmental phonetic posterior-grams based discovery of non-categories in L2 English speech
• Generating Question Relevant Captions to Aid Visual Question Answering
• A Novel Technique for Evidence based Conditional Inference in Deep Neural Networks via Latent Feature Perturbation
• Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation
• Online Multiple Object Tracking with Cross-Task Synergy
• Hallucinating Optical Flow Features for Video Classification
• Latent Variable Session-Based Recommendation
• On the retraining frequency of global models in retail demand forecasting
• Learning A Physical Long-term Predictor
• Neural information retrieval: at the end of the early years
• Hierarchical Neural Circuit Theory of Normalization and Inter-areal Communication
• DLTPy: Deep Learning Type Inference of Python Function Signatures using Natural Language Context
• Auxiliary Tasks and Exploration Enable ObjectNav
• Answering while Summarizing: Multi-task Learning for Multi-hop QA with Evidence Extraction
• Annotation Order Matters: Recurrent Image Annotator for Arbitrary Length Image Tagging
• Population-Scale Advancing Interface Modeling Reveals How Bacterial Swarms Encode Future Spatial Architecture
• CHASE: Competing Hypotheses for Ambiguity-Aware Selective Prediction
• Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding
• Nonlinear and Heavy-Tailed Predictability in Transition-Energy Financial Markets
• Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipeline
• Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces
• Locating Faulty Methods with a Mixed RNN and Attention Model
• Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting
• DeltaDPD: Exploiting Dynamic Temporal Sparsity in Recurrent Neural Networks for Energy-Efficient Wideband Digital Predistortion
• IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem
• MUFASA: A Multi-Layer Framework for Slot Attention
• An End-to-End Framework for Optimizing Foot Trajectory and Force in Dry Adhesion Legged Wall-Climbing Robots
• Robotic Trail Maker Platform for Rehabilitation in Neurological Conditions: Clinical Use Cases
• Learning to Rank Critical Road Segments via Heterogeneous Graphs with OD Flow Integration
• Neural posterior estimation of the neutrino direction in IceCube using transformer-encoded normalizing flows on the sphere
• Deep Learning for Electricity Price Forecasting: A Review of Day-Ahead, Intraday, and Balancing Electricity Markets
• Deep Learning
• A solver-in-the-loop framework for end-to-end differentiable coastal hydrodynamics
• Energy-Based Dynamical Models for Neurocomputation, Learning, and Optimization
• Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbo
• An Empirical Study of Language CNN for Image Captioning
• Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos
• Estimating the Conditional Forecast-Revision Scale in Sequential Models: Local-Smoothing Limits, Matched Models, and Cost--Accuracy Trade-offs
• Predicting Early and Complete Drug Release from Long-Acting Injectables Using Explainable Machine Learning
• IntrinSeqNet: Learning to Estimate the Reflectance from Varying Illumination
• Catplayinginthesnow: Impact of Prior Segmentation on a Model of Visually Grounded Speech
• Data Movement Is All You Need: A Case Study on Optimizing Transformers
• On the use of case estimate and transactional payment data in neural networks for individual loss reserving
• RAGAT-Mind: A Multi-Granular Modeling Approach for Rumor Detection Based on MindSpore
• Refining Source Representations with Relation Networks for Neural Machine Translation
• A Deep Decoder Structure Based on WordEmbedding Regression for An Encoder-Decoder Based Model for Image Captioning
• Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks
• Deep learning
• Low-Resource Knowledge-Grounded Dialogue Generation
• Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization
• Improving Significant Wave Height Prediction Using Chronos Models
• Balancing Cost and Benefit with Tied-Multi Transformers
• 2D LiDAR Map Prediction via Estimating Motion Flow with GRU
• Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge
• mmFall: Fall Detection using 4D MmWave Radar and a Hybrid Variational RNN AutoEncoder
• Spatio-Temporal Neural Network for Fitting and Forecasting COVID-19
• Accurately and Efficiently Interpreting Human-Robot Instructions of Varying Granularities
• Improving the Robustness of Speech Translation
• An Improvement of Data Classification Using Random Multimodel Deep Learning (RMDL)
• Unifying Physics- and Data-Driven Modeling via Novel Causal Spatiotemporal Graph Neural Network for Interpretable Epidemic Forecasting
• SemCo: Toward Semantic Coherent Visual Relationship Forecasting
• Representation Learning for Natural Language Processing
• An Efficient Approach to Boosting Performance of Deep Spiking Network\n Training
• Wavelet-Enhanced Sequence-to-Sequence Modeling with Attention Mechanism for Short-Term Wind Power Forecasting
• Visual Depth Mapping from Monocular Images using Recurrent Convolutional Neural Networks
• Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrieval
• Deep Reinforcement Learning for Visual Object Tracking in Videos
• Deep Knowledge Tracing with Side Information
• Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification
• Lindblad-Inspired Multi-Timescale Reservoir Computing with Separable Rotation and Dissipation
• BashCoder-R1: Towards Robust and Explainable Bash Code Generation with Robustness-Aware Group Relative Policy Optimization
• mSHINE: A Multiple-meta-paths Simultaneous Learning Framework for Heterogeneous Information Network Embedding
• On Automatic Parsing of Log Records
• A Novel Hybrid Approach Using an Attention-Based Transformer + GRU Model for Predicting Cryptocurrency Prices
• Enhancing interpretability in neural networks for nuclear power plant fault diagnosis: A comprehensive analysis and improvement approach
• Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation Model
• When FastText Pays Attention: Efficient Estimation of Word Representations using Constrained Positional Weighting
• MVQA: Mamba with Unified Sampling for Efficient Video Quality Assessment
• Dynamic population-based meta-learning for multi-agent communication\n with natural language
• Semi-supervised Phoneme Recognition with Recurrent Ladder Networks
• Modeling Semantics with Gated Graph Neural Networks for Knowledge Base\n Question Answering
• Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimization
• FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection
• Hierarchical Hidden Markov Jump Processes for Cancer Screening Modeling
• Neural Rating Regression with Abstractive Tips Generation for Recommendation
• Deep Learning based Channel Estimation Algorithm over Time Selective Fading Channels
• Retrieving Complex Tables with Multi-Granular Graph Representation Learning
• Deep reinforcement learning with shallow controllers: An experimental application to PID tuning
• SiTGRU: Single-Tunnelled Gated Recurrent Unit for Abnormality Detection
• Matching Algorithms: Fundamentals, Applications and Challenges
• Development of a real-time posture feedback system with integrated human motion prediction for proactive intervention in work-related musculoskeletal disorders
• Investigating Catastrophic Forgetting During Continual Training for Neural Machine Translation
• Learning from Few Samples: A Survey
• Multimodal Perception for Goal-oriented Navigation: A Survey
• DERD-Net: Learning Depth from Event-based Ray Densities
• A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks
• Improving Sound Source Localization with Joint Slot Attention on Image and Audio
• Human-Level Competitive Pokémon via Scalable Offline Reinforcement Learning with Transformers
• Aspect Category Detection via Topic-Attention Network
• RECKONition: a NLP-based system for Industrial Accidents at Work Prevention
• ReWE: Regressing Word Embeddings for Regularization of Neural Machine Translation Systems
• Data-driven Regularization via Racecar Training for Generalizing Neural Networks
• Deep Learning-Based Vehicle Behavior Prediction for Autonomous Driving Applications: A Review
• Watch It Twice: Video Captioning with a Refocused Video Encoder
• Siamese recurrent networks learn first-order logic reasoning and exhibit zero-shot compositional generalization
• Attention-based Quantum Tomography
• Efficient Target Activity Detection based on Recurrent Neural Networks
• Improving Sequential Recommenders through Counterfactual Augmentation of System Exposure
• Session-Based Recommendation with Graph Neural Networks
• Disentangling neural mechanisms for perceptual grouping
• A Recurrent CNN for Automatic Detection and Classification of Coronary Artery Plaque and Stenosis in Coronary CT Angiography
• Priberam at MESINESP Multi-label Classification of Medical Texts Task
• Understanding Feature Selection and Feature Memorization in Recurrent Neural Networks
• Differentiable programming and its applications to dynamical systems
• An Empirical Investigation of Pre-Trained Transformer Language Models for Open-Domain Dialogue Generation
• Introducing Fuzzy Layers for Deep Learning
• Multi-year long-term load forecast for area distribution feeders based on selective sequence learning
• Sequence-to-sequence models for workload interference prediction on batch processing datacenters
• Self-Supervised VQ-VAE for One-Shot Music Style Transfer
• Learning robust perceptive locomotion for quadrupedal robots in the wild
• Disinformation, Misinformation, and Fake News in Social Media
• An Overview of Computational Approaches for Interpretation Analysis
• Deep learning in remote sensing applications: A meta-analysis and review
• Recurrent Batch Normalization
• Machine Translation using Semantic Web Technologies: A Survey
• Soft Hierarchical Graph Recurrent Networks for Many-Agent Partially Observable Environments
• Re-entry Prediction for Online Conversations via Self-Supervised Learning
• Sequence-based dynamic handwriting analysis for Parkinson’s disease detection with one-dimensional convolutions and BiGRUs
• Tag-less back-translation
• Neural Machine Translation: A Review of Methods, Resources, and Tools
• Chinese Medical Question Answer Matching based on Interactive Sentence Representation Learning
• A Survey of Orthographic Information in Machine Translation
• Enhanced Modality Transition for Image Captioning
• Recurrent neural network-based volumetric fluorescence microscopy
• A synthetic dataset of French electric load curves with temperature conditioning
• Prototypes are Balanced Units for Efficient and Effective Partially Relevant Video Retrieval
• Rethinking Temporal Fusion with a Unified Gradient Descent View for 3D Semantic Occupancy Prediction
• MAIN: Mutual Alignment Is Necessary for instruction tuning
• Classification-Based Analysis of Price Pattern Differences Between Cryptocurrencies and Stocks
• Machine learning in flight parameter-based structural load prediction: A review and framework proposal
• Quantum-Structured World Models (QSWMs) for Predictive Latent Dynamics
• Reinforcement Learning of Graph Neural Networks for Service Function Chaining
• MInCo: Mitigating Information Conflicts in Distracted Visual Model-based Reinforcement Learning
• Trajectory Encoding Temporal Graph Networks
• C-SHAP for time series: An approach to high-level temporal explanations
• STaRFormer: Semi-Supervised Task-Informed Representation Learning via Dynamic Attention-Based Regional Masking for Sequential Data
• SeizureFormer: A Transformer Model for IEA-Based Seizure Risk Forecasting
• Online Regularization of Complex-Valued Neural Networks for Structure Optimization in Wireless-Communication Channel Prediction
• Graph Learning-Driven Multi-Vessel Association: Fusing Multimodal Data for Maritime Intelligence
• Accurate Discharge Coefficient Prediction of Streamlined Weirs by Coupling Linear Regression and Deep Convolutional Gated Recurrent Unit
• SRVP: Strong Recollection Video Prediction Model Using Attention-Based Spatiotemporal Correlation Fusion
• Latent Space Cartography: Generalised Metric-Inspired Measures and Measure-Based Transformations for Generative Models
• Diversity-aware Dual-promotion Poisoning Attack on Sequential Recommendation
• LIAF-Net: Leaky Integrate and Analog Fire Network for Lightweight and Efficient Spatiotemporal Information Processing
• Temporal Dynamic Embedding for Irregularly Sampled Time Series
• Grouped Target Tracking and Seamless People Counting with a 24 GHz MIMO FMCW
• Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehicles
• History of machine translation [wikipedia]

Related

• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Machine Translation : From Statistical to modern Deep-learning practices
• Classification-based RNN machine translation using GRUs
• Learning Semantic Representations for the Phrase Translation Model
• Recurrent Neural Network Grammars