Toward Code Generation: A Survey and Lessons from Semantic Parsing

2021/04/26 by Celine Lee, Justin Gottschlich, Lee, Celine +3
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Programming Languages (cs.PL) #Software Engineering (cs.SE) #Software Engineering Research #Software Testing and Debugging Techniques

paper · pdf · doi:10.48550/arxiv.2105.03317

openalex publication_date 2021/04/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

With the growth of natural language processing techniques and demand for improved software engineering efficiency, there is an emerging interest in translating intention from human languages to programming languages. In this survey paper, we attempt to provide an overview of the growing body of research in this space. We begin by reviewing natural language semantic parsing techniques and draw parallels with program synthesis efforts. We then consider semantic parsing works from an evolutionary perspective, with specific analyses on neuro-symbolic methods, architecture, and supervision. We then analyze advancements in frameworks for semantic parsing for code generation. In closing, we present what we believe are some of the emerging open challenges in this domain.

Citations

• Learning to Map Sentences to Logical Form: Structured Classification\n with Probabilistic Categorial Grammars
• Language to Logical Form with Neural Attention
• Incorporating Copying Mechanism in Sequence-to-Sequence Learning
• Latent Predictor Networks for Code Generation
• DeepCoder: Learning to Write Programs
• A Syntactic Neural Model for General-Purpose Code Generation
• Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
• Coarse-to-Fine Decoding for Neural Semantic Parsing
• Learning Dependency-Based Compositional Semantics
• Neo

Related

• A Syntactic Neural Model for General-Purpose Code Generation
• Program Synthesis and Semantic Parsing with Learned Code Idioms
• A Survey on Semantic Parsing
• Neural Models for Source Code Synthesis and Completion
• Bridging Code Semantic and LLMs: Semantic Chain-of-Thought Prompting for Code Generation