PromDA: Prompt-based Data Augmentation for Low-Resource NLU Tasks

2022/02/25 by Yufei Wang, Can Xu, Wang, Yufei +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2202.12499

openalex publication_date 2022/02/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper focuses on the Data Augmentation for low-resource Natural Language Understanding (NLU) tasks. We propose Prompt-based Data Augmentation model (PromDA) which only trains small-scale Soft Prompt (i.e., a set of trainable vectors) in the frozen Pre-trained Language Models (PLMs). This avoids human effort in collecting unlabeled in-domain data and maintains the quality of generated synthetic data. In addition, PromDA generates synthetic data via two different views and filters out the low-quality data using NLU models. Experiments on four benchmarks show that synthetic data produced by PromDA successfully boost up the performance of NLU models which consistently outperform several competitive baseline models, including a state-of-the-art semi-supervised model using unlabeled in-domain data. The synthetic data from PromDA are also complementary with unlabeled in-domain data. The NLU models can be further improved when they are combined for training.

Cited by

• An Interpretability-Guided Framework for Responsible Synthetic Data Generation in Emotional Text
• Decoupling Augmentation Bias in Prompt Learning for Vision-Language Models
• Multi-refined Feature Enhanced Sentiment Analysis Using Contextual Instruction
• Filtering with Confidence: When Data Augmentation Meets Conformal Prediction

Related

• PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners
• CoDa: Constrained Generation based Data Augmentation for Low-Resource NLP
• A Survey on Recent Approaches for Natural Language Processing in\n Low-Resource Scenarios
• KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Low-Resource NLP
• Not Enough Data? Deep Learning to the Rescue!