Feiyu Duan
- D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
2024/06/03 by Haoran Que, Que, Haoran, Jiaheng Liu +29 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awareness
2024/10/09 by Zekun Wang, Wang, Zekun, Feiyu Duan +11 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Semantic Web and Ontologies
- LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation
2024/04/22 by Keheng Wang, Feiyu Duan, Wang, Keheng +7 · 2 citations
Computer Science · Decision Sciences · #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Library Science and Information Systems
- FRAME: Boosting LLMs with A Four-Quadrant Multi-Stage Pretraining Strategy
2025/02/08 by Zhang, Xuemiao, Feiyu Duan, Lei Xu +12 · 3 citations
Computer Science · #Natural Language Processing Techniques
- Preference Curriculum: LLMs Should Always Be Pretrained on Their Preferred Data
2025/01/21 by Lei Xu, Zhang, Xuemiao, Feiyu Duan +11 · 2 citations
Social Sciences · #Legal Education and Practice Innovations