Taylor Berg-Kirkpatrick
- Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation
2022/11/12 by Yusong Wu, Ke Chen, Wu, Yusong +10 · 233 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Towards a Unified View of Parameter-Efficient Transfer Learning
2021/10/08 by Junxian He, Chunting Zhou, He, Junxian +7 · 93 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Speaker-Follower Models for Vision-and-Language Navigation
2018/06/07 by Daniel Fried, Fried, Daniel, Ronghang Hu +17 · 36 citations
Computer Science · #Speech and dialogue systems #Natural Language Processing Techniques #Speech Recognition and Synthesis
- HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection
2022/02/02 by Ke Chen, Chen, Ke, Xingjian Du +9 · 41 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks
2022/03/08 by Fatemehsadat Mireshghallah, Kartik Goyal, Mireshghallah, Fatemehsadat +7 · 30 citations
Computer Science · #Privacy-Preserving Technologies in Data
- MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategies
2023/08/03 by Ke Chen, Chen, Ke, Yusong Wu +9 · 27 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Optical Context Compression Is Just (Bad) Autoencoding
2025/12/03 by Ivan Yee Lee, Ivan Lee, Lee, Ivan Yee +4 · 4 voices
Computer Science · #Advanced Data Compression Techniques #Algorithms and Data Compression #Generative Adversarial Networks and Image Synthesis #cs.CL #cs.CV #cs.LG
- Lagging Inference Networks and Posterior Collapse in Variational Autoencoders
2019/01/16 by Junxian He, Daniel Spokoyny, He, Junxian +5 · 16 citations
Computer Science · Physics and Astronomy · #Generative Adversarial Networks and Image Synthesis #Model Reduction and Neural Networks #Gaussian Processes and Bayesian Inference
- DITTO: Diffusion Inference-Time T-Optimization for Music Generation
2024/01/22 by Zachary Novack, Novack, Zachary, Julian McAuley +5 · 22 citations
Computer Science · Neuroscience · #Music and Audio Processing #Music Technology and Sound Studies #Neuroscience and Music Perception
- Grammar-Aligned Decoding
2024/05/31 by Kanghee Park, Park, Kanghee, Jiayu Wang +8 · 2 voices · 15 citations
Computer Science · #Natural Language Processing Techniques
- Learning-Based Single-Document Summarization with Compression and Anaphoricity Constraints
2016/03/29 by Greg Durrett, Taylor Berg-Kirkpatrick, Durrett, Greg +3 · 10 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text and Document Classification Technologies #Topic Modeling
- Imprompter: Tricking LLM Agents into Improper Tool Use
2024/10/19 by Xiaohan Fu, Shuheng Li, Fu, Xiaohan +11 · 22 citations
Business, Management and Accounting · Computer Science · #Business Process Modeling and Analysis #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation #Service-Oriented Architecture and Web Services
- Efficient Nearest Neighbor Language Models
2021/09/09 by Junxian He, Graham Neubig, He, Junxian +3 · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Universal Source Separation with Weakly Labelled Data
2023/05/11 by Qiuqiang Kong, Kong, Qiuqiang, Ke Chen +11 · 10 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos
2022/12/14 by Hao‐Wen Dong, Naoya Takahashi, Dong, Hao-Wen +7 · 8 citations
Computer Science · Engineering · #Acoustic Wave Phenomena Research #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data
2021/12/15 by Ke Chen, Xingjian Du, Chen, Ke +9 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Prompt Consistency for Zero-Shot Task Generalization
2022/04/29 by Chunting Zhou, Junxian He, Zhou, Chunting +7 · 6 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Privacy Regularization: Joint Privacy-Utility Optimization in Language Models
2021/03/12 by Fatemehsadat Mireshghallah, Huseyin A. Inan, Mireshghallah, Fatemehsadat +9 · 5 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data
- PDMX: A Large-Scale Public Domain MusicXML Dataset for Symbolic Music Processing
2024/09/17 by P. E. Long, Phillip Long, Zachary Novack +2 · 1 voice · 7 citations
Computer Science · Neuroscience · #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #cs.AI #cs.LG #cs.MM #cs.SD #eess.AS
- Unsupervised Text Style Transfer using Language Models as Discriminators
2018/05/30 by Zichao Yang, Zhiting Hu, Yang, Zichao +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- DITTO-2: Distilled Diffusion Inference-Time T-Optimization for Music Generation
2024/05/30 by Zachary Novack, Julian McAuley, Novack, Zachary +5 · 9 citations
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD)
- MusPy: A Toolkit for Symbolic Music Generation
2020/08/05 by Hao‐Wen Dong, Ke Chen, Dong, Hao-Wen +5 · 3 citations
Computer Science · Neuroscience · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD) #electronic engineering #information engineering
- Misusing Tools in Large Language Models With Visual Adversarial Examples
2023/10/04 by Xiaohan Fu, Zihan Wang, Fu, Xiaohan +11 · 5 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Topic Modeling
- Paraphrastic Representations at Scale
2021/04/30 by John Wieting, Kevin Gimpel, Wieting, John +5 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Multitrack Music Transformer
2022/07/14 by Hao‐Wen Dong, Dong, Hao-Wen, Ke Chen +7 · 4 citations
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD) #electronic engineering #information engineering
- Are you really listening? Boosting Perceptual Awareness in Music-QA Benchmarks
2025/04/01 by Yongyi Zang, Sean O’Brien, Zang, Yongyi +7 · 12 citations
Computer Science · Social Sciences · #Music and Audio Processing #Topic Modeling #Computational and Text Analysis Methods
- MORL-Prompt: An Empirical Analysis of Multi-Objective Reinforcement Learning for Discrete Prompt Optimization
2024/02/18 by Yasaman Jafari, Jafari, Yasaman, Dheeraj Mekala +5 · 5 citations
Computer Science · #Computation and Language (cs.CL) #Evolutionary Algorithms and Applications #FOS: Computer and information sciences
- Deep Performer: Score-to-Audio Music Performance Synthesis
2022/02/12 by Hao‐Wen Dong, Dong, Hao-Wen, Cong Zhou +5 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Presto! Distilling Steps and Layers for Accelerating Music Generation
2024/10/07 by Zachary Novack, Novack, Zachary, Ge Zhu +9 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Sound (cs.SD) #electronic engineering #information engineering
- Generating Symbolic Music from Natural Language Prompts using an LLM-Enhanced Dataset
2023/12/31 by Weihan Xu, Xu, Weihan, McAuley, Julian +5 · 4 citations
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Smaller Language Models are Better Black-box Machine-Generated Text Detectors
2023/05/17 by Mireshghallah, Niloofar, Justus Mattern, Sicun Gao +6 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis
2021/10/01 by Fatemehsadat Mireshghallah, Mireshghallah, Fatemehsadat, Vaishnavi Shrivastava +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Recommender Systems and Techniques #Sentiment Analysis and Opinion Mining #Topic Modeling
- Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability
2023/10/12 by Ivan Lee, Nan Jiang, Lee, Ivan +3 · 3 citations
Computer Science · Social Sciences · #Education and Learning Interventions #Educational Research and Pedagogy #FOS: Computer and information sciences #Higher Education Learning Practices #Machine Learning (cs.LG)
- Constrained Adaptive Rejection Sampling
2025/10/02 by Paweł Parys, Parys, Paweł, Sairam Vaidya +5 · 2 voices · 1 citation
#cs.AI #cs.CL #cs.LG
- Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation
2024/11/01 by Bohan Lyu, Yadi Cao, Lyu, Bohan +11 · 2 voices · 3 citations
Computer Science · #Semantic Web and Ontologies #cs.AI #cs.CL #cs.LG
- A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text
2019/09/02 by Bohan Li, Junxian He, Li, Bohan +7 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Healthcare #Natural Language Processing Techniques #Topic Modeling
- Visual Referring Expression Recognition: What Do Systems Actually Learn?
2018/05/30 by Volkan Cirik, Louis‐Philippe Morency, Cirik, Volkan +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- An Empirical Investigation of Contextualized Number Prediction
2020/10/20 by Daniel Spokoyny, Spokoyny, Daniel, Taylor Berg-Kirkpatrick +1 · 1 citation
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #Computational Physics and Python Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Continuous Diffusion Models Can Obey Formal Syntax
2026/02/12 by Jinwoo Kim, Taylor Berg-Kirkpatrick, Loris D'Antoni · 2 voices
Computer Science · #cs.LG #cs.FL
- Using Syntax to Ground Referring Expressions in Natural Images
2018/05/26 by Volkan Cirik, Taylor Berg-Kirkpatrick, Cirik, Volkan +3 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE)
- Contrastive Attention Networks for Attribution of Early Modern Print
2023/06/12 by Nikolai Vogler, Kartik Goyal, Vogler, Nikolai +13 · 1 citation
Computer Science · Arts and Humanities · #Image Processing and 3D Reconstruction #Handwritten Text Recognition Techniques #Digital Humanities and Scholarship
- Checklist Models for Improved Output Fluency in Piano Fingering Prediction
2022/09/12 by Nikita Srivatsan, Taylor Berg-Kirkpatrick, Srivatsan, Nikita +1 · 1 citation
Computer Science · Neuroscience · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception
- Clustering Running Titles to Understand the Printing of Early Modern Books
2024/05/01 by Nikolai Vogler, Kartik Goyal, Vogler, Nikolai +11 · 1 citation
Arts and Humanities · Social Sciences · #Digital Humanities and Scholarship #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Historical Influence and Diplomacy #Renaissance Literature and Culture