vix.ing · top · new · best · stats · spec

Morency, Louis-Philippe

  1. Multimodal Machine Learning: A Survey and Taxonomy
    2017/05/26 by Tadas Baltrušaitis, Baltrušaitis, Tadas, Chaitanya Ahuja +3 · 1 voice · 116 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.LG
  2. Multimodal Transformer for Unaligned Multimodal Language Sequences
    2019/06/01 by Tsai, Yao-Hung Hubert, Bai, Shaojie, Liang, Paul Pu +3 · 94 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  3. Tensor Fusion Network for Multimodal Sentiment Analysis
    2017/07/23 by Zadeh, Amir, Chen, Minghai, Poria, Soujanya +2 · 50 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  4. Efficient Low-rank Multimodal Fusion with Modality-Specific Factors
    2018/05/31 by Zhun Liu, Ying Shen, Liu, Zhun +9 · 44 citations
    Computer Science · Psychology · #Sentiment Analysis and Opinion Mining #Emotion and Mood Recognition #Multimodal Machine Learning Applications
  5. SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents
    2023/10/18 by Xuhui Zhou, Hao Zhu, Zhou, Xuhui +19 · 54 citations
    Computer Science · #Topic Modeling #Multi-Agent Systems and Negotiation #Natural Language Processing Techniques
  6. Speaker-Follower Models for Vision-and-Language Navigation
    2018/06/07 by Daniel Fried, Ronghang Hu, Fried, Daniel +17 · 27 citations
    Computer Science · #Speech and dialogue systems #Natural Language Processing Techniques #Speech Recognition and Synthesis
  7. Memory Fusion Network for Multi-view Sequential Learning
    2018/02/03 by Amir Zadeh, Zadeh, Amir, Paul Pu Liang +9 · 25 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning and ELM
  8. MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
    2021/07/15 by Liang, Paul Pu, Lyu, Yiwei, Fan, Xiang +9 · 27 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
  9. Language2Pose: Natural Language Grounded Pose Forecasting
    2019/07/02 by Ahuja, Chaitanya, Morency, Louis-Philippe · 20 citations
    #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  10. Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
    2022/09/07 by Paul Pu Liang, Liang, Paul Pu, Amir Zadeh +3 · 25 citations
    Computer Science · #Speech and dialogue systems #Topic Modeling
  11. Towards Understanding and Mitigating Social Biases in Language Models
    2021/06/24 by Liang, Paul Pu, Wu, Chiyu, Morency, Louis-Philippe +1 · 19 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  12. Think Locally, Act Globally: Federated Learning with Local and Global Representations
    2020/01/06 by Paul Pu Liang, Liang, Paul Pu, Terrance Liu +13 · 16 citations
    Computer Science · Social Sciences · #Distributed #FOS: Computer and information sciences #Human Mobility and Location-Based Analysis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
  13. Learning Factorized Multimodal Representations
    2018/06/16 by Yao-Hung Hubert Tsai, Tsai, Yao-Hung Hubert, Paul Pu Liang +7 · 17 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Sentiment Analysis and Opinion Mining #Topic Modeling
  14. Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework
    2023/02/23 by Paul Pu Liang, Liang, Paul Pu, Yun Cheng +19 · 21 citations
    Computer Science · #Topic Modeling #Machine Learning in Healthcare #Explainable Artificial Intelligence (XAI)
  15. Towards Debiasing Sentence Representations
    2020/07/16 by Paul Pu Liang, Liang, Paul Pu, Irene Li +9 · 14 citations
    Computer Science · #Topic Modeling #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques
  16. Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalities
    2018/12/19 by Hai Pham, Paul Pu Liang, Pham, Hai +7 · 12 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Sentiment Analysis and Opinion Mining #Topic Modeling
  17. Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
    2023/06/08 by Liang, Paul Pu, Deng, Zihao, Ma, Martin +3 · 20 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM)
  18. Transformer Dissection: A Unified Understanding of Transformer's\n Attention via the Lens of Kernel
    2019/08/30 by Yao-Hung Hubert Tsai, Shaojie Bai, Tsai, Yao-Hung Hubert +7 · 11 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  19. Embodied AI Agents: Modeling the World
    2025/06/27 by Pascale Fung, Fung, Pascale, Yoram Bachrach +39 · 1 voice · 20 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #cs.AI
  20. Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities
    2023/11/16 by Alex Wilf, Sihyun Shawn Lee, Wilf, Alex +5 · 14 citations
    Computer Science · Social Sciences · #Topic Modeling #Computational and Text Analysis Methods #Explainable Artificial Intelligence (XAI)
  21. DIME: Fine-grained Interpretations of Multimodal Models via Disentangled Local Explanations
    2022/03/03 by Yiwei Lyu, Paul Pu Liang, Lyu, Yiwei +7 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
  22. Multi-attention Recurrent Network for Human Communication Comprehension
    2018/02/03 by Zadeh, Amir, Liang, Paul Pu, Poria, Soujanya +3 · 5 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  23. Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis
    2022/10/10 by Xiao, Yuxin, Liang, Paul Pu, Bhatt, Umang +3 · 7 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  24. Deep Gamblers: Learning to Abstain with Portfolio Theory
    2019/06/29 by Liu Ziyin, Zhikang Wang, Ziyin, Liu +9 · 5 citations
    Economics, Econometrics and Finance · Engineering · #FOS: Computer and information sciences #Financial Markets and Investment Strategies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reservoir Engineering and Simulation Methods #Sports Analytics and Performance
  25. MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts
    2023/11/16 by Haofei Yu, Yu, Haofei, Qi, Zhengyang +7 · 8 citations
    Computer Science · Psychology · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language, Metaphor, and Cognition #Multimodal Machine Learning Applications #Topic Modeling
  26. Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions
    2024/04/17 by Mathur, Leena, Liang, Paul Pu, Morency, Louis-Philippe · 10 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG)
  27. Understanding Masked Autoencoders via Hierarchical Latent Variable Models
    2023/06/08 by Lingjing Kong, Martin Q. Ma, Kong, Lingjing +11 · 7 citations
    Computer Science · Engineering · #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning #Image Processing Techniques and Applications
  28. Learning Representations from Imperfect Time Series Data via Tensor Rank\n Regularization
    2019/07/01 by Paul Pu Liang, Zhun Liu, Liang, Paul Pu +9 · 4 citations
    Computer Science · Mathematics · #Computation and Language (cs.CL) #Computational Physics and Python Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Tensor decomposition and applications #Topic Modeling
  29. Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment
    2022/12/20 by Rohan Pandey, Rulin Shao, Pandey, Rohan +7 · 5 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  30. Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning
    2018/02/03 by Chen, Minghai, Wang, Sen, Liang, Paul Pu +3 · 3 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  31. Multimodal Language Analysis with Recurrent Multistage Fusion
    2018/08/12 by Liang, Paul Pu, Liu, Ziyin, Zadeh, Amir +1 · 3 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
  32. Conditional Contrastive Learning for Improving Fairness in Self-Supervised Learning
    2021/06/05 by Ma, Martin Q., Tsai, Yao-Hung Hubert, Liang, Paul Pu +4 · 3 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  33. Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications
    2023/06/07 by Liang, Paul Pu, Ling, Chun Kai, Cheng, Yun +6 · 4 citations
    #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  34. Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventions
    2023/06/07 by Thakur, Himanshu, Jain, Atishay, Vaddamanu, Praneetha +2 · 4 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  35. Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors
    2018/11/23 by Yansen Wang, Ying Shen, Wang, Yansen +9 · 3 citations
    Computer Science · Psychology · #Sentiment Analysis and Opinion Mining #Emotion and Mood Recognition #Topic Modeling
  36. MultiViz: Towards Visualizing and Understanding Multimodal Models
    2022/06/30 by Paul Pu Liang, Yiwei Lyu, Liang, Paul Pu +13 · 3 citations
    Computer Science · #Explainable Artificial Intelligence (XAI) #Software Engineering Research #Anomaly Detection Techniques and Applications
  37. High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-Modality Representation Learning
    2022/03/02 by Paul Pu Liang, Yiwei Lyu, Liang, Paul Pu +13 · 3 citations
    Computer Science · #Speech and dialogue systems #Multimodal Machine Learning Applications #Music and Audio Processing
  38. Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
    2025/02/10 by Ce Zhang, Zhang, Ce, Zifu Wan +17 · 8 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Neuroscience · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Fractal and DNA sequence analysis #Topological and Geometric Data Analysis
  39. Social Genome: Grounded Social Reasoning Abilities of Multimodal Models
    2025/02/21 by Mathur, Leena, Qian, Marian, Liang, Paul Pu +1 · 8 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  40. Neural Methods for Point-wise Dependency Estimation
    2020/06/09 by Tsai, Yao-Hung Hubert, Zhao, Han, Yamada, Makoto +2 · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Methodology (stat.ME)
  41. AV-Flow: Transforming Text to Audio-Visual Human-like Interactions
    2025/02/18 by Chatziagapi, Aggelina, Morency, Louis-Philippe, Gong, Hongyu +3 · 5 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  42. Propose, Solve, Verify: Self-Play Through Formal Verification
    2025/12/20 by Alex Wilf, Wilf, Alex, Pranjal Aggarwal +11 · 4 voices
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #cs.AI
  43. Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset
    2025/06/27 by Vasu Agrawal, Akinniyi Akinyemi, Agrawal, Vasu +165 · 1 voice · 4 citations
    #cs.CV #cs.AI
  44. GazeDirector: Fully Articulated Eye Gaze Redirection in Video
    2017/04/27 by Wood, Erroll, Baltrusaitis, Tadas, Morency, Louis-Philippe +2 · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  45. HEMM: Holistic Evaluation of Multimodal Foundation Models
    2024/07/03 by Paul Pu Liang, Liang, Paul Pu, Akshay Goindani +11 · 3 citations
    Engineering · #BIM and Construction Integration
  46. Strong and Simple Baselines for Multimodal Utterance Embeddings
    2019/05/14 by Liang, Paul Pu, Lim, Yao Chong, Tsai, Yao-Hung Hubert +2 · 1 citation
    #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sound (cs.SD) #electronic engineering #information engineering
  47. LlaMADRS: Prompting Large Language Models for Interview-Based Depression Assessment
    2025/01/07 by Kebe, Gaoussou Youssouf, Girard, Jeffrey M., Liebenthal, Einat +3 · 4 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #I.2.7
  48. What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
    2020/07/07 by Yang, Jianing, Zhu, Yuying, Wang, Yongxin +3 · 1 citation
    #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  49. Self-supervised Representation Learning with Relative Predictive Coding
    2021/03/21 by Tsai, Yao-Hung Hubert, Ma, Martin Q., Yang, Muqiao +3 · 1 citation
    #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG)
  50. Understanding the Tradeoffs in Client-side Privacy for Downstream Speech Tasks
    2021/01/22 by Peter Wu, Wu, Peter, Paul Pu Liang +9 · 1 citation
    Computer Science · #Adversarial Robustness in Machine Learning #Audio and Speech Processing (eess.AS) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #FOS: Electrical engineering #Privacy-Preserving Technologies in Data #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
  51. A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning
    2021/04/28 by Tsai, Yao-Hung Hubert, Bai, Shaojie, Morency, Louis-Philippe +1 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  52. Integrating Auxiliary Information in Self-supervised Learning
    2021/06/05 by Tsai, Yao-Hung Hubert, Li, Tianqin, Liu, Weixin +3 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  53. Conditional Contrastive Learning with Kernel
    2022/02/11 by Tsai, Yao-Hung Hubert, Li, Tianqin, Ma, Martin Q. +4 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  54. SeedBERT: Recovering Annotator Rating Distributions from an Aggregated Label
    2022/11/23 by Aneesha Sampath, Victoria Lin, Sampath, Aneesha +3 · 1 citation
    Computer Science · Psychology · Social Sciences · #Computation and Language (cs.CL) #Emotion and Mood Recognition #FOS: Computer and information sciences #Machine Learning (cs.LG) #Misinformation and Its Impacts #Sentiment Analysis and Opinion Mining
  55. Difference-Masking: Choosing What to Mask in Continued Pretraining
    2023/05/23 by Wilf, Alex, Akter, Syeda Nahida, Mathur, Leena +5 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  56. Multimodal Fusion Interactions: A Study of Human and Automatic Quantification
    2023/06/07 by Paul Pu Liang, Yun Cheng, Liang, Paul Pu +5 · 1 citation
    Computer Science · Decision Sciences · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG) #Multi-Criteria Decision Making #Speech and dialogue systems
  57. Comparative Knowledge Distillation
    2023/11/03 by Wilf, Alex, Xu, Alex Tianyi, Liang, Paul Pu +3 · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  58. From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
    2025/06/24 by G.J. Kim, Alex Wilf, Kim, Gyeongwon James +5 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Model-Driven Software Engineering Techniques #Semantic Web and Ontologies #Software Engineering Research
  59. Factorized Multimodal Transformer for Multimodal Sequential Learning
    2019/11/22 by Amir Zadeh, Zadeh, Amir, Chengfeng Mao +11 · 1 citation
    Computer Science · #Speech and dialogue systems #Speech Recognition and Synthesis #Topic Modeling
  60. ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models
    2025/07/01 by Wan, Zifu, Zhang, Ce, Yong, Silong +6 · 2 citations
    #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
  61. IoT-LM: Large Multisensory Language Models for the Internet of Things
    2024/07/13 by Shentong Mo, Russ R. Salakhutdinov, Mo, Shentong +5 · 1 citation
    Agricultural and Biological Sciences · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Food Supply Chain Traceability #Machine Learning (cs.LG) #Multimedia (cs.MM) #Public Relations and Crisis Communication