Rohrbach, Marcus
- Towards VQA Models That Can Read
2019/04/18 by Singh, Amanpreet, Natarajan, Vivek, Shah, Meet +5 · 274 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Memory Aware Synapses: Learning what (not) to forget
2017/11/27 by Aljundi, Rahaf, Babiloni, Francesca, Elhoseiny, Mohamed +2 · 81 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (stat.ML)
- Efficient Lifelong Learning with A-GEM
2018/12/02 by Arslan Chaudhry, Marc’Aurelio Ranzato, Chaudhry, Arslan +5 · 72 citations
Computer Science · #Advanced Data Compression Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- TextCaps: a Dataset for Image Captioning with Reading Comprehension
2020/03/24 by Sidorov, Oleksii, Hu, Ronghang, Rohrbach, Marcus +1 · 44 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Long-term Recurrent Convolutional Networks for Visual Recognition and Description
2014/11/17 by Jeff Donahue, Lisa Anne Hendricks, Donahue, Jeff +11 · 29 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- FLAVA: A Foundational Language And Vision Alignment Model
2021/12/08 by Singh, Amanpreet, Hu, Ronghang, Goswami, Vedanuj +4 · 45 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Segmentation from Natural Language Expressions
2016/03/20 by Hu, Ronghang, Rohrbach, Marcus, Darrell, Trevor · 30 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Sequence to Sequence -- Video to Text
2015/05/03 by Subhashini Venugopalan, Marcus Rohrbach, Venugopalan, Subhashini +9 · 36 citations
Computer Science · #Multimodal Machine Learning Applications #Human Pose and Action Recognition #Video Analysis and Summarization
- Neural Module Networks
2015/11/09 by Andreas, Jacob, Rohrbach, Marcus, Darrell, Trevor +1 · 24 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
- Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
2016/06/06 by Akira Fukui, Dong Huk Park, Fukui, Akira +9 · 35 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- A Dataset for Movie Description
2015/01/12 by Anna Rohrbach, Rohrbach, Anna, Marcus Rohrbach +5 · 16 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Video Analysis and Summarization
- On Tiny Episodic Memories in Continual Learning
2019/02/27 by Arslan Chaudhry, Chaudhry, Arslan, Marcus Rohrbach +11 · 23 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and ELM
- Ask Your Neurons: A Neural-based Approach to Answering Questions about\n Images
2015/05/05 by Mateusz Malinowski, Marcus Rohrbach, Malinowski, Mateusz +3 · 28 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Generating Visual Explanations
2016/03/28 by Lisa Anne Hendricks, Hendricks, Lisa Anne, Zeynep Akata +9 · 21 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling
- Multimodal Explanations: Justifying Decisions and Pointing to the\n Evidence
2018/02/15 by Dong Huk Park, Lisa Anne Hendricks, Park, Dong Huk +11 · 11 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Explainable Artificial Intelligence (XAI)
- Movie Description
2016/05/12 by Rohrbach, Anna, Torabi, Atousa, Rohrbach, Marcus +5 · 10 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Pythia v0.1: the Winning Entry to the VQA Challenge 2018
2018/07/26 by Yu Jiang, Vivek Natarajan, Jiang, Yu +9 · 21 citations
Computer Science · Medicine · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #COVID-19 diagnosis using AI
- Modeling Relationships in Referential Expressions with Compositional Modular Networks
2016/11/30 by Ronghang Hu, Marcus Rohrbach, Hu, Ronghang +7 · 15 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Human Pose and Action Recognition
- Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution
2019/04/10 by Yunpeng Chen, Chen, Yunpeng, Haoqi Fan +13 · 15 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition
- Graph-Based Global Reasoning Networks
2018/11/30 by Chen, Yunpeng, Rohrbach, Marcus, Yan, Zhicheng +3 · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Natural Language Object Retrieval
2015/11/13 by Ronghang Hu, Hu, Ronghang, Huazhe Xu +9 · 10 citations
Computer Science · #Multimodal Machine Learning Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- Adversarial Continual Learning
2020/03/21 by Ebrahimi, Sayna, Meier, Franziska, Calandra, Roberto +2 · 9 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Reliable Visual Question Answering: Abstain Rather Than Answer Incorrectly
2022/04/28 by Spencer Whitehead, Whitehead, Spencer, Suzanne Petryk +11 · 10 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain\n Knowledge-Based VQA
2020/12/20 by Kenneth Marino, Xinlei Chen, Marino, Kenneth +7 · 7 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- Chrono: A Simple Blueprint for Representing Time in MLLMs
2024/06/26 by Meinardus, Boris, Rodriguez, Hector, Batra, Anil +2 · 12 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Cycle-Consistency for Robust Visual Question Answering
2019/02/15 by Shah, Meet, Chen, Xinlei, Rohrbach, Marcus +1 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Grounded Video Description
2018/12/17 by Zhou, Luowei, Kalantidis, Yannis, Chen, Xinlei +2 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQA
2019/11/14 by Ronghang Hu, Amanpreet Singh, Hu, Ronghang +5 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- 12-in-1: Multi-Task Vision and Language Representation Learning
2019/12/05 by Jiasen Lu, Vedanuj Goswami, Lu, Jiasen +7 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Improving Selective Visual Question Answering by Learning from Your Peers
2023/06/14 by Dancette, Corentin, Whitehead, Spencer, Maheshwary, Rishabh +5 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Experts
2024/12/13 by Tobias Braun, Mark Rothermel, Braun, Tobias +5 · 1 voice · 10 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation #Software Engineering Research #Software Engineering Techniques and Practices #cs.CL #cs.CV
- Learning to Compose Neural Networks for Question Answering
2016/01/07 by Jacob Andreas, Andreas, Jacob, Marcus Rohrbach +5 · 2 voices
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural and Evolutionary Computing (cs.NE) #cs.CL #cs.CV #cs.NE
- Speaking the Same Language: Matching Machine to Human Captions by Adversarial Training
2017/03/30 by Rakshith Shetty, Marcus Rohrbach, Shetty, Rakshith +7 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Multimodal Machine Learning Applications
- CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog
2019/03/07 by Kottur, Satwik, Moura, José M. F., Parikh, Devi +2 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- SMART Frame Selection for Action Recognition
2020/12/19 by Gowda, Shreyank N, Rohrbach, Marcus, Sevilla-Lara, Laura · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoning
2025/04/01 by Nishad Singhi, Singhi, Nishad, Hritik Bansal +11 · 11 citations
Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Topic Modeling
- Learning To Recognize Procedural Activities with Distant Supervision
2022/01/26 by Xudong Lin, Lin, Xudong, Fabio Petroni +9 · 3 citations
Computer Science · #Human Pose and Action Recognition #Video Analysis and Summarization #Music and Audio Processing
- Learning to Reason: End-to-End Module Networks for Visual Question Answering
2017/04/18 by Hu, Ronghang, Andreas, Jacob, Rohrbach, Marcus +2 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Attentive Explanations: Justifying Decisions and Pointing to the\n Evidence
2016/12/14 by Dong Huk Park, Park, Dong Huk, Lisa Anne Hendricks +9 · 6 citations
Computer Science · #Multimodal Machine Learning Applications #Visual Attention and Saliency Detection #Domain Adaptation and Few-Shot Learning
- Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering
2019/02/21 by Ramakrishna Vedantam, Karan Desai, Vedantam, Ramakrishna +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Topic Modeling
- Uncertainty-guided Continual Learning with Bayesian Neural Networks
2019/06/06 by Ebrahimi, Sayna, Elhoseiny, Mohamed, Darrell, Trevor +1 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Remembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting
2020/10/04 by Ebrahimi, Sayna, Petryk, Suzanne, Gokul, Akash +4 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Large-Scale Visual Relationship Understanding
2018/04/27 by Ji Zhang, Zhang, Ji, Yannis Kalantidis +9 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition
2022/06/09 by Gowda, Shreyank N, Rohrbach, Marcus, Keller, Frank +1 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Simple Token-Level Confidence Improves Caption Correctness
2023/05/11 by Petryk, Suzanne, Whitehead, Spencer, Gonzalez, Joseph E. +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Translating Videos to Natural Language Using Deep Recurrent Neural Networks
2014/12/15 by Venugopalan, Subhashini, Xu, Huijuan, Donahue, Jeff +3 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Selfless Sequential Learning
2018/06/14 by Rahaf Aljundi, Aljundi, Rahaf, Marcus Rohrbach +3 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM
- Visual Coreference Resolution in Visual Dialog using Neural Module Networks
2018/09/06 by Kottur, Satwik, Moura, José M. F., Parikh, Devi +2 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- CLASTER: Clustering with Reinforcement Learning for Zero-Shot Action Recognition
2021/01/18 by Shreyank N Gowda, Laura Sevilla-Lara, Gowda, Shreyank N +5 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition
- A New Split for Evaluating True Zero-Shot Action Recognition
2021/07/27 by Gowda, Shreyank N, Sevilla-Lara, Laura, Kim, Kiyoon +2 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication
2017/12/15 by Jin-Hwa Kim, Kim, Jin-Hwa, Nikita Kitaev +13 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Erased but Not Forgotten: How Backdoors Compromise Concept Erasure
2025/04/29 by Grebe, Jonas Henry, Braun, Tobias, Rohrbach, Marcus +1 · 3 citations
#Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Variational Visual Question Answering for Uncertainty-Aware Selective Prediction
2025/05/14 by T. Wieczorek, Wieczorek, Tobias Jan, Nathalie Daun +5 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Multimodal Machine Learning Applications
- Deep Compositional Captioning: Describing Novel Object Categories\n without Paired Training Data
2015/11/17 by Lisa Anne Hendricks, Subhashini Venugopalan, Hendricks, Lisa Anne +9 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications