Contextual Object Detection with Multimodal Large Language Models

2024/08/20 by Yuhang Zang, Wei Li, Jun Han +2 · 16 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Human Pose and Action Recognition #Multimodal Machine Learning Applications

paper · doi:10.1007/s11263-024-02214-4

openalex publication_date 2024/08/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01

Citations

• The Pascal Visual Object Classes (VOC) Challenge
• Long Short-Term Memory
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal\n Networks
• Deformable DETR: Deformable Transformers for End-to-End Object Detection
• Learning Transferable Visual Models From Natural Language Supervision
• Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
• Referring Transformer: A One-step Approach to Multi-task Visual Grounding
• Multimodal Few-Shot Learning with Frozen Language Models
• DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection
• Flamingo: a Visual Language Model for Few-Shot Learning
• GLIPv2: Unifying Localization and Vision-Language Understanding
• Bridging the Gap between Object and Image-level Representations for Open-Vocabulary Detection
• Generate rather than Retrieve: Large Language Models are Strong Context Generators
• Segment Anything

Cited by

• Mitigating Attention Sinks and Massive Activations in Audio-Visual Speech Recognition with LLMs
• EVER: Edge-Assisted Auto-Verification for Mobile MR-Aided Operation
• VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observations
• Adaptive Guidance Semantically Enhanced via Multimodal LLM for Edge-Cloud Object Detection
• Check Field Detection Agent (CFD-Agent) using Multimodal Large Language and Vision Language Models
• SAEC: Scene-Aware Enhanced Edge-Cloud Collaborative Industrial Vision Inspection with Multimodal LLM
• Towards Understanding Visual Grounding in Visual Language Models
• Real Time FPGA Based Transformers & VLMs for Vision Tasks: SOTA Designs and Optimizations
• Object Detection with Multimodal Large Vision-Language Models: An In-depth Review
• VLM-3D:End-to-End Vision-Language Models for Open-World 3D Perception
• Differentiated Information Mining: A Semi-supervised Learning Framework for GNNs
• MV-CoRe: Multimodal Visual-Conceptual Reasoning for Complex Visual Question Answering
• Open-Vocabulary HOI Detection with Interaction-aware Prompt and Concept Calibration
• Application of large language models to natural language processing and image analysis tasks in dermatology: A systematic review
• Semi-off-Policy Reinforcement Learning for Vision-Language Slow-Thinking Reasoning
• KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model