- MIRAGE: Adaptive Multimodal Gating for Whole-Brain fMRI Encoding
2026/05/28 by Abdülkadir Gökce, Abdulkadir Gokce, Badr AlKhamissi +1 · 1 voice
Computer Science · Neuroscience · Psychology · #Action Observation and Synchronization #Artificial neural network #ENCODE #Encoder #Encoding (memory) #Face Recognition and Perception #Feature (linguistics) #Gating #Modality (human–computer interaction) #Multisensory perception and integration #cs.LG
- CLIP-Guided SAM: Parameter-Efficient Semantic Conditioning for Promptable Segmentation
2026/05/24 by Shayan Jalilian, Abdul Bais · 1 voice
Computer Science · #Advanced Neural Network Applications #Consistency (knowledge bases) #Domain Adaptation and Few-Shot Learning #Encoder #Feature (linguistics) #Image segmentation #Multimodal Machine Learning Applications #Robustness (evolution) #Segmentation #Semantic data model #Semantic feature #Semantics (computer science) #cs.CV
- Let ViT Speak: Generative Language-Image Pre-training
2026/05/01 by Yan Fang, Mengcheng Lan, Zilong Huang +7 · 1 voice
Computer Science · #Domain Adaptation and Few-Shot Learning #Encoder #Generative Adversarial Networks and Image Synthesis #Generative grammar #Generative model #Key (lock) #Language acquisition #Language model #Multimodal Machine Learning Applications #Natural language #Transformer #cs.CV
- Why Advanced Encoders Lag on Sparse Retrieval? The Answer and an Approach to Bridging Vocabulary Gaps
2026/04/20 by Zhichao Geng, Yang Yang · 1 voice
Computer Science · #Bridging (networking) #Decoding methods #Domain Adaptation and Few-Shot Learning #Encoder #Generative Adversarial Networks and Image Synthesis #Granularity #Intuition #Lag #Lossless compression #Multimodal Machine Learning Applications #Vocabulary #cs.AI #cs.IR #cs.LG
- Learning to Concatenate Quantum Codes
2026/04/16 by Nico Meyer, Christopher Mutschler, Dominik Seuß +2 · 1 voice
Computer Science · Engineering · Physics and Astronomy · #Code (set theory) #Encoder #Error detection and correction #Noise (video) #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum convolutional code #Quantum error correction #Qubit #Radiation Effects in Electronics #Turbo code #cs.LG #quant-ph
- V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning
2026/03/15 by Lorenzo Mur-Labadia, Matthew Muckley, Matthew J. Muckley +7 · 2 voices · 2 citations
Computer Science · Engineering · #Action recognition #Anticipation (artificial intelligence) #Deep learning #Encoder #Feature (linguistics) #Human Pose and Action Recognition #Key (lock) #Multimodal Machine Learning Applications #Representation (politics) #Robot Manipulation and Learning #Training (meteorology) #cs.CV
- Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding
2026/02/09 by Yuchen Wang, Haonan Wang, Yu Guo +2 · 1 voice
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · Neuroscience · #Adversarial Robustness in Machine Learning #Code (set theory) #Decoding methods #EEG and Brain-Computer Interfaces #Encoder #Encoding (memory) #Forcing (mathematics) #Language model #Machine translation #Noise (video) #Semantics (computer science) #Topic Modeling #cs.AI #cs.CL #cs.HC #eess.AS #q-bio.NC
- Identifying Bots Through LLM-Generated Text in Open Narrative Responses: A Proof-of-Concept Study
2026/01/13 by Joshua Claassen, Jan Karem Höhne, Ruben L. Bach +1 · 1 voice
Psychology · Social Sciences · #Encoder #Exploit #Identification (biology) #Mental Health via Writing #Narrative #Open source #Proxy (statistics) #Quality (philosophy) #Social Media in Health Education #Social media #Survey Methodology and Nonresponse
- A Comparative Study of Clinical ModernBERT and BioMedical ModernBERT on the DDXPlus Dataset
2024/12/18 by Benjamin Warner, Warner, Benjamin, Antoine Chaffin +25 · 8 voices · 271 citations
Computer Science · #Advanced Data Compression Techniques #Artificial intelligence #Computer architecture #Computer science #Context (archaeology) #Encoder #Human Pose and Action Recognition #Inference #Parallel computing #Video Analysis and Summarization #cs.AI #cs.CL
- Encoding categorical data: Is there yet anything 'hotter' than one-hot encoding?
2023/12/28 by Ekaterina Poslavskaya, Poslavskaya, Ekaterina, А. А. Королев +1 · 9 citations
Computer Science · Mathematics · #Arithmetic #Artificial intelligence #Binary number #Categorical variable #Coding (social sciences) #Computer science #Data mining #Encoder #Encoding (memory) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine learning #Mathematics #Pattern recognition (psychology) #Preprocessor #Statistics #Task (project management)
- Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment
2023/12/12 by Utkarsh Mall, Cheng Perng Phoo, Mall, Utkarsh +9 · 19 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Encoder #FOS: Computer and information sciences #Genomics and Phylogenetic Studies #Ground truth #Image (mathematics) #Key (lock) #Language model #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Remote sensing #Segmentation #The Internet #Vocabulary #World Wide Web
- MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training
2023/11/28 by Pavan Kumar Anasosalu Vasu, Vasu, Pavan Kumar Anasosalu, Hadi Pouransari +7 · 1 voice · 35 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial intelligence #Closed captioning #Computer engineering #Computer science #Domain Adaptation and Few-Shot Learning #Encoder #Image (mathematics) #Latency (audio) #Machine learning #Modal #Multimodal Machine Learning Applications #Reinforcement learning #Robustness (evolution) #Transformer #Voltage #cs.CL #cs.CV #cs.LG
- Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch
2023/11/06 by Le Yu, Yu, Le, Bowen Yu +7 · 1 voice · 200 citations
Computer Science · #Algorithm #Artificial intelligence #Computer science #Encoder #Language model #Merge (version control) #Natural Language Processing Techniques #Parallel computing #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
- Multi-View Causal Representation Learning with Partial Observability
2023/11/07 by Dingling Yao, Yao, Dingling, Danru Xu +13 · 21 citations
Computer Science · Mathematics · #Adversarial Robustness in Machine Learning #Algorithm #Applied mathematics #Artificial Intelligence (cs.AI) #Artificial intelligence #Bijection #Computer science #Discrete mathematics #Domain Adaptation and Few-Shot Learning #Encoder #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Feature learning #Identifiability #Latent variable #Machine Learning (cs.LG) #Machine learning #Mathematics #Nonlinear system #Observability #Representation (politics) #Set (abstract data type) #Simple (philosophy) #Theoretical computer science #Tuple
- Towards image compression with perfect realism at ultra-low bitrates
2023/10/16 by Marlène Careil, Careil, Marlène, Matthew J. Muckley +5 · 37 citations
Computer Science · #Advanced Data Compression Techniques #Advanced Image Processing Techniques #Algorithm #Artificial intelligence #Bandwidth (computing) #Codec #Computer science #Computer vision #Context (archaeology) #Data compression #Decoding methods #Distortion (music) #Encoder #Image (mathematics) #Image and Signal Denoising Methods #Image compression #Image processing #Image quality #Pixel #Telecommunications
- PaLI-3 Vision Language Models: Smaller, Faster, Stronger
2023/10/13 by Xi Chen, Xiao Wang, Chen, Xi +37 · 1 voice · 29 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Artificial intelligence #Computer science #Electrical engineering #Encoder #Engineering #Image (mathematics) #Language model #Modal #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Situated #Transformer #Voltage #cs.CV
- Learning Mask-aware CLIP Representations for Zero-Shot Segmentation
2023/09/30 by Siyu Jiao, Yunchao Wei, Jiao, Siyu +7 · 16 citations
Computer Science · #Advanced Neural Network Applications #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Domain Adaptation and Few-Shot Learning #Encoder #FOS: Computer and information sciences #FOS: Electrical engineering #False positive paradox #Image (mathematics) #Image and Video Processing (eess.IV) #Machine learning #Margin (machine learning) #Multimodal Machine Learning Applications #Pascal (unit) #Programming language #Segmentation #Shot (pellet) #Transferability #electronic engineering #information engineering
- Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
2023/08/25 by Chi Chen, Chen, Chi, Ruoyu Qin +11 · 10 citations
Computer Science · #Artificial intelligence #Code (set theory) #Comprehension #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Construct (python library) #Encoder #FOS: Computer and information sciences #Image (mathematics) #Language model #Modalities #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Position (finance) #Programming language
- Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis
2023/07/18 by Jiahe Li, Li, Jiahe, Jiawei Zhang +7 · 16 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Encoder #FOS: Computer and information sciences #Face recognition and analysis #Hash function #Human Motion and Animation #Rendering (computer graphics)
- SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis
2023/07/04 by Dustin Podell, Podell, Dustin, Zion English +13 · 1 voice · 1,334 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Algorithm #Artificial intelligence #Code (set theory) #Computer science #Computer vision #Context (archaeology) #Diffusion #Encoder #Fidelity #Generative Adversarial Networks and Image Synthesis #Generative grammar #Generative model #Image (mathematics) #Image Retrieval and Classification Techniques #Machine learning #Programming language #Stability (learning theory) #Transparency (behavior) #cs.AI #cs.CV
- MedBLIP: Bootstrapping Language-Image Pre-training from 3D Medical Images and Texts
2023/05/18 by Qiuhui Chen, Chen, Qiuhui, Xinyue Hu +5 · 22 citations
Computer Science · Medicine · #Artificial intelligence #Bootstrapping (finance) #CAD #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Domain (mathematical analysis) #Encoder #Engineering drawing #FOS: Computer and information sciences #Image (mathematics) #Language model #Machine Learning in Healthcare #Machine learning #Medical diagnosis #Medicine #Multimodal Machine Learning Applications #Natural language processing #Radiology #Topic Modeling
- Unlimiformer: Long-Range Transformers with Unlimited Length Input
2023/05/02 by Amanda Bertsch, Bertsch, Amanda, Uri Alon +5 · 6 voices · 23 citations
Computer Science · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Automatic summarization #Chunking (psychology) #Code (set theory) #Computation #Computer engineering #Computer science #Data mining #Decoding methods #Encoder #Generative Adversarial Networks and Image Synthesis #Handwritten Text Recognition Techniques #Operating system #Programming language #Security token #Theoretical computer science #Transformer #cs.CL
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
2023/04/20 by Deyao Zhu, Zhu, Deyao, Jun Chen +7 · 547 citations
Computer Science · #Artificial intelligence #Code (set theory) #Computer science #Encoder #Human–computer interaction #Language model #Linguistics #Modal #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Programming language #Repetition (rhetorical device) #Topic Modeling #Usability
- MaMMUT: A Simple Architecture for Joint Learning for MultiModal Tasks
2023/03/29 by Weicheng Kuo, AJ Piergiovanni, Kuo, Weicheng +21 · 9 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Architecture #Artificial intelligence #Closed captioning #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Domain Adaptation and Few-Shot Learning #Encoder #FOS: Computer and information sciences #Flexibility (engineering) #Generative grammar #Generative model #Human–computer interaction #Image (mathematics) #Joint (building) #Linguistics #Machine Learning (cs.LG) #Machine learning #Multimodal Machine Learning Applications #Natural language processing #Simple (philosophy) #Speech recognition #Vocabulary
- Mixed Hierarchy Network for Image Restoration
2023/02/19 by Hu Gao, Gao, Hu, Depeng Dang +1 · 7 citations
Computer Science · Engineering · #Advanced Image Fusion Techniques #Advanced Image Processing Techniques #Artificial intelligence #Artificial neural network #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Convolution (computer science) #Deblurring #Encoder #FOS: Computer and information sciences #Hierarchy #Image (mathematics) #Image and Signal Denoising Methods #Image processing #Image quality #Image restoration #Process (computing)
- Compact Transformer Tracker with Correlative Masked Modeling
2023/01/26 by Zikai Song, Run Luo, Song, Zikai +7 · 7 citations
Computer Science · #Advanced Neural Network Applications #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Discriminative model #Embedding #Encoder #FOS: Computer and information sciences #Feature (linguistics) #Pattern recognition (psychology) #Video Surveillance and Tracking Methods #Visual Attention and Saliency Detection
- DISCO: Adversarial Defense with Local Implicit Functions
2022/12/11 by Chih-Hui Ho, Ho, Chih-Hui, Nuno Vasconcelos +1 · 11 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Adversarial system #Algorithm #Anomaly Detection Techniques and Applications #Artificial intelligence #Bacillus and Francisella bacterial research #Cascade #Classifier (UML) #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Encoder #Engineering #FOS: Computer and information sciences #Image (mathematics) #Machine learning #Manifold (fluid mechanics) #Pattern recognition (psychology) #Pixel #RGB color model #Value (mathematics)
- SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading
2022/10/20 by Yijin Huang, Junyan Lyu, Huang, Yijin +7 · 8 citations
Computer Science · Medicine · #Artificial intelligence #Artificial neural network #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Domain Adaptation and Few-Shot Learning #Encoder #FOS: Computer and information sciences #Fundus (uterus) #Grading (engineering) #Machine learning #Pattern recognition (psychology) #Retinal Diseases and Treatments #Retinal Imaging and Analysis #Salient #Segmentation #Supervised learning #Transformer
- Learning to Decompose Visual Features with Latent Textual Prompts
2022/10/09 by Feng Wang, Wang, Feng, Manling Li +9 · 8 citations
Computer Science · #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Domain Adaptation and Few-Shot Learning #Encoder #FOS: Computer and information sciences #Feature (linguistics) #Feature learning #Inference #Language model #Machine learning #Margin (machine learning) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Natural language processing #Robustness (evolution) #Scalability #Visual language
- Augmenting Reinforcement Learning with Transformer-based Scene Representation Learning for Decision-making of Autonomous Driving
2022/08/24 by Haochen Liu, Liu, Haochen, Zhiyu Huang +5 · 8 citations
Engineering · #Adaptability #Artificial Intelligence (cs.AI) #Artificial intelligence #Autonomous Vehicle Technology and Safety #Computer science #Encoder #Engineering #FOS: Computer and information sciences #Feature learning #Machine Learning (cs.LG) #Machine learning #Reinforcement learning #Robotics (cs.RO) #Traffic Prediction and Management Techniques #Traffic control and management #Transformer #Voltage
more