Ferrando, Javier
- A Primer on the Inner Workings of Transformer-based Language Models
2024/04/30 by Javier Ferrando, Ferrando, Javier, Gabriele Sarti +5 · 4 voices · 11 citations
#cs.CL
- Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models
2024/11/21 by Javier Ferrando, Oscar Obeso, Ferrando, Javier +5 · 3 voices · 30 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling #cs.AI #cs.CL #cs.LG
- Information Flow Routes: Automatically Interpreting Language Models at Scale
2024/02/27 by Javier Ferrando, Elena Voita, Ferrando, Javier +1 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Measuring the Mixing of Contextual Information in the Transformer
2022/03/08 by Javier Ferrando, Gerard I. Gállego, Ferrando, Javier +3 · 7 citations
Computer Science · Materials Science · #Explainable Artificial Intelligence (XAI) #Machine Learning in Materials Science
- Neurons in Large Language Models: Dead, N-gram, Positional
2023/09/09 by Elena Voita, Javier Ferrando, Voita, Elena +3 · 6 citations
Engineering · Computer Science · Materials Science · #Ferroelectric and Negative Capacitance Devices #Topic Modeling #Machine Learning in Materials Science
- Explaining How Transformers Use Context to Build Predictions
2023/05/21 by Javier Ferrando, Gerard I. Gállego, Ferrando, Javier +5 · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- On the Similarity of Circuits across Languages: a Case Study on the Subject-verb Agreement Task
2024/10/09 by Javier Ferrando, Marta R. Costa‐jussà, Ferrando, Javier +1 · 5 citations
Computer Science · #Natural Language Processing Techniques
- Attention Weights in Transformer NMT Fail Aligning Words Between Sequences but Largely Explain Model Predictions
2021/09/13 by Javier Ferrando, Ferrando, Javier, Marta R. Costa‐jussà +1 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer
2022/05/23 by Javier Ferrando, Ferrando, Javier, Gerard I. Gállego +7 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models
2024/04/10 by Igor Tufanov, Karen Hambardzumyan, Tufanov, Igor +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Toxicity in Multilingual Machine Translation at Scale
2022/10/06 by Costa-jussà, Marta R., Smith, Eric, Ropers, Christophe +4 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7
- Real-Time Detection of Hallucinated Entities in Long-Form Generation
2025/08/26 by Obeso, Oscar, Arditi, Andy, Ferrando, Javier +3 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)