vix.ing · top · new · best · stats · spec

Martin Jaggi

  1. Landmark Attention: Random-Access Infinite Context Length for Transformers
    2023/05/25 by Amirkeivan Mohtashami, Martin Jaggi, Mohtashami, Amirkeivan +1 · 2 voices · 17 citations
    Computer Science · #Topic Modeling #Advanced Neural Network Applications #Machine Learning and Data Classification
  2. Evaluating the Search Phase of Neural Architecture Search
    2019/02/21 by Kaicheng Yu, Yu, Kaicheng, Christian Sciuto +7 · 2 voices · 3 citations
    #cs.LG #stat.ML
  3. DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
    2024/02/04 by Matteo Pagliardini, Pagliardini, Matteo, Amirkeivan Mohtashami +6 · 1 voice · 13 citations
    Computer Science · #Neural Networks and Applications
  4. Advances and Open Problems in Federated Learning
    2020/12/02 by Peter Kairouz, H. Brendan McMahan, Brendan Avent +56 · 198 citations
    Computer Science · #Cryptography and Data Security #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data
  5. QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
    2024/03/30 by Saleh Ashkboos, Ashkboos, Saleh, Amirkeivan Mohtashami +14 · 108 citations
    Computer Science · Engineering · #Advanced Wireless Communication Techniques #Error Correcting Code Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Optical Network Technologies
  6. Sparsified SGD with Memory
    2018/09/20 by Sebastian U. Stich, Jean-Baptiste Cordonnier, Stich, Sebastian U. +3 · 54 citations
    Computer Science · Engineering · #68W15 #68W40 #90C06 #90C25 #Data Structures and Algorithms (cs.DS) #Distributed #Distributed Sensor Networks and Detection Algorithms #E.4 #F.2.1 #FOS: Computer and information sciences #G.1.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  7. Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
    2023/05/26 by Atli Kosson, Bettina Messmer, Kosson, Atli +3 · 2 voices · 10 citations
    Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics
  8. Ensemble Distillation for Robust Model Fusion in Federated Learning
    2020/06/12 by Tao Lin, Lin, Tao, Lingjing Kong +5 · 46 citations
    Computer Science · Engineering · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Traffic Prediction and Management Techniques
  9. Error Feedback Fixes SignSGD and other Gradient Compression Schemes
    2019/01/28 by Sai Praneeth Karimireddy, Karimireddy, Sai Praneeth, Quentin Rebjock +5 · 34 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #FOS: Mathematics #I.2.6 #I.5.1 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  10. Decentralized Stochastic Optimization and Gossip Algorithms with\n Compressed Communication
    2019/02/01 by Anastasia Koloskova, Sebastian U. Stich, Koloskova, Anastasia +3 · 45 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Distributed Control Multi-Agent Systems
  11. A Unified Theory of Decentralized SGD with Changing Topology and Local Updates
    2020/03/23 by Anastasia Koloskova, Koloskova, Anastasia, Nicolas Loizou +7 · 34 citations
    Computer Science · #68W10 #68W15 #68W40 #90C06 #90C35 #Cooperative Communication and Network Coding #Distributed #Distributed Control Multi-Agent Systems #F.2.1 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  12. FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
    2025/06/26 by Guilherme Penedo, Hynek Kydlíček, Penedo, Guilherme +17 · 1 voice · 33 citations
    Computer Science · #Computation and Language (cs.CL) #Educational Technology and Assessment #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics
  13. MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
    2023/11/27 by Zeming Chen, Chen, Zeming, A. Cano +37 · 44 citations
    Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
  14. On the Global Linear Convergence of Frank-Wolfe Optimization Variants
    2015/11/18 by Simon Lacoste-Julien, Lacoste-Julien, Simon, Martin Jaggi +1 · 25 citations
    Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Machine Learning and Algorithms
  15. Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
    2024/05/28 by Alexander Hägele, Elie Bakouch, Hägele, Alexander +9 · 34 citations
    Decision Sciences · #Scheduling and Timetabling Solutions #Simulation Techniques and Applications
  16. A Field Guide to Federated Optimization
    2021/07/14 by Jianyu Wang, Wang, Jianyu, Zachary Charles +103 · 16 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
  17. DoGE: Domain Reweighting with Generalization Estimation
    2023/10/23 by Simin Fan, Matteo Pagliardini, Fan, Simin +3 · 14 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  18. FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings
    2022/10/10 by Jean Ogier du Terrail, Samy-Safwan Ayed, Terrail, Jean Ogier du +45 · 10 citations
    Computer Science · Decision Sciences · #Big Data Technologies and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
  19. Byzantine-Robust Learning on Heterogeneous Datasets via Bucketing
    2020/06/16 by Sai Praneeth Karimireddy, Lie He, Karimireddy, Sai Praneeth +3 · 7 citations
    Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #I.2.6 #I.5.1 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
  20. Block-Coordinate Frank-Wolfe Optimization for Structural SVMs
    2012/07/19 by Simon Lacoste-Julien, Lacoste-Julien, Simon, Martin Jaggi +5 · 5 citations
    Computer Science · Engineering · #68T05 #90C06 #90C52 #90C90 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #I.2.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  21. Global linear convergence of Newton's method without strong-convexity or Lipschitz gradients
    2018/06/01 by Sai Praneeth Karimireddy, Sebastian U. Stich, Karimireddy, Sai Praneeth +3 · 6 citations
    Computer Science · Engineering · Mathematics · #68Q25 #90C25 #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  22. Masking as an Efficient Alternative to Finetuning for Pretrained Language Models
    2020/04/26 by Mengjie Zhao, Zhao, Mengjie, Tao Lin +7 · 5 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  23. Second-order optimization with lazy Hessians
    2022/12/01 by Nikita Doikov, Doikov, Nikita, El Mahdi Chayti +3 · 8 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  24. CoCoA: A General Framework for Communication-Efficient Distributed Optimization
    2016/11/07 by Virginia Smith, Simone Forte, Smith, Virginia +9 · 5 citations
    Computer Science · #Complexity and Algorithms in Graphs #FOS: Computer and information sciences #Machine Learning (cs.LG) #Optimization and Search Problems #Stochastic Gradient Optimization Techniques
  25. Byzantine-Robust Decentralized Learning via ClippedGossip
    2022/02/03 by Lie He, He, Lie, Sai Praneeth Karimireddy +3 · 4 citations
    Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Wireless Communication Security Techniques #and Cluster Computing (cs.DC)
  26. Apertus: Democratizing Open and Compliant LLMs for Global Language Environments
    2025/09/17 by Project Apertus, Apertus, Project, Alejandro Hernández-Cano +203 · 4 voices · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
  27. Efficient Greedy Coordinate Descent for Composite Problems
    2018/10/16 by Sai Praneeth Karimireddy, Anastasia Koloskova, Karimireddy, Sai Praneeth +5 · 4 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Optimization and Search Problems
  28. Training DNNs with Hybrid Block Floating Point
    2018/04/04 by Mario Drumond, Drumond, Mario, Tao Lin +5 · 2 citations
    Computer Science · Engineering · #Advanced Data Storage Technologies #FOS: Computer and information sciences #FOS: Mathematics #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Numerical Analysis (math.NA) #Parallel Computing and Optimization Techniques
  29. Effective Interplay between Sparsity and Quantization: From Theory to Practice
    2024/05/31 by Simla Burcu Harma, Ayan Chakraborty, Harma, Simla Burcu +19 · 5 citations
    Computer Science · Engineering · #Neural Networks and Applications #Advanced MEMS and NEMS Technologies
  30. Simple Unsupervised Keyphrase Extraction using Sentence Embeddings
    2018/01/13 by Kamil Bennani-Smires, Claudiu Musat, Bennani-Smires, Kamil +7 · 2 citations
    Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences
  31. Benchmarking Optimizers for Large Language Model Pretraining
    2025/09/01 by Andrei Semenov, A L Semenov, Matteo Pagliardini +4 · 2 voices · 15 citations
    Computer Science · Social Sciences · #Computational and Text Analysis Methods #Machine Learning and Data Classification #Topic Modeling #cs.LG
  32. Can Performant LLMs Be Ethical? Quantifying the Impact of Web Crawling Opt-Outs
    2025/04/08 by Dongyang Fan, Vinko Sabolčec, Fan, Dongyang +11 · 3 voices · 2 citations
    Computer Science · Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Research Data Management Practices #Scientific Computing and Data Management #Software Engineering Research
  33. On Convergence of Incremental Gradient for Non-Convex Smooth Functions
    2023/05/30 by Anastasia Koloskova, Koloskova, Anastasia, Nikita Doikov +5 · 3 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Machine Learning and Algorithms #Advanced Neural Network Applications
  34. Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
    2025/02/14 by Bettina Messmer, Messmer, Bettina, Vinko Sabolčec +3 · 6 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification
  35. Masked Training of Neural Networks with Partial Gradients
    2021/06/16 by Amirkeivan Mohtashami, Martin Jaggi, Mohtashami, Amirkeivan +3 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
  36. MultiModN- Multimodal, Multi-Task, Interpretable Modular Networks
    2023/09/25 by Vinitra Swamy, Swamy, Vinitra, Malika Satayeva +13 · 3 citations
    Computer Science · Medicine · #Machine Learning in Healthcare #COVID-19 diagnosis using AI #Explainable Artificial Intelligence (XAI)
  37. Special Properties of Gradient Descent with Large Learning Rates
    2022/05/30 by Amirkeivan Mohtashami, Martin Jaggi, Mohtashami, Amirkeivan +3 · 2 citations
    Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and ELM #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  38. The Privacy Power of Correlated Noise in Decentralized Learning
    2024/05/02 by Youssef Allouah, Anastasia Koloskova, Allouah, Youssef +7 · 3 citations
    Computer Science · #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
  39. Towards an empirical understanding of MoE design choices
    2024/02/20 by Dongyang Fan, Bettina Messmer, Fan, Dongyang +3 · 2 citations
    Business, Management and Accounting · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Innovative Approaches in Technology and Social Development #Machine Learning (cs.LG) #Technology Use by Older Adults #Usability and User Interface Design
  40. Extrapolation for Large-batch Training in Deep Learning
    2020/06/10 by Tao Lin, Lingjing Kong, Lin, Tao +5 · 1 citation
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning
  41. Obtaining Better Static Word Embeddings Using Contextual Embedding Models
    2021/06/08 by Prakhar Gupta, Gupta, Prakhar, Martin Jaggi +1 · 1 citation
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
  42. Optimal Model Averaging: Towards Personalized Collaborative Learning
    2021/10/25 by Felix Grimberg, Mary‐Anne Hartley, Grimberg, Felix +5 · 1 citation
    Computer Science · Mathematics · #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Statistical Methods and Inference
  43. Data-heterogeneity-aware Mixing for Decentralized Learning
    2022/04/13 by Yatin Dandi, Anastasia Koloskova, Dandi, Yatin +5 · 1 citation
    Computer Science · #Age of Information Optimization #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
  44. Modular Clinical Decision Support Networks (MoDN) -- Updatable, Interpretable, and Portable Predictions for Evolving Clinical Environments
    2022/11/12 by Cécile Trottet, Trottet, Cécile, Thijs Vogels +5 · 1 citation
    Computer Science · Health Professions · #AI in cancer detection #Artificial Intelligence in Healthcare #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare
  45. Beyond spectral gap (extended): The role of the topology in decentralized learning
    2023/01/05 by Thijs Vogels, Vogels, Thijs, Hadrien Hendrikx +3 · 1 citation
    Computer Science · #Age of Information Optimization #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  46. Multiplication-Free Transformer Training via Piecewise Affine Operations
    2023/05/26 by Atli Kosson, Kosson, Atli, Martin Jaggi +1 · 1 citation
    Computer Science · Physics and Astronomy · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications
  47. LASER: Linear Compression in Wireless Distributed Optimization
    2023/10/19 by Ashok Vardhan Makkuva, Makkuva, Ashok Vardhan, Marco Bondaschi +8 · 1 citation
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  48. Leveraging the true depth of LLMs
    2025/02/05 by Ramón Calvo González, González, Ramón Calvo, Daniele Paliotta +7 · 2 voices · 1 citation
    #cs.LG #cs.CL
  49. Greedy Algorithms for Cone Constrained Optimization with Convergence\n Guarantees
    2017/05/31 by Francesco Locatello, Michael Tschannen, Locatello, Francesco +5 · 2 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  50. GRAPE: Optimize Data Mixture for Group Robust Multi-target Adaptive Pretraining
    2025/05/26 by Simin Fan, Maria Ios Glarou, Fan, Simin +3 · 2 citations
    Engineering · #Advanced Measurement and Detection Methods #FOS: Computer and information sciences #Machine Learning (cs.LG)
  51. CoBo: Collaborative Learning via Bilevel Optimization
    2024/09/09 by Diba Hashemi, Lie He, Hashemi, Diba +3 · 1 citation
    Psychology · #Distributed #FOS: Computer and information sciences #Innovative Teaching and Learning Methods #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  52. MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference
    2026/07/20 by Simla Burcu Harma, Danila Mishin, Zhengyuan Su +7
    #cs.LG #cs.AI