vix.ing · top · new · best · stats

MicLog: Towards Accurate and Efficient LLM-based Log Parsing via Progressive Meta In-Context Learning

2026/01/11 by Jianbo Yu, Yixuan Li, Hai Xu +5
Computer Science · #Bottom-up parsing #Inference #Leverage (statistics) #Machine Learning in Healthcare #Natural Language Processing Techniques #Parser combinator #Parsing #S-attributed grammar #Top-down parsing #Top-down parsing language #Topic Modeling

paper · pdf · open access · doi:10.1609/aaai.v40i2.37123

published in Proceedings of the AAAI Conference on Artificial Intelligence 40(2), 1480-1488 (Association for the Advancement of Artificial Intelligence)

openalex publication_date 2026/03/14 · openalex created_date 2026/03/18 · openalex updated_date 2026/08/05

Abstract

Log parsing converts semi-structured logs into structured templates, forming a critical foundation for downstream analysis. Traditional syntax and semantic-based parsers often struggle with semantic variations in evolving logs and data scarcity stemming from their limited domain coverage. Recent large language model (LLM)-based parsers leverage in-context learning (ICL) to extract semantics from examples, demonstrating superior accuracy. However, LLM-based parsers face two main challenges: 1) underutilization of ICL capabilities, particularly in dynamic example selection and cross-domain generalization, leading to inconsistent performance; 2) time-consuming and costly LLM querying. To address these challenges, we present MicLog, the first progressive meta in-context learning (ProgMeta-ICL) log parsing framework that combines meta-learning with ICL on small open-source LLMs (i.e., Qwen-2.5-3B). Specifically, MicLog: i) enhances LLMs' ICL capability through a zero-shot to k-shot ProgMeta-ICL paradigm, employing weighted DBSCAN candidate sampling and enhanced BM25 demonstration selection; ii) accelerates parsing via a multi-level pre-query cache that dynamically matches and refines recently parsed templates. Evaluated on Loghub-2.0, MicLog achieves 10.3% higher parsing accuracy than the state-of-the-art parser while reducing parsing time by 42.4%.

Citations

Related