Junxuan Wang
- Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoders
2024/10/27 by Zhengfu He, Wentao Shu, He, Zhengfu +21 · 52 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Video Analysis and Summarization
- Towards Universality: Studying Mechanistic Similarity Across Language Model Architectures
2024/10/09 by Junxuan Wang, Wang, Junxuan, Xuyang Ge +10 · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Automatically Identifying Local and Global Circuits with Linear Computation Graphs
2024/05/22 by Xuyang Ge, Ge, Xuyang, Fukang Zhu +9 · 7 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Low-power high-performance VLSI design #Machine Learning (cs.LG) #Quantum Computing Algorithms and Architecture #VLSI and FPGA Design Techniques