Bioformer: an efficient transformer language model for biomedical text mining

2023/02/03 by Fang Li, Fang, Li, Qingyu Chen +7 · 1 citation
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling

paper · doi:10.48550/arxiv.2302.01588

openalex publication_date 2023/02/03 · openalex created_date 2023/02/08 · openalex updated_date 2026/07/28

Abstract

. Bioformer has been successfully deployed to PubTator Central providing gene annotations over 35 million PubMed abstracts and 5 million PubMed Central full-text articles. We make Bioformer publicly available via https://github.com/WGLab/bioformer, including pre-trained models, datasets, and instructions for downstream use.

Cited by

• Extraction of biological terms using large language models enhances the usability of metadata in the BioSample database

Related

• PMC text mining subset in BioC: 2.3 million full text articles and growing
• Services for annotation of biomedical text
• BioPars: A Pretrained Biomedical Large Language Model for Persian Biomedical Text Mining
• BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition
• BioMamba: A Pre-trained Biomedical Language Representation Model Leveraging Mamba