2026/02/19 by Orsolya Székely, Nicholas P. Holmes, J. Ashton +14 · 1 voice
Neuroscience · Biochemistry, Genetics and Molecular Biology · #Transcranial Magnetic Stimulation Studies #Electromagnetic Fields and Biological Effects #Hemispheric Asymmetry in Neuroscience
paper · pdf · doi:10.64898/2026.02.18.706460
Abstract Highlights We introduce the TMS-RAT, a reporting (assessment) tool for TMS studies Developed within a community-informed, iterative process rating 333 TMS studies Empirically evaluated for usability, inter-rater, and test-retest reliability A validated subset enables reliable retrospective assessment of reporting The modular structure enables use across a wide range of TMS study designs Background A standardised tool for comprehensive reporting can improve transparency, support consistent documentation, and enable comparison across transcranial magnetic stimulation (TMS) studies. The most used reporting checklist lacks clear definitions of full reporting and was not initially evaluated for usability or inter-rater reliability. A scoping review of studies using this checklist shows that its items are reported only 50% of the time, suggesting that method descriptions are often incomplete. Methods We developed the TMS Reporting Assessment Tool (TMS-RAT), a comprehensive reporting framework that provides clear definitions and examples for its items, covering a wide range of TMS protocols. We tested the usability and reliability of the TMS-RAT by rating all studies published between 1991 and 2025 using afferent conditioning (n = 333), a protocol encompassing many reporting categories identified during tool development. Seventeen independent raters contributed across three development phases, a validation phase, and a retest phase, with naïve raters introduced in each phase. Iterative refinements of the tool were informed by inter-rater reliability, qualitative rater feedback, and consultation with external TMS experts. Results We present two versions of the tool: the 72-item TMS-RAT v1.0, designed to guide comprehensive reporting, and the TMS-RAT v1.1, a subset of 50 items with the highest inter-rater (overall AC1 = 0.78, range = [0.60–0.99]) and test-retest reliability (overall AC1 = 0.82, range = [0.65–1.0]), intended for retrospective evaluation of reporting in systematic reviews, meta-analyses. Conclusion The TMS-RAT is a comprehensive, reliable tool that seeks to improve transparency and reproducibility in TMS research.