Replication Package (v2): Output Format × Model Identity Interaction Effects

2026/07/23 by Yang Yang
Computer Science · Decision Sciences · #Data Visualization and Analytics #Identification (biology) #Identity (music) #Interaction model #Key (lock) #Psychometric Methodologies and Testing #Replication (statistics) #Topic Modeling #cs.SE

paper · pdf · doi:10.5281/zenodo.21505157

published in arXiv (Cornell University) (Cornell University)

openalex publication_date 2026/07/23 · openalex created_date 2026/07/24 · openalex updated_date 2026/08/05

Abstract

v2 update (2026-07-23): Qwen n=10→n=20 (+18 runs, ¥0.24). Total 3,994 runs. Qwen format effect now significant (χ²(2)=6.28, p<0.05). All figures regenerated.

Citations

• Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents

Related

• Reproducibility Report for the Paper: QN-based Modeling and Analysis of Software Performance Antipatterns for Cyber-Physical Systems
• Replication in the Social Sciences
• Replication Data for: Meta-Analysis of the Effects of Voting Advice Applications
• Replication – The ugly duckling of science?
• Verify original results through reanalysis before replicating