Replication Package (v2): Output Format × Model Identity Interaction Effects

2026/07/23 by Yang Yang
#cs.SE

paper · pdf · doi:10.5281/zenodo.21505157

Abstract

v2 update (2026-07-23): Qwen n=10→n=20 (+18 runs, ¥0.24). Total 3,994 runs. Qwen format effect now significant (χ²(2)=6.28, p<0.05). All figures regenerated.

Citations

• Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents

Related

• Reproducibility Report for the Paper: QN-based Modeling and Analysis of Software Performance Antipatterns for Cyber-Physical Systems
• Replication – The ugly duckling of science?
• Verify original results through reanalysis before replicating
• Reproducibility Report for the Paper: Modeling of Request Cloning in Cloud Server Systems using Processor Sharing
• CANDI data and settings