2020/04/07 by Eugene Kharitonov, Marco Baroni, Kharitonov, Eugene +1 · 1 citation
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Neural Networks and Applications
paper · pdf · doi:10.48550/arxiv.2004.03420
openalex publication_date 2020/04/07 · openalex created_date 2022/07/26 · openalex updated_date 2026/07/28
Studies of discrete languages emerging when neural agents communicate to\nsolve a joint task often look for evidence of compositional structure. This\nstems for the expectation that such a structure would allow languages to be\nacquired faster by the agents and enable them to generalize better. We argue\nthat these beneficial properties are only loosely connected to\ncompositionality. In two experiments, we demonstrate that, depending on the\ntask, non-compositional languages might show equal, or better, generalization\nperformance and acquisition speed than compositional ones. Further research in\nthe area should be clearer about what benefits are expected from\ncompositionality, and how the latter would lead to them.\n