Language Model Teams as Distributed Systems
2026/03/12 by Elizabeth Mieczkowski, Katherine M. Collins, Ilia Sucholutsky +2 · 14 voices
#cs.MA
paper · pdf
Abstract
Large language models (LLMs) are growing increasingly capable, prompting recent interest in LLM teams. Yet, despite increased deployment of LLM teams at scale, we lack a principled framework for addressing key questions such as when a team is helpful, how many agents to use, how structure impacts performance -- and whether a team is better than a single agent. Rather than designing and testing these possibilities through trial-and-error, we propose using distributed systems as a principled foundation for creating and evaluating LLM teams. We find that many of the fundamental advantages and challenges studied in distributed computing also arise in LLM teams, highlighting the rich practical insights that can come from the cross-talk of these two fields of study.
Citations
Discussions
- Language model teams as distributed systems [hn, 104 points, 46 comments]
- CDS Faculty Fellow @sucholutsky.bsky.social co-authored a new paper arguing that teams of language models should be studied like distributed computer systems, with similar coordination and scaling cha [bsky, 5 points, 2 comments]
- 11/ Paper and code: arxiv.org/abs/2603.12229. Thanks to my amazing collaborators: Katie Collins, @sucholutsky.bsky.social, @natvelali.bsky.social, @cocoscilab.bsky.social !! [bsky, 3 points, 0 comments]
- https://arxiv.org/abs/2603.12229 大規模言語モデル（LLM）のチームを分散システムとして捉える研究です。 LLMチームが有用な状況や最適なエージェント数、構造の影響などを探求します。 分散コンピューティングの知見をLLMチームの設計と評価に応用する新しい視点を提供します。 [bsky, 1 points, 1 comments]
- From the "Department Of The Blindingly Obvious" department: "It applies distributed systems theory to LLM teams and finds the same O(n²) communication bottlenecks, straggler delays, and consistency co [bsky, 1 points, 1 comments]
- Language Model Teams as Distrbuted Systems https://arxiv.org/abs/2603.12229 [bsky, 0 points, 0 comments]
- Language Model Teams as Distrbuted Systems https://arxiv.org/abs/2603.12229 (https://news.ycombinator.com/item?id=47401901) [bsky, 0 points, 0 comments]
- ⚡ Hackernews Top story: Language Model Teams as Distrbuted Systems [bsky, 0 points, 0 comments]
- Language model teams as distributed systems https:// arxiv.org/abs/2603.12229 # arxiv [mastodon, 0 points, 0 comments]
- Language Model Teams as Distrbuted Systems https://arxiv.org/abs/2603.12229 [comments] [29 points] [bsky, 0 points, 0 comments]
- Language Model Teams as Distrbuted Systems https://arxiv.org/abs/2603.12229 (https://news.ycombinator.com/item?id=47401901) [bsky, 0 points, 0 comments]
- https://bsky.app/profile/buzzing.cc.web.brid.gy/post/3mhbpozrjafz2 [bsky, 0 points, 0 comments]
- Language Model Teams as Distrbuted Systems [bsky, 0 points, 0 comments]
- Language Model Teams as Distrbuted Systems #HackerNews https://arxiv.org/abs/2603.12229 [bsky, 0 points, 0 comments]
Related