2023/08/25 by D. D. Hai, Frederik Brudy, Dang, Hai +5 · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Augmented Reality Applications #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Virtual Reality Applications and Impacts
paper · pdf · doi:10.48550/arxiv.2308.13355
openalex publication_date 2023/08/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image generation systems to enable users iteratively visualize and modify elements of their fictional world using a combination of text input, sketching, and region-based filling. WorldSmith enables novice world builders to quickly visualize a fictional world with layered edits and hierarchical compositions. Through a formative study (4 participants) and first-use study (13 participants) we demonstrate that WorldSmith offers more expressive interactions with prompt-based models. With this work, we explore how creatives can be empowered to leverage prompt-based generative AI as a tool in their creative process, beyond current "click-once" prompting UI paradigms.