TaleBrush: Sketching Stories with Generative Pretrained Language Models

blog_img0

John Joon Young Chung (University of Michigan), Wooseok Kim (KAIST), Kang Min Yoo (Naver AI LAB), Hwaran Lee (Naver AI LAB), Eytan Adar (University of Michigan), Minsuk Chang (Naver AI LAB)

Abstract

While advanced text generation algorithms (e.g., GPT-3) have enabled writers to co-create stories with an AI, guiding the narrative remains a challenge. Existing systems often leverage simple turn-taking between the writer and the AI in story development. However, writers remain unsupported in intuitively understanding the AI’s actions or steering the iterative generation. We introduce TaleBrush, a generative story ideation tool that uses line sketching interactions with a GPT-based language model for control and sensemaking of a protagonist’s fortune in co-created stories. Our empirical evaluation found our pipeline reliably controls story generation while maintaining the novelty of generated sentences. In a user study with 14 participants with diverse writing experiences, we found participants successfully leveraged sketching to iteratively explore and write stories according to their intentions about the character’s fortune while taking inspiration from generated stories. We conclude with a reflection on how sketching interactions can facilitate the iterative human-AI co-creation process.

Paper Code

Video

Examples from TaleBrush

Mike’s story

tb1_1 tb1_2 tb1_3 tb1_4

Sherry’s story

tb2_1 tb2_2 tb2_3 tb2_4