Abstract

We propose a "lyric app," a novel media format of interactive lyric-driven visual art. We developed a framework to support its development, analyzed 52 contest submissions created in the wild in 2020–2021, and gained insights into the future of creative culture and the intersection of music and programming.
The programming contests have continued since the paper was published. A 2025 Japanese journal paper reported an analysis of four years of submissions. In 2026, the number of submissions increased substantially compared with the previous year.
Programming Contests

We made the framework publicly available in 2020 and have been conducting an annual programming contest in "Hatsune Miku Magical Mirai" — a live show and exhibition, connecting with Hatsune Miku through creativity.
Presentation materials
| Where? | Room Y07 + Y08, Congress Center Hamburg (CCH) |
| When? | |
| CHI '23 Program |
CHI 2023 Video Preview (30s)
CHI 2023 Pre-recorded Presentation Video
Publications
Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications
Revision history
Relevant projects
To realize a creative society in which people want to create content with the help of AI technologies, a sustainable ecosystem in which content inspires the next creation serves a critical role.
I shed light on the creative culture in such an ecosystem, build a "creativity support environment (CSE)" that supports the content creation and distribution process, and aim to establish Human-Computer Interaction (HCI) technologies that engineer, nurture, and maintain the creative culture.
Top page
