For more detailed news, please refer to the Japanese event page.
This paper presents TextAlive, a graphical tool that allows interactive editing of kinetic typography videos in which lyrics or transcripts are animated in synchrony with the corresponding music or speech.
While existing systems have allowed the designer and casual user to create animations, most of them do not take into account synchronization with audio signals. They allow predefined motions to be applied to objects and parameters to be tweaked, but it is usually impossible to extend the predefined set of motion algorithms within these systems.
We therefore propose an integrated design environment featuring
- GUIs that designers can use to create and edit animations synchronized with audio signals,
- integrated tools that programmers can use to implement animation algorithms, and
- a framework for bridging the interfaces for designers and programmers.
A preliminary user study with designers, programmers, and casual users demonstrated its capability in authoring various kinetic typography videos.
CHI 2015 Fast-forward
CHI 2015 Slides
TextAlive: Integrated Design Environment for Kinetic Typography
Lights, Animation, Interaction! – Synchronizing Music with Computer-controlled Visuals in Live Performances
We propose a "lyric app," a novel media format of interactive lyric-driven visual art. We developed a framework to support its development, collected 52 examples in the wild, and gained insights into the future of creative culture and the intersection of music and programming.