Lyric App Framework

2020-2023

CHI '23

ACM CHI '23 Honorable Mention Award

関連キーワード: Communication, Creativity, Music, Toolkit

歌詞が魅力的にアニメーションするインタラクティブなビジュアルアートとして新たなメディア様式「リリックアプリ」を提案しました。その開発を支援するフレームワークを実装し、プログラミング・コンテストを開催し、応募された52作品を分析することで、創作文化の未来および音楽とプログラミングの関わりについて洞察を得ました。

会場	Room Y07 + Y08, Congress Center Hamburg (CCH)
日時	Thu, Apr 27 \| 09:00 - 09:14
CHI '23 Program	Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications - CHI '23

CHI 2023 Video Preview（30秒）

CHI 2023 Pre-recorded Presentation Video

引用するならコレ！2023CHI '23

Jun Kato, Masataka Goto

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

ACM CHI '23 Honorable Mention Award

スライドPDF DOIを照会

BibTeX:

@inproceedings{chi2023-kato-lyric-app-framework,
  title = {Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications},
  author = {Kato, Jun and Goto, Masataka},
  year = {2023},
  booktitle = {Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems},
  location = {Hamburg, Germany},
  publisher = {ACM},
  address = {New York, NY, USA},
  series = {CHI '23},
  doi = {10.1145/3544548.3580931},
  isbn = {9781450394215},
  url = {https://doi.org/10.1145/3544548.3580931},
  abstract = {Lyric videos have become a popular medium to convey lyrical content to listeners, but they present the same content whenever they are played and cannot adapt to listeners’ preferences. Lyric apps, as we name them, are a new form of lyric-driven visual art that can render different lyrical content depending on user interaction and address the limitations of static media. To open up this novel design space for programmers and musicians, we present Lyric App Framework, a web-based framework for building interactive graphical applications that play musical pieces and show lyrics synchronized with playback. We designed the framework to provide a streamlined development experience for building production-ready lyric apps with creative coding libraries of choice. We held programming contests twice and collected 52 examples of lyric apps, enabling us to reveal eight representative categories, confirm the framework’s effectiveness, and report lessons learned.},
  articleno = {124},
  numpages = {18},
  keywords = {toolkit, multimedia control, music synchronization},
  slides = {https://junkato.jp/publications/chi2023-kato-lyric-apps-slides.pdf},
  project = {lyric-app-framework},
  addition = {ACM CHI '23 Honorable Mention Award}
}

クリップボードにコピー

04/19/2023

事前録画のプレゼンテーション動画を追加

04/16/2023

Video Preview を追加

03/31/2023

プロジェクトページを仮公開

Lyric App Framework
A Web-based Framework for Developing Interactive Lyric-driven Musical Applications

概要

発表内容

発表文献

Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications

更新履歴

Lyric App FrameworkA Web-based Framework for Developing Interactive Lyric-driven Musical Applications

概要

発表内容

発表文献

Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications

更新履歴

Lyric App Framework
A Web-based Framework for Developing Interactive Lyric-driven Musical Applications