Top pageBlogContact
Projects
List of projects
TextAliveGriffithSongle Syncf3.js
Research projectsDesign and Engineering projects
PublicationsDesignActivitiesTimelineCollaborations日本語
Timeline
2021
2019

Timeline (2020)

This page shows 2020 updates to the website as well as publication records. View the full timeline.

Updates

September 20, 2020
Released TextAlive App API, a JavaScript library for building "lyric apps" (cf. lyric videos) that show lyrics synchronized with the music playback. Songle Sync (ACM Multimedia 2018) was used to celebrate Hatsune Miku's birthday with over 10,000 participants. Thank you for your birthday messages!
May 31, 2020
Appeared in the Microsoft Research article celebrating the 20th year of MSRA Fellowship, titled "A Story That Has Lasted Twenty Years, A Fellowship That Has Changed a Group of People".
May 15, 2020
Added a preprint of the paper on Rethinking Programming "Environment" in the Programming as Communication project page.
May 9, 2020
Presented Rethinking Programming "Environment" in Convivial Computing Salon 2020, as part of my Programming as Communication project. The recording and slides of my talk are available.
April 1, 2020
My affiliation, AIST, and OTON GLASS, Inc., a Japanese company utilizing personal fabrication technologies to create customized smart glasses, have started a collaborative research project. Please refer to "Programming as Communication" for more details.
January 16, 2020
There have been many committee roles these days. I will provide an invited talk on "Programming for X" at RIEC International Symposium on Human-Computer Interaction as part of the preparation for CHI 2021!

Invited Talks

January 24, 2020
RIEC International Symposium on HCI, "Programming for X: Programming Experience Research for Convivial Computing"

New Projects

Lyric App Framework

We propose a "lyric app," a novel media format of interactive lyric-driven visual art. We developed a framework to support its development, collected 52 examples in the wild, and gained insights into the future of creative culture and the intersection of music and programming.

2020-2026CHI '23Communication Creativity Music Toolkit

Publications

Paper PDFResolve DOICopy BibTeX

Lyric Video Analysis Using Text Detection and Tracking

2020DAS '20
Shota Sakaguchi, Jun Kato, Masataka Goto, Seiichi Uchida (Eds. Xiang Bai, Dimosthenis Karatzas, Daniel Lopresti)
Document Analysis Systems, pp.426-440
Paper PDFSlides PDFResolve DOICopy BibTeX

Rethinking Programming "Environment": Technical and Social Environment Design toward Convivial Computing

2020Convivial Computing Salon '20Programming as Communication
Jun Kato, Keisuke Shimakage
Companion Proceedings of the 4th International Conference on the Art, Science, and Engineering of Programming, pp.95-103
Resolve DOICopy BibTeX

Live Programming Environment for Deep Learning with Instant and Editable Neural Network Visualization

2020PLATEAU '19
Chunqi Zhao, Tsukasa Fukusato, Jun Kato, Takeo Igarashi (Eds. Sarah Chasins, Elena L. Glassman, Joshua Sunshine)
10th Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU 2019), pp.7:1-7:5