Top pageBlogContact
Projects
List of projects
TextAliveGriffithSongle Syncf3.js
Research projectsDesign and Engineering projects
PublicationsDesignActivitiesTimelineCollaborations日本語
Awards
Invited Talks
Lectures
Publications
Selected
Reviewed
Others
Dissertation
Timeline

Awards and Honors

I have received 13 international and 9 domestic awards.

Domestic
International
Visual Computing 2024 VC Poster Award for the co-authored poster of techniques behind Forest Tale
September 12, 2024
IPSJ Yamashita SIG Research Award (SIGHCI)
July 31, 2024
IPSJ Yamashita SIG Research Award (SIGMUS)
July 31, 2024
IPSJ Symposium Interaction 2024 Best Paper Award and Interactivity Award ("People's Choice" category)
March 6, 2024
IPSJ SIGMUS Best Presentation Award ("Best Research" category)
August 28, 2023
ACM CHI '23 Honorable Mention Award
April 23, 2023
Japan ACM SIGCHI Chapter Distinguished Young Researcher Award
February 18, 2023
ISID '22 Best Poster Award
March 15, 2022
IEEE VL/HCC '21 Best Short Paper Award for the co-authored Roly-poly short paper
October 13, 2021
IPSJ/ACM Award for Early Career Contributions to Global Research
March 18, 2021
ISID '21 Best Poster Award
March 17, 2021
IEEE PacificVis '18 Honorable Mention Poster Award for the co-authored TextTimeline poster
April 12, 2018
IPSJ Interaction '16 Interactive Presentation Award (Program Committee selection)
March 4, 2016
SMC '15 Best Paper for the co-authored CrossSong paper
July 30, 2015
ACM CHI '15 Honorable Mention Award
April 23, 2015
JSSST WISS '14 Best Paper Award
November 28, 2014
HAI '14 Best Paper Nominee
October 31, 2014
IPSJ SIGMUS Best Presentation Award
August 1, 2014
PhD dissertation selected for IPSJ Quick Report on Doctoral Theses Recommended by SIGs
July 22, 2014
JDP Good Design Award for OpenPool Project
October 1, 2013
ACM PLDI '13 Student Research Competition Finalist
June 17, 2013
ACM CHI '13 Honorable Mention Award
April 27, 2013
Microsoft Research Asia Fellowship 2012 Award
2012
Microsoft Research 7th Collaborative Research (CORE7) Program Principal Investigator
April 2011 - March 2012
JSPS Research Fellowships for Young Scientists (DC1)
April 2011 - March 2014
4th Rakuten Research & Development Symposium Best Research & Development Award
November 1, 2011
ACM Student Research Competition Grand Finals Finalist
2010
ACM SIGGRAPH '09 Laval Virtual Award (Best of Emerging Technologies)
August 2009
ACM CHI '09 Student Research Competition 1st Place
April 2009
IPA Exploratory IT Human Resources Project (MITOH)
December 2008 - August 2009

Invited Talks

Mizuho India Japan Study Centre at IIM Bangalore, Meijin-Samvad webinar series, "Impact & Synergy of Manga, Anime, and Video Games: Japanese Soft Power’s Impact on Global Markets - Positive? Negative? Balanced?" panelist
August 23, 2024
Japan ACM SIGCHI Chapter International Symposium on HCI, "The HCI researcher as toolsmith," award talk for 2023 Japan ACM SIGCHI Chapter Distinguished Young Researcher Award, YouTube
February 18, 2023
Mozilla MIECO weekly meeting, "A Toolsmith for Programmers, Musicians, and Anime Creators"
February 8, 2023
Programming Languages Mentoring Workshop at ACM SPLASH 2022 "Post PhD Careers Panel" panelist
December 7, 2022
Connichi invited panel, "How Academics Contribute to Anime's Future" panelist
September 4, 2021
ISID 2021, "Creativity Support for People with Diverse Technical Background"
March 15, 2021
RIEC International Symposium on HCI, "Programming for X: Programming Experience Research for Convivial Computing"
January 24, 2020
SPLASH LIVE 2017, Keynote, "User Interfaces for Live Programming", Website
October 24, 2017
CMU HCII, Special Human-Computer Interaction Talk, "Delivering Benefits of Programming to Everyone through Programming Experience Research", Video
June 1, 2017
Dagstuhl Seminar 17232 (Computational Interactivity), "The Future of Programming and Data Sciences"
June 1, 2017
Viewpoints Research Institute and Y Combinator Research HARC, "Programming with {Examples | People}"
April 1, 2016
University of Bristol BIG Group seminar, "Integrated Design Environments for Creating Interactive Media Content"
July 1, 2015
University of Manitoba HCI Lab seminar, "Toward Live Programming in the Real World"
June 1, 2014
University of Toronto DGP seminar, "Toward Live Programming in the Real World"
June 1, 2014
University of Washington dub seminar, "Integrated Graphical Representations for Programming with Real-world Input and Output", Video
October 1, 2013
Microsoft Research Asia, Document
May 1, 2011

Lectures

The University of Tokyo Non-Research Tips for Information Science Researchers Guest Lectures "Research community" and "DevOps for research"
Jun. 19, 2024, Jun. 26, 2024

Publications

The following publications list is automatically generated from the BibTeX file.

Selected peer-reviewed publications

Resolve DOICopy BibTeX

Griffith: A Storyboarding Tool Designed with Japanese Animation Professionals

2024CHI '24Griffith
Jun Kato, Kenta Hara, Nao Hirasawa
Proceedings of the CHI Conference on Human Factors in Computing Systems
Slides PDFResolve DOICopy BibTeX

Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications

2023CHI '23ACM CHI '23 Honorable Mention AwardLyric App Framework
Jun Kato, Masataka Goto
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Paper PDFPoster PDFSlides PDFResolve DOICopy BibTeX

Songle Sync: A Large-Scale Web-based Platform for Controlling Various Devices in Synchronization with Music

2018MM '18Songle Sync
Jun Kato, Masa Ogata, Takahiro Inoue, Masataka Goto
Proceedings of the 26th ACM International Conference on Multimedia, pp.1697-1705
Paper PDFSlides PDFResolve DOICopy BibTeX

F3.Js: A Parametric Design Tool for Physical Computing Devices for Both Interaction Designers and End-users

2017DIS '17f3.js
Jun Kato, Masataka Goto
Proceedings of the 2017 Conference on Designing Interactive Systems, pp.1099-1110
Resolve DOICopy BibTeX

Programming with Examples to Develop Data-Intensive User Interfaces

2016Special Issue on 21st User InterfacesProgramming with Examples
Jun Kato, Takeo Igarashi, Masataka Goto
IEEE Computer 49(7), pp.34-42
Paper PDFSlides PDFResolve DOICopy BibTeX

TextAlive: Integrated Design Environment for Kinetic Typography

2015CHI '15ACM CHI '15 Honorable Mention AwardTextAlive
Jun Kato, Tomoyasu Nakano, Masataka Goto
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp.3403-3412
Paper PDFSlides PDFResolve DOICopy BibTeX

It's Alive! Continuous Feedback in UI Programming

2013PLDI '13It's Alive! (TouchDevelop)
Sebastian Burckhardt, Manuel Fahndrich, Peli de Halleux, Sean McDirmid, Michal Moskal, Nikolai Tillmann, Jun Kato
Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation, pp.95-104
Paper PDFSlides PDFResolve DOICopy BibTeX

Picode: Inline Photos Representing Posture Data in Source Code

2013CHI '13ACM CHI '13 Honorable Mention AwardPicode
Jun Kato, Daisuke Sakamoto, Takeo Igarashi
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp.3097-3100
Paper PDFPoster PDFSlides PDFResolve DOICopy BibTeX

DejaVu: Integrated Support for Developing Interactive Camera-Based Programs

2012UIST '12DejaVu
Jun Kato, Sean McDirmid, Xiang Cao
Proceedings of the 25th Annual ACM symposium on User Interface Software and Technology, pp.189-196

Journal/conference/workshop publications

All of these publications, except those explicitly marked as the invited articles, underwent a review process; most of these publications are considered either archival or semi-archival.

Resolve DOICopy BibTeX

On the Relationship between HCI Researchers and Creators---Or How I Became a Toolsmith

2023Invited articleCreativity Support Environments
Jun Kato
XRDS 29(4), pp.26-31
Slides PDFResolve DOICopy BibTeX

Special Interest Group on Creativity and Cultures in Computing

2023CHI EA '23Creativity Support Environments
Jun Kato, Jonas Frich, Zhicong Lu, Jennifer Jacobs, Kumiyo Nakakoji, Celine Latulipe
Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
Resolve DOICopy BibTeX

ODEN: Live Programming for Neural Network Architecture Editing

2022IUI '22
Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, Takeo Igarashi
27th International Conference on Intelligent User Interfaces, pp.392-404
Paper PDFResolve DOICopy BibTeX

Guided Optimization for Image Processing Pipelines

2021VL/HCC '21IEEE VL/HCC '21 Best Short Paper Award
Yuka Ikarashi, Jonathan Ragan-Kelley, Tsukasa Fukusato, Jun Kato, Takeo Igarashi
Proceedings of the 2021 IEEE Symposium on Visual Languages and Human-Centric Computing
Paper PDFResolve DOICopy BibTeX

Lyric Video Analysis Using Text Detection and Tracking

2020DAS '20
Shota Sakaguchi, Jun Kato, Masataka Goto, Seiichi Uchida (Eds. Xiang Bai, Dimosthenis Karatzas, Daniel Lopresti)
Document Analysis Systems, pp.426-440
Paper PDFSlides PDFResolve DOICopy BibTeX

Rethinking Programming "Environment": Technical and Social Environment Design toward Convivial Computing

2020Convivial Computing Salon '20Programming as Communication
Jun Kato, Keisuke Shimakage
Companion Proceedings of the 4th International Conference on the Art, Science, and Engineering of Programming, pp.95-103
Paper PDFSlides PDFResolve DOICopy BibTeX

DeployGround: A Framework for Streamlined Programming from API playgrounds to Application Deployment

2018VL/HCC '18DeployGround
Jun Kato, Masataka Goto
Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing, pp.259-263
Paper PDFSlides PDFResolve DOICopy BibTeX

Reactile: Programming Swarm User Interfaces Through Direct Physical Manipulation

2018CHI '18Reactile
Ryo Suzuki, Jun Kato, Mark D. Gross, Tom Yeh
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp.199:1-199:13
Copy BibTeX

A Singing Instrument for Real-Time Vocal-Part Arrangement of Music and Audio Signals

2017SMC '17
Yuta Ojima, Tomoyasu Nakano, Satoru Fukayama, Jun Kato, Masataka Goto, Katsutoshi Itoyama, Kazuyoshi Yoshii
Proceedings of the 14th Sound and Music Computing Conference, pp.559-563
Paper PDFResolve DOICopy BibTeX

User-Generated Variables: Streamlined Interaction Design for Feature Requests and Implementations

2017PX '17User-Generated Variables
Jun Kato, Masataka Goto
Companion to the First International Conference on the Art, Science and Engineering of Programming, pp.28:1-28:7
Resolve DOICopy BibTeX

The CrossSong Puzzle: Developing a Logic Puzzle for Musical Thinking

2017CrossSong
Jordan B.L. Smith, Jun Kato, Satoru Fukayama, Graham Percival, Masataka Goto
Journal of New Music Research, pp.1-16
Paper PDFPoster PDFRelated linkCopy BibTeX

Live Tuning: Expanding Live Programming Benefits to Non-Programmers

2016LIVE '16Live Tuning
Jun Kato, Masataka Goto
Proceedings of the Second Workshop on Live Programming Systems
Resolve DOICopy BibTeX

PlaylistPlayer: An Interface Using Multiple Criteria to Change the Playback Order of a Music Playlist

2016IUI '16
Tomoyasu Nakano, Jun Kato, Masahiro Hamasaki, Masataka Goto
Proceedings of the 21st International Conference on Intelligent User Interfaces, pp.186-190
Paper PDFRelated linkCopy BibTeX

CrossSong Puzzle: Generating and Unscrambling Music Mash-ups with Real-time Interactivity

2015SMC '15SMC '15 Best Paper AwardCrossSong
Jordan Smith, Graham Parcival, Jun Kato, Masataka Goto, Satoru Fukayama
Proceedings of the 12nd Sound and Music Computing Conference, pp.61-67
Resolve DOICopy BibTeX

TextAlive Online: Live Programming of Kinetic Typography Videos with Online Music

2015ICLC '15TextAlive
Jun Kato, Tomoyasu Nakano, Masataka Goto
Proceedings of the First International Conference on Live Coding, pp.199-205
Paper PDFSlides PDFResolve DOICopy BibTeX

Sharedo: To-do List Interface for Human-agent Task Sharing

2014HAI '14HAI '14 Best Paper NomineeSharedo
Jun Kato, Daisuke Sakamoto, Takeo Igarashi, Masataka Goto
Proceedings of the Second International Conference on Human-Agent Interaction, pp.345-351
Paper PDFSlides PDFRelated linkCopy BibTeX

VisionSketch: Integrated Support for Example-centric Programming of Image Processing Applications

2014GI '14VisionSketch
Jun Kato, Takeo Igarashi
Proceedings of the 2014 Graphics Interface Conference, pp.115-122
Paper PDFPoster PDFResolve DOICopy BibTeX

CapStudio: An Interactive Screencast for Visual Application Development

2014CHI EA '14CapStudio
Koumei Fukahori, Daisuke Sakamoto, Jun Kato, Takeo Igarashi
Extended Abstracts on Human Factors in Computing Systems, pp.1453-1458
Paper PDFSlides PDFResolve DOICopy BibTeX

OpenPool: Community-based Prototyping of Digitally-augmented Billiard Table

2013IEEE GCCE '13OpenPool
Jun Kato, Takashi Nakashima, Hideki Takeoka, Kazunori Ogasawara, Kazuma Murao, Toshinari Shimokawa, Masaaki Sugimoto
Proceedings of the 2nd IEEE Global Conference on Consumer Electronics, pp.175-176
Paper PDFSlides PDFResolve DOICopy BibTeX

Phybots: A Toolkit for Making Robotic Things

2012DIS '12Phybots
Jun Kato, Daisuke Sakamoto, Takeo Igarashi
Proceedings of the 9th Conference on Designing Interactive Systems, pp.248-257
Paper PDFPoster PDFSlides PDFResolve DOICopy BibTeX

Multi-touch Interface for Controlling Multiple Mobile Robots

2009CHI EA '09ACM CHI '09 Student Research Competition 1st PlaceMulti-touch Interface for Controlling Multiple Mobile Robots
Jun Kato, Daisuke Sakamoto, Masahiko Inami, Takeo Igarashi
Extended Abstracts on Human Factors in Computing Systems, pp.3443-3448

Other publications

The following publications are either invited articles or non-archival demo/poster papers.

Resolve DOICopy BibTeX

DanceUnisoner: A Parametric, Visual, and Interactive Simulation Interface for Choreographic Composition of Group Dance

2024
Shuhei Tsuchida, Satoru Fukayama, Jun Kato, Hiromu Yakura, Masataka Goto
IEICE Transactions on Information and Systems E107.D(3), pp.386-399
Slides PDFCopy BibTeX

Lights, Animation, Interaction! – Synchronizing Music with Computer-controlled Visuals in Live Performances

2023SAS 34TextAlive
Jun Kato
Society for Animation Studies 34th Annual Conference: The Animated Environment
Slides PDFCopy BibTeX

Past, Present, and Future of “Toolsmiths” in Japanese Animation

2022SAS '22Griffith
Jun Kato
Society for Animation Studies 2022 Conference: Animation Unlocked
Related linkCopy BibTeX

Griffith: Prototype of A Web-based Tool for Authoring Japanese Anime Storyboards

2022ISID '22ISID '22 Best Poster AwardGriffith
Jun Kato, Kazuya Murata, Kenta Hara, Satoko Okuno, Tetsushi Suzuki, Nao Hirasawa
Slides PDFCopy BibTeX

Past, Present, and Future of Storyboarding in Japanese Animation

2021SAS '21Griffith
Jun Kato, Ryotaro Mihara, Nao Hirasawa
Society for Animation Studies 2021 Conference: Animated Energies
Related linkCopy BibTeX

Research on Anime Storyboards for Individual and Collaborative Creativity

2021ISID '21ISID '21 Best Poster AwardGriffith
Jun Kato, Ryotaro Mihara Mihara, Kazuya Murata, Kenta Hara, Nao Hirasawa
Resolve DOICopy BibTeX

Live Programming Environment for Deep Learning with Instant and Editable Neural Network Visualization

2020PLATEAU '19
Chunqi Zhao, Tsukasa Fukusato, Jun Kato, Takeo Igarashi (Eds. Sarah Chasins, Elena L. Glassman, Joshua Sunshine)
10th Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU 2019), pp.7:1-7:5
Resolve DOICopy BibTeX

Placing Music in Space: A Study on Music Appreciation with Spatial Mapping

2018DIS '18 Companion
Shoki Miyagawa, Yuki Koyama, Jun Kato, Masataka Goto, Shigeo Morishima
Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems, pp.39-43
Slides PDFRelated linkCopy BibTeX

User Interfaces for Live Programming

2017LIVE '17Keynote talk at LIVE '17User Interfaces for Live Programming
Jun Kato
Resolve DOICopy BibTeX

The Future of Programming and Data Sciences

2017
Jun Kato (Eds. Xiaojun Bi, Otmar Hilliges, Takeo Igarashi, Antti Oulasvirta)
Computational Interactivity (Dagstuhl Seminar 17232), pp.56-56
Paper PDFResolve DOICopy BibTeX

A Robotic Framework for Video Recording and Authoring

2017HRI '17 Companionf3.js
Jun Kato, Masataka Goto
Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp.41-41
Paper PDFResolve DOICopy BibTeX

Form Follows Function(): An IDE to Create Laser-cut Interfaces and Microcontroller Programs from Single Code Base

2015UIST '15 Adjunctf3.js
Jun Kato, Masataka Goto
Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology, pp.43-44
Paper PDFPoster PDFResolve DOICopy BibTeX

Integrated Visual Representations for Programming with Real-world Input and Output

2013UIST '15 Adjunct (Doctoral Symposium)
Jun Kato
Adjunct Proceedings of the 26th Annual ACM symposium on User Interface Software and Technology, pp.57-60
Paper PDFPoster PDFSlides PDFRelated linkCopy BibTeX

Visionsketch: Gesture-based Language for End-user Computer Vision Programming

2013Student Research Competition at PLDI '13ACM PLDI '13 Student Research Competition FinalistVisionSketch
Jun Kato
The 34th ACM SIGPLAN Conference on Programming Language Design and Implementation
Paper PDFPoster PDFResolve DOICopy BibTeX

Surfboard: Keyboard with Microphone as a Low-cost Interactive Surface

2010UIST '10 AdjunctSurfboard
Jun Kato, Daisuke Sakamoto, Takeo Igarashi
Adjunct Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, pp.387-388
Paper PDFRelated linkCopy BibTeX

A Toolkit for Easy Development of Mobile Robot Applications with Visual Markers and a Ceiling Camera

2009UIST '09 DemoPhybots
Daisuke Sakamoto, Jun Kato, Masahiko Inami, Takeo Igarashi
The 22nd Annual ACM Symposium on User Interface Software and Technology
Paper PDFResolve DOICopy BibTeX

CRISTAL, Control of Remotely Interfaced Systems using Touch-based Actions in Living Spaces

2009SIGGRAPH '09 E-TechLaval Virtual Award (SIGGRAPH '09 Best of E-Tech)CRISTAL
Thomas Seifried, Christian Rendl, Florian Perteneder, Jakob Leitner, Michael Haller, Daisuke Sakamoto, Jun Kato, Masahiko Inami, Stacey D. Scott
ACM SIGGRAPH 2009 Emerging Technologies

Dissertation

Paper PDFCopy BibTeX

Integrated Graphical Representations for Development of Programs with Real-world Input and Output

2014
Jun Kato