Jun Kato
Human-Computer Interaction researcher, Ph.D. (Computer Science)

Research area

I am interested in broad area of Human-Computer Interaction (HCI), and have been especially focused on designing user interfaces and integrated environments for creativity support. Improving Programming Experience (PX) is an important subgoal to support the creativity of people with diverse technical backgrounds.


Jun Kato is a HCI researcher at AIST, Japan. He worked for Microsoft and Adobe and received a Ph.D. from The University of Tokyo supervised by Prof. Takeo Igarashi in 2014. He has focused on PX research, founded SIGPX, and regularly gained academic recognition such as ACM CHI 2013/2015 Best Paper Honorable Mention.

Recent updates

Renewed the website. See how it's made—source code available! Beside UI changes, newly-added content includes the follow-up page for the LIVE keynote talk discussing user interfaces for Live Programming, the f3.js project page, the TextAlive project page, and the design portfolio.
Provided a keynote talk at SPLASH LIVE 2017. I'm writing a follow-up article about the talk, but for now, please refer to the talk abstract and slide deck.
Will serve as a keynote speaker at SPLASH LIVE 2017. See you in Vancouver!
Visited Pittsburgh for ACM UIST 2017 PC meeting, gave a talk at CMU HCII, dropped by Seattle and visited UW and Microsoft Research.
Presented f3.js at ACM DIS 2017. Slides are available for download in the publications page.

Research topics

While I am interested in broad area of HCI and have a high-level goal of supporting people's creativity, I have been especially focused on the following topics. For the list of concrete projects, see Projects.

User Interfaces for Live Programming

Live programming eliminates the gulf between code and execution. User interface design plays the key role in providing live programming experience.

With appropriate user interface design, live programming can potentially benefit end-users, be used for applications whose computation takes a long time, and mean much more than merely providing real-time information of the running program.

Programming with Examples

The programming-with-examples (PwE) workflow lets developers create interactive applications with the help of example data. It takes a general programming environment and adds dedicated user interfaces for visualizing and managing the data.

This is particularly useful in developing data-intensive applications such as physical computing, image processing, video authoring, machine learning, and others that require intensive parameter tuning.


Below is the list of research projects, followed by the list of design and/or engineering projects. See Design for the design-oriented list of my projects.

Recent research projects

Songle Sync Tutorial
An interactive tutorial for the Songle Sync API that allows controlling numerous devices in synchrony with the songs.
2017-2018(Work in progress)
A parametric design tool for physical computing devices for both interaction designers and end-users.
2015-2018DIS '17
An integrated design environment for kinetic typography; desktop app revamped as a web service in 2015.
2014-2018CHI '15

Previous research projects

A logic puzzle for "musical thinking," deepening your understanding on music while enjoying the puzzle.
2015-2017SMC '15Co-authoredMusic
A to-do list interface for sharing tasks between human and agents including robots and software personal assistants.
2011-2014HAI '14Robot
An IDE for example-centric programming of image processing applications, enabling fluid transition between abstract text-based coding and concrete direct manipulation.
2013-2014GI '14IDE NUI
An IDE for visual applications that shows interactive screencasts for replaying program executions and editing visual parameters.
2012-2014CHI EA '14Co-authoredIDE
It's Alive! (TouchDevelop)
The TouchDevelop IDE enables live programming for user interface programming by cleanly separating the rendering and non-rendering aspects of a UI program, allowing the display to be refreshed on a code change without restarting the program.
2012-2013PLDI '13IDE
An IDE that shows inline photos representing posture data in source code. It manages the data binding between the photos and posture data and show photos to aid source code comprehension and editing.
2011-2013CHI '13IDE Robot
An open-source project that augments a standard billiard table with the cutting-edge computing technologies to provide the "super-billiard" experience.
2012-2013IEEE GCCE '13Toolkit NUI
An IDE that eases the iterative development of interactive camera-based programs with support for monitoring, recording, reviewing, and reprocess temporal data
A toolkit that allows researchers and interaction designers to rapidly prototype applications with locomotive robotic things.
2009-2012DIS '12Toolkit Robot
A technique to detect simple gestures of "surfing" (moving a hand horizontally) on a standard keyboard by analyzing recorded sounds in real-time with a microphone attached close to the keyboard.
2010UIST '10 AdjunctNUI
A "pressure-sensitive" programming environment with visual feedbacks of the built-in 2D physical simulator.
2009インタラクション2010デモIDE NUI
A table-top interface that provides a streaming video view of the living room, so users can walk up to it, see the layout of the room and interact with the TV, lighting, cleaning robot, and so on.
2009SIGGRAPH '09 E-TechCo-authoredRobot NUI
Multi-touch Interface for Controlling Multiple Mobile Robots
A multi-touch interface with a top-down view from a ceiling-mounted camera for simultaneously controlling multiple mobile robots.
2008-2009CHI EA '09Robot NUI

Private design and/or engineering projects

"junkato.jp" Website
This portfolio website is built with various OSS and itself is open-sourced on GitHub.
Tenju Works web design
Helped renovation of the Tenju Works website.
OngaCREST service flyer and poster design
Designed flyers and posters of the four web services developed by the OngaCREST project.
Home hacking
Have been hacking my home to automate various tasks.
A Java-based tool for listening to your home iTunes Library from anywhere.
A user interface for helping navigation of source code in IDEs. For each row of the keyboard, available namespaces, classes, member variables and methods are shown on the keytops.
CD jacket design
Designed multiple CD jackets.
An extendible PHP framework for content management of news website.
2006-2008Design Toolkit
arX MusicPlayer
Yet another music player for Windows with a built-in interpreter of a domain-specific language to change "skins."
arX Launcher
Yet another program launcher for Windows written with <300 physical loc.


Please reach me via email or social networking services rather than telephone and facsimile when possible. I rarely check these conventional machines.

Interested in collaborations?