Top pageBlogContact
Projects
List of projects
TextAliveGriffithSongle Syncf3.js
Research projectsDesign and Engineering projects
PublicationsDesignActivitiesTimelineCollaborations日本語

Creativity support research "in the wild"

Poster

Research on creativity support tools (CSTs) has long been conducted in the field of human-computer interaction (HCI), but there is growing criticism that applied computer science, including HCI, has typically been conducted and evaluated in a limited cultural context, such as the fast-paced academic community and the WEIRD (Western, educated, industrialized, rich, and developed) part of the world.

This poster presents recent efforts in creativity support research "in the wild", taking a longitudinal and constructive approach with the help of creators outside the research community to build computational tools for creative activities.

Examples include TextAlive and its API for creating lyric-driven visual art [ACM CHI 2015, 2023] and Griffith for creating animation storyboards [ACM CHI 2024], both of which contribute to the discussion of how to develop human-centered AI that nurtures the creativity of people with diverse technical and cultural backgrounds.

References

  1. Ben Shneiderman. 2007. Creativity support tools: accelerating discovery and innovation. Commun. ACM 50, 12 (December 2007), 20–32. https://doi.org/10.1145/1323688.1323689
  2. Erin Cherry and Celine Latulipe. 2014. Quantifying the Creativity Support of Digital Tools through the Creativity Support Index. ACM Trans. Comput.-Hum. Interact. 21, 4, Article 21 (August 2014), 25 pages. https://doi.org/10.1145/2617588
  3. Andruid Kerne, Andrew M. Webb, Celine Latulipe, Erin Carroll, Steven M. Drucker, Linda Candy, and Kristina Höök. 2013. Evaluation methods for creativity support environments. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 3295–3298. https://doi.org/10.1145/2468356.2479670
  4. Jingyi Li, Eric Rawn, Jacob Ritchie, Jasper Tran O'Leary, and Sean Follmer. 2023. Beyond the Artifact: Power as a Lens for Creativity Support Tools. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 47, 1–15. https://doi.org/10.1145/3586183.3606831
  5. Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau, Klaus Opwis, and Katharina Reinecke. 2021. How WEIRD is CHI? In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 143, 1–14. https://doi.org/10.1145/3411764.3445488
  6. Paul Dourish and Scott D. Mainwaring. 2012. Ubicomp's colonial impulse. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). Association for Computing Machinery, New York, NY, USA, 133–142. https://doi.org/10.1145/2370216.2370238
  7. Jun Kato, Kenta Hara, and Nao Hirasawa. 2024. Griffith: A Storyboarding Tool Designed with Japanese Animation Professionals. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 233, 1–14. https://doi.org/10.1145/3613904.3642121
  8. Jingyi Li, Sonia Hashim, and Jennifer Jacobs. 2021. What We Can Learn From Visual Artists About Software Development. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 314, 1–14. https://doi.org/10.1145/3411764.3445682
  9. Jun Kato. 2023. On the Relationship between HCI Researchers and Creators---Or How I Became a Toolsmith. XRDS 29, 4 (Summer 2023), 26–31. https://doi.org/10.1145/3596927
  10. Wendy Mackay. 2000. Responding to cognitive overload : Co-adaptation between users and technology. Intellectica 30, 1 (2000), 177–193. https://doi.org/10.3406/intel.2000.1597
  11. Jun Kato, Tomoyasu Nakano, and Masataka Goto. 2015. TextAlive: Integrated Design Environment for Kinetic Typography. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 3403–3412. https://doi.org/10.1145/2702123.2702140
  12. Michel Beaudouin-Lafon. 2000. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '00). Association for Computing Machinery, New York, NY, USA, 446–453. https://doi.org/10.1145/332040.332473
  13. Glaveanu, V.P., Hanchett Hanson, M., Baer, J., Barbot, B., Clapp, E.P., Corazza, G.E., Hennessey, B., Kaufman, J.C., Lebuda, I., Lubart, T., Montuori, A., Ness, I.J., Plucker, J., Reiter-Palmon, R., Sierra, Z., Simonton, D.K., Neves-Pereira, M.S. and Sternberg, R.J. (2020), Advancing Creativity Theory and Research: A Socio-cultural Manifesto. J Creat Behav, 54: 741-745. https://doi.org/10.1002/jocb.395
  14. Jun Kato and Masataka Goto. 2023. Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 124, 1–18. https://doi.org/10.1145/3544548.3580931

Projects

TextAlive

An integrated design environment for kinetic typography; desktop app revamped as a web service in 2015.

2014-2024CHI '15Creativity Music PwE Communication Live IDE Design
Lyric App Framework

We propose a "lyric app," a novel media format of interactive lyric-driven visual art. We developed a framework to support its development, collected 52 examples in the wild, and gained insights into the future of creative culture and the intersection of music and programming.

2020-2024CHI '23Communication Creativity Music Toolkit
Griffith

Griffith is a web-based authoring tool for Japanese animation (anime) storyboards.

2019-2024CHI '24Creativity