Schedule & Format
As CHI 2021 will be virtual, STT21 will be virtual and conducted over Zoom. We will additionally offer attendees access to an STT Discord Server with an #STT21 channel for asynchronous text-based conversation and some social fun. The server will be available beyond STT21 and hopefully used for future events.
Please note that the date and times are standardized to JST! Each date links to a time zone convertor, and participants in Europe, the Americas, and Africa should note that the workshop will be from Thursday, May 6, to Saturday, May 8.
| Friday, May 7, 2021 - Future of Smell | |
| Time | Schedule Item |
| 06:00 - 06:10 JST | Introduction & Welcome |
| 06:10 - 06:40 JST | 10-minute provocations by Haruka Matsukura, Emanuela Maggioni, and Judith Amores. |
| 06:40 - 07:10 JST |
Lisena, P., Van Erp, M., Bembibre, C., Leemans, I. "Data Mining and Knowledge Graphs as Backbone for Advanced Olfactory Experiences." Brianza, G., Maggioni, E., Cornelio Martinez, P., Obrist, M. "ESSolation: The Impact of The Loss of Smell on Body Image in the Covid-19 Era." Niedenthal, S., Nilsson, J., Larsson, M., Olofsson, J. "A method for computerized olfactory assessment and training outside of laboratory or clinical settings." Lundén, P., Niedenthal, S., Fredborg, W., Ehrndal, M., Olofsson, J. "NOSEWISE: A Handheld Olfactory Display for VR Smell Training." Bahremand, A., Spackman, C., Gerkin, R., LiKamWa, R., Smith, B. "Virtually composing and dynamically mixing complex odors." Worgan, L., Alexander, J., Fraser, M. "Manipulating Scent Particles with Ultrasonic Transducer Arrays." Rantala, J., Müller, P., Salpavaara, T., Verho, J., Ryynänen, T., Isokoski, P., Kondratev, A., Toimela, N., Vehkaoja, A., Lekkala, J., Kallio, P., Surakka, V. "On Characterizing Olfactory Displays." Sikes, C. "Scent Device Database & Visual Wiki." Kurze, A. "Scented Dice: New interaction qualities for ideating connected devices." Lai, M. K., Cao, Y. Y. "Designing Olfactory Experience for Daily practices with Interactive Olfaction Community." |
| 07:10 - 07:35 JST | Breakout discussions in groups of 4-5 participants with 1-2 organizers |
| 07:35 - 08:00 JST | Reconvene to discuss the challenges and possibilities of smell interfaces. |
| 08:00 - open end JST | Social event with a crowdsourcing activity for Scent Device Wiki. |
| Saturday, May 8, 2021 - Future of Taste | |
| Time | Schedule Item |
| 06:00 - 06:20 JST | 10-minute provocations by Nimesha Ranasinghe and Marianna Obrist. |
| 06:20 - 07:00 JST |
Cornelio, P., Bianza, G., Obrist, M. "The Effect of Smell on Self-Avatar-based Body Image Perception in Virtual Reality." McMillan, C. "AromaCare: Designing Olfactory Experiences for Ongoing Living and Dying Well." Dubey, A., Bhardwaj, N., Veenu, A. "Intelligent Multi-Sensory Food Experience with Visual and Smell Simulation Devices." Jedrysiak, M. and Ammenheuser, J. "Explorations with Breakfast Bot (A Cooking Robot Controlled via Livestream)." Armitage, R., Thanh Vi, C., Yeomas, M. "Sweet Taste and Sweet-Liking Phenotypes: The Challenges of using Sweet Taste as a Reward." Kale, M. and Rikters, M. "Fragmented and Valuable: Following Sentiment Changes in Food Tweets." Berkholz, J. and Stevens, G. "Bourdieu Reloaded: On the Social Construction of Digital Taste." Taitz, A., Shalom, D., Trevisan, M., Mesz, B. "The taste of scales and chords." |
| 07:00 - 07:30 JST | Breakout discussions in groups of 4-5 participants with 1-2 organizers. |
| 07:30 - 08:00 JST | Reconvene to discuss the challenges and possibilities of taste interfaces. |
| 08:00 - open end JST | Social event with a Breakfast Bot performance on Twitch |
| Sunday, May 9, 2021 - Future of Thermal & Chemesthetic | |
| Time | Schedule Item |
| 06:00 - 06:20 JST | 10-minute provocations by Roshan Peiris and Jas Brooks. |
| 06:20 - 07:00 JST |
Matsui, A., Narumi, T., Huzuoka, H. "A Cross-Modal Olfactory Display Using the Influence of Visual and Thermal Sensations on Olfaction." Mesz, B. and Tedesco, S. "Gastrosonic and Osmotactile Installations: Three pieces for a flattened ontology of the sensorium." Barbosa Escobar, F., Velasco, C., Byrne, D., Janice Wang, Q. "Embodied Temperature Influences Chocolate Flavor and Texture Perception: A Pilot Study." Ueda, M. "Smells for the Paris Agreement." Napoli, D. and Chiasson, S. "Enhancing the Experience of Security and Privacy Warnings with Smell, Taste, and Temperature." Ho, H. "Importance of relaying warmth in this pandemic time." |
| 07:00 - 07:30 JST | Breakout discussions in groups of 4-5 participants with 1-2 organizers. |
| 07:30 - 07:50 JST | Reconvene to discuss the challenges and possibilities of taste interfaces. | 08:00 - open end JST | Closing ceremony followed by optional social event, scratch-and-sniff short film screening. |
Workshop Proceedings
Niedenthal, S., Nilsson, J., Larsson, M., Olofsson, J. “A method for computerized olfactory assessment and training outside of laboratory or clinical settings.”
McMillan, C. “AromaCare: Designing Olfactory Experiences for Ongoing Living and Dying Well.” Paper.
Berkholz, J. and Stevens, G. “Bourdieu Reloaded: On the Social Construction of Digital Taste.” Paper.
Lisena, P., Van Erp, M., Bembibre, C., Leemans, I. “Data Mining and Knowledge Graphs as Backbone for Advanced Olfactory Experiences.” Paper.
Lai, M. K., Cao, Y. Y. “Designing Olfactory Experience for Daily practices with Interactive Olfaction Community.” Paper.
Barbosa Escobar, F., Velasco, C., Byrne, D., Janice Wang, Q. “Embodied Temperature Influences Chocolate Flavor and Texture Perception: A Pilot Study.” Paper.
Napoli, D. and Chiasson, S. “Enhancing the Experience of Security and Privacy Warnings with Smell, Taste, and Temperature.” Paper.
Brianza, G., Maggioni, E., Cornelio Martinez, P., Obrist, M. “ESSolation: The Impact of The Loss of Smell on Body Image in the Covid-19 Era.”
Jedrysiak, M. and Ammenheuser, J. “Explorations with Breakfast Bot (A Cooking Robot Controlled via Livestream).” Paper.
Kale, M. and Rikters, M. “Fragmented and Valuable: Following Sentiment Changes in Food Tweets.” Paper.
Mesz, B. and Tedesco, S. “Gastrosonic and Osmotactile Installations: Three pieces for a flattened ontology of the sensorium.” Paper.
Ho, H. “Importance of relaying warmth in this pandemic time.” Paper.
Dubey, A., Bhardwaj, N., Veenu, A. “Intelligent Multi-Sensory Food Experience with Visual and Smell Simulation Devices.” Paper.
Worgan, L., Alexander, J., Fraser, M. “Manipulating Scent Particles with Ultrasonic Transducer Arrays.” Paper.
Lundén, P., Niedenthal, S., Fredborg, W., Ehrndal, M., Olofsson, J. “NOSEWISE: A Handheld Olfactory Display for VR Smell Training.”
Rantala, J., Müller, P., Salpavaara, T., Verho, J., Ryynänen, T., Isokoski, P., Kondratev, A., Toimela, N., Vehkaoja, A., Lekkala, J., Kallio, P., Surakka, V. “On Characterizing Olfactory Displays.” Paper.
Sikes, C. “Scent Device Database & Visual Wiki.” Paper.
Kurze, A. “Scented Dice: New interaction qualities for ideating connected devices.” Paper.
Ueda, M. “Smells for the Paris Agreement.” Paper.
Armitage, R., Thanh Vi, C., Yeomas, M. “Sweet Taste and Sweet-Liking Phenotypes: The Challenges of using Sweet Taste as a Reward.” Paper.
Cornelio, P., Bianza, G., Obrist, M. “The Effect of Smell on Self-Avatar-based Body Image Perception in Virtual Reality.”
Taitz, A., Shalom, D., Trevisan, M., Mesz, B. “The taste of scales and chords.” Paper.
Bahremand, A., Spackman, C., Gerkin, R., LiKamWa, R., Smith, B. “Virtually composing and dynamically mixing complex odors.” Paper.
Attendees
Rhiannon Armitage, University of Sussex
Alireza Bahremand, Arizona State University
Francisco Barbosa Escobar, Aarhus University
Jenny Berkholz, Universität Siegen
Nitish Bhardwaj, Accenture Labs
Giada Brianza, University of Sussex
Yan Yan Cao, Singapore Polytechnic
Patricia Cornelio, University College London
Alpana Dubey, Accenture Labs
William Fredborg, Stockholm University
Hsin-Ni Ho, NTT Communication Science Laboratories
Meetha Nesam James, Maine University
Maija Kāle, University of Latvia
Albrecht Kurze, Chemnitz University of Technology
Mei-Kei Lai, Macao Polytechnic Institute
Pasquale Lisena, EURECOM
Ayari Matsui, University of Tokyo
Jennifer McGrath, Concordia University
Bruno Mesz, Universidad Nacional de Quilmes
Daniela Napoli, Carleton University
Takuji Narumi, University of Tokyo
Sebastian Navas Chaparro, Carleton University
Simon Niedenthal, Malmö University
Johannes Nilsson, Malmö University
Chase Philip
Jussi Rantala, Tampere University
Timo Salpavaara, Tampere University
Carlos Velasco, BI Norwegian Business School
Chi Thanh Vi, University of Sussex
Qian Janice Wang, Aarhus University
Luke Worgan, University of Bath
Ruowei Xiao, Tampere University
Martin Yeomans, University of Sussex
Megan Jedrysiak and Jackson Ammenheuser, AppleButter Animated
Caroline McMillan, RMIT University
Chach Sikes, Redbeak Studios
Maki Ueda
Call for Participation
The “Smell, Taste, and Temperature Interfaces” workshop addresses the burgeoning subfield of chemo- and thermo-sensory interfaces (smell, taste, and temperature) as well as their cultural contexts, usage, and resulting experiences. This three-day workshop will offer an interdisciplinary forum of discussion for academics and practitioners interested in leveraging these sensations.
Researchers and practitioners from academia, arts, and industry are invited to apply to the workshop by submitting a 1-4 page position or research paper in the ACM Master Article Submission Template single column format via the submission portal. The submission deadline is Friday, February 19, 2021 at 12:00pm (noon) PT. All applications will be reviewed by the workshop organizers and selection will be based on the paper’s quality, novelty, and fit for topics. Applicants will be notified of decisions on Friday, March 5, 2021 at 12:00pm (noon) PT. Accepted papers will have the option to be made available at the workshop webpage. Upon acceptance, participants are asked to produce a 5-minute introduction/paper presentation video, which will also be shared publicly on the workshop website. At least one author of each accepted paper must attend the workshop.
Suggested Topics/Areas
The topics of interest for the workshop include, but are not limited to, the following
- Design and use of multi-sensory technologies.
- Technologies pushing forward smell, taste, and thermal experiences.
- Chemo- and thermo-sensory augmentation.
- Cultural aspects and contexts of multi-sensory interactions in everyday life and history, which influence and shape both the technologies being developed and their societal adoption.
- Techniques & recommendations for recording and stimulating chemo- and thermo-sensations.
We aim to additionally highlight and discuss open challenges in the field, which include, but are not limited to,
- Power consumption: affects all chemo- and thermo-sensory devices, but especially thermo-.
- Chemicals: affects all chemo-sensory devices (smell, taste, chemesthetic), often non-reducible, recordings and replay of experiences, precision, inter- and intra-modality effects (e.g. suppression effects).
- Non-technical: complexity of dimensions, precision, cultural adoption, sharing data across HCI researchers, open sourcing of devices, simultaneously ongoing basic scientific research.
Important Dates
Submission deadline: February 19, 2021
Notification of acceptance: March 10, 2021 March 5, 2021
Camera-ready submissions due: April 30, 2021 March 12, 2021
Video recording due: April 30, 2021
Workshop dates: May 7-9, 2021
Workshop Organizers
Jas Brooks is a PhD student in the Department of Computer Science at the University of Chicago. Jas focuses on computer interfaces that directly modulate human chemosensation, such as smell, taste, and chemesthesis. Their most recent device leveraged chemical stimulation of the nose’s trigeminal nerve endings to induce temperature illusions. Jas’s research is supported by a National Science Foundation Graduate Research Fellowship and has been covered by media publications such as IEEE Spectrum.
Website: jasbrooks.net
Pedro Lopes is an Assistant Professor in Computer Science at the University of Chicago. Pedro focuses on integrating computer interfaces with the human body—exploring the interface paradigm that supersedes wearable computing. Some of these new integrated-devices include: a device based on muscle stimulation that allows users to manipulate tools they never seen before or that accelerate their reaction time, or a device that leverages the nose to create an illusion of temperature. Pedro’s work also captured the interest of media, such as New York Times or NewScientist, and was exhibited at Ars Electronica and the World Economic Forum.
Website: lab.plopes.org
Judith Amores is a Research Fellow at the MGH/Harvard Medical School and a Research Affiliate at the MIT Media Lab, where she did her PhD and master’s and helped run VR/AR at MIT as a co-president. She holds a multimedia engineering degree and has worked at Microsoft Research, URL Barcelona, and the Google Creative Lab. Her awards and publications include over 27 peer-reviewed research papers, two patents, a Facebook Graduate Fellowship, LEGO Foundation sponsored research, and was a finalist of the Innovation by Design Awards. She also received the Scent Innovator Award by CEW and IFF.
Website: judithamores.com
Emanuela Maggioni is a Research Fellow in multisensory experiences at the University College London (UCLIC) as well as director and co-founder of OWidgets. OWidgets is a university spinout establishing novel software and hardware solutions for smell experience design. Emanuela has a PhD in Experimental Psychology and is passionate about odors, emotions, and engineering solutions applied to HCI and AI perfumery. She works in both academic and industry projects (as Benetton Group, Facebook/Oculus VR), leading to over 40 publications and immersive experience collaborative projects (such as Tree VR, Fly). Emanuela was awarded an Enterprise Fellowship from the Royal Academy of Engineering (RAEng, 2019).
Website: multi-sensory.info
Haruka Matsukura is an Assistant Professor at Osaka University’s Graduate School of Engineering Science. She completed her PhD at the Tokyo University of Agriculture and Technology in 2013 and was employed by Osaka University as an Assistant Professor in 2017. She was a JSPS Fellow (DC1) from 2010 to 2013. Haruka’s work includes the Smelling Screen and the Olfactory Assist Mask. Her research interests include olfactory displays, gas source localization robots, and body extension.
Website: haruka-matsu.com
Marianna Obrist is Professor of Multisensory Interfaces at UCL, Department of Computer Science. She has established the SCHI Lab, an interdisciplinary research group, investigating touch, taste, and smell as interaction modalities. She is a co-founder of OWidgets Ltd, a University start-up developing novel software and hardware solutions for smell experience design. She is an inaugural member of the ACM Future of Computing Academy and was selected Young Scientist 2017 and 2018 to attend the World Economic Forum. She is a Visiting Professor at the Royal College of Art and has recently published a book on Multisensory Experiences: where the senses meet technology.
Website: multi-sensory.info
Roshan Peiris is an Assistant Professor at the School of Information at the Rochester Institute of Technology. He currently leads the Altered Reality research group that focuses on understanding the human perception to create new technologies that can alter and enhance our experiences. His research areas include haptics, multisensory mixed reality technologies, wearable computing, and accessibility. Roshan received his PhD from the National University of Singapore in Integrative Sciences and Engineering and his BSc in Electrical Engineering from the University of Moratuwa. His work includes ThermoVR, ThermalBracelet, LiquidReality, and LiquidVR, and has received several awards at international events.
Website: roshanpeiris.com
Nimesha Ranasinghe is an Assistant Professor at the School of Computing and Information Science and directs the Multisensory Interactive Media lab (MIM lab) at the University of Maine. He completed his PhD at the Department of Electrical and Computer Engineering, National University of Singapore (NUS) in 2013. Dr. Ranasinghe’s research interests include Multisensory Interactive Media, Human-Computer Interaction, Augmented and Virtual Reality. He is well-known for his Digital Lollipop (a.k.a. Virtual Flavors) and Virtual Cocktail (Vocktail) inventions and featured in numerous media publications worldwide, including New Scientist, New York Times, Time Magazine, BBC Radio, Discovery Channel, and Reuters.
Website: mimlab.info