Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance

Research output: Research - peer-reviewArticle in proceedings

We propose combining shape-changing interfaces and spatial augmented reality for extending the space of appearances and interactions of actuated interfaces. While shape-changing interfaces can dynamically alter the physical appearance of objects, the integration of spatial augmented reality additionally allows for dynamically changing objects’ optical appearance with high detail. This way, devices can render currently challenging features such as high frequency texture or fast motion. We frame this combination in the context of computer graph- ics with analogies to established techniques for increasing the realism of 3D objects such as bump mapping. This extensible framework helps us identify challenges of the two techniques and benefits of their combination. We utilize our prototype shape-changing device enriched with spatial augmented reality through projection mapping to demonstrate the concept. We present a novel mechanical distance-fields algorithm for real-time fitting of mechanically constrained shape-changing devices to arbitrary 3D graphics. Furthermore, we present a technique for increasing effective screen real estate for spatial augmented reality through view-dependent shape change.
Original languageEnglish
Title of host publicationCHI '16 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
EditorsCliff Lampe, Dan Morris, Juan Pablo Hourcade
Number of pages12
Place of publicationNew York, NY, USA
PublisherAssociation for Computing Machinery
Publication year2016
Pages791-802
ISBN (print)978-1-4503-3362-7
DOIs
StatePublished - 2016
EventACM CHI Conference on Human Factors in Computing Systems - California, San Jose, United States
Duration: 7 May 201612 May 2016

Conference

ConferenceACM CHI Conference on Human Factors in Computing Systems
LocationCalifornia
LandUnited States
BySan Jose
Periode07/05/201612/05/2016

See relations at Aarhus University Citationformats

Download statistics

No data available

ID: 107469095