Predictive Haptic COding Devices In Next Generation interfaces

PH-CODING founds the next generation ultra-intuitive user interfaces, through a new branch of neuroscience and providing the first exploitation of its underlying predictive coding principles in technological solutions for human haptic interactions. The main scientific hypothesis is that any haptic interaction involves a very large number of widespread skin sensors whose signals have a relationship that is intrinsically modulated by the contact with the environment and the skin mechanics. Combined with predictive actions, the brain is thus able to generate highly enriched percepts of the interactions that we make, which yields an essential part of the brain’s development of the concept of contingencies and a rich and stimulating understanding of the physical world. Failure to reach a corresponding level of responsiveness is likely a main reason why current user interfaces in VR systems and remote control become understimulating and disinteresting to most users. PH-CODING will: Characterize the brain’s computational mechanisms for reading out sensor population code’s generated in different skin tension states in experiments with dedicated haptic interfaces Develop a predictive coding model to extract stable haptic percepts through active interaction despite variability in the sensory signals, and demonstrate it in a robotic implementation Design and fabricate a soft artificial eSKIN based on bendable electronics integrating a variety of micro-/nano-sensors, with the capacity to ‘perceive’ multi-dimensional user input Demonstrate the transmission of ultra-rich haptic information generated in a man-to-eSKIN contact to a remote user via novel active haptic interfaces Carried out by leading neuroscience, nanotechnology and robotics groups and an SME at the forefront of haptics technology, this ground-breaking research will usher a new generation of passive and active devices enabling human-like, robust and rich interaction with objects, devices and robots.