Paint job transforms walls into sensors, interactive surfaces

Smart walls react to human touch, sense activity in room.

Byron Spice, School of Computer Science, Carnegie Mellon University April 23, 2018

Walls are what they are — big, dull dividers. With a few applications of conductive paint and some electronics, however, walls can become smart infrastructure that sense human touch, and detect things like gestures and when appliances are used.

Researchers at Carnegie Mellon University and Disney Research found that they could transform dumb walls into smart walls at relatively low cost — about $20 per square meter —using simple tools and techniques, such as a paint roller.

These new capabilities might enable users to place or move light switches or other controls anywhere on a wall that’s most convenient, or to control videogames by using gestures. By monitoring activity in the room, this system could adjust light levels when a TV is turned on or alert a user in another location when a laundry machine or electric kettle turns off.

“Walls are usually the largest surface area in a room, yet we don’t make much use of them other than to separate spaces, and perhaps hold up pictures and shelves,” said Chris Harrison, assistant professor in CMU Human-Computer Interaction Institute (HCII). “As the internet of things and ubiquitous computing become reality, it is tempting to think that walls can become active parts of our living and work environments.”

Yang Zhang, a PhD student in the HCII, will present a research paper on this sensing approach, called Wall++, at CHI 2018, the Conference on Human Factors in Computing Systems, April 21–26 in Montréal.

The researchers found that they could use conductive paint to create electrodes across the surface of a wall, enabling it to act both as a touchpad to track users’ touch and an electromagnetic sensor to detect and track electrical devices and appliances.

“Walls are large, so we knew that whatever technique we invented for smart walls would have to be low cost,” Zhang said. He and his colleagues thus dispensed with expensive paints, such as those containing silver, and picked a water-based paint containing nickel.

They also wanted to make it easy to apply the special coating with simple tools and without special skills. Using painter’s tape, they found they could create a cross-hatched pattern on a wall to create a grid of diamonds, which testing showed was the most effective electrode pattern. After applying two coats of conductive paint with a roller, they removed the tape and connected the electrodes. They then finished the wall with a top coat of standard latex paint to improve durability and hide the electrodes.

The electrode wall can operate in two modes — capacitive sensing and electromagnetic (EM) sensing. In capacitive sensing, the wall functions like any other capacitive touchpad: when a person touches the wall, the touch distorts the wall’s electrostatic field at that point. In EM sensing mode, the electrode can detect the distinctive electromagnetic signatures of electrical or electronic devices, enabling the system to identify the devices and their locations.

Similarly, if a person is wearing a device that emits an EM signature, the system can track the location of that person, Zhang said.

Wall++ hasn’t been optimized for energy consumption, Zhang said, but he estimated the wall-sized electrodes consume about as much power as a standard touch screen.

In addition to Zhang and Harrison, the research team included HCII Professor Scott Hudson, and Alanson Sample, and Chouchang (Jack) Yang of Disney Research.

Source School of Computer Science, Carnegie Mellon University

References

Wall++: Room-Scale Interactive and Context-Aware Sensing, Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. 2018. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Paper 273, 15 pages. DOI: 10.1145/3173574.3173847 PDF

EM-Comm: Touch-based Communication via Modulated Electromagnetic Emissions, Chouchang Jack Yang, Alanson P. Sample. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies,(IMWUT) 2017, International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) 2017 Volume 1 Issue 3, September 2017. Article No. 118 ACM New York, NY, USA. DOI: 10.1145/3130984 PDF

We present Wall++, a low-cost sensing approach that allows walls to become a smart infrastructure. Intead of merely separating spaces, walls can now enhance rooms with sensing and interactivity. Our wall treatment and sensing hardware can track users’ touch and gestures, as well as estimate body pose if they are close. By capturing airborne electromagnetic noise, we can also detect what appliances are active and where they are located. Future Interfaces Group. Youtube Apr 22, 2018

Also see
Turn a Wall into a Touch Screen Cheap, Audio in Scientific American