Researchers Look to Combine AI and IR Sensing to Save Lives

Researchers at Stanford University are looking at AI and infrared sensing to save lives in smart hospitals and at-home care, specifically in a study that looks at 170 scientific papers to gather information on the field of “ambient intelligence” as it relates to health care. The effort aims to create smart hospital rooms equipped with AI systems to improve patient safety and outcomes.

Ambient technologies have many health benefits, but they can raise legal and regulatory issues, as well as privacy concerns that must be identified and addressed to win the trust of patients, providers, agencies, and institutions that pay health care costs, said Fei-Fei Li, co-director of the Stanford Institute for Human-Centered Artificial Intelligence.

“Technology to protect the health of medically fragile populations is inherently human-centered,” Li said. “Researchers must listen to all the stakeholders in order to create systems that supplement and complement the efforts of nurses, doctors, and other caregivers, as well as patients themselves.”

Graduate student Albert Haque, who compiled the papers cited in the article, said that the field is largely based on the convergence of two technological trends: the availability of infrared sensors inexpensive enough to build into high-risk caregiving environments, and the rise of machine learning systems as a way to use sensor input to train specialized AI applications in health care.

The infrared technologies are of two types. First is active infrared, the same type used by TV remote controls. However, instead of beaming invisible light in one direction like a TV remote, new active infrared systems use AI to compute how long it takes the invisible rays to bounce back to the source, like a light-based form of radar that maps the 3D outlines of a person or object.

The second type of infrared technology is passive detectors, which are used in night vision googles to create thermal images from the infrared rays generated by heat. In a hospital setting, a thermal sensor above an ICU bed would enable the governing AI to detect twitching or writhing beneath the sheets and alert clinical team members to impending health crises without constantly going from room to room.

The researchers have so far avoided using high-definition video sensors, as capturing video imagery could unnecessarily intrude on the privacy of clinicians and patients.

“The silhouette images provided by infrared sensors may provide data that is sufficiently accurate to train AI algorithms for many clinically important applications,” Haque said.

Monitoring via ambient intelligence systems in a home environment could also be used to detect clues of serious illness or potential accidents, and alert caregivers to make timely, necessary interventions. Researchers are developing activity recognition algorithms that can sift through infrared sensing data to detect changes in habitual behaviors and help caregivers acquire a more holistic view of patient well-being.

The research was published in Nature (www.dx.doi.org/10.1038/s41586-020-2669-y).