Remote Estimation of Peripheral Oxygen Saturation and Pulse Rate From Facial Analysis Using a Smartphone Camera

Andreas Gronbech Petersen, Magnus Ruud Kjar, Helge B.D. Sorensen

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

Vital sign monitoring is an invaluable tool for healthcare professionals, both in the hospital and at home. Traditional measurement devices provide accurate readings but require physical contact with the patient which often is unsuitable, furthermore contact-based devices have been reported to fail by loosing contact due to movement as severe events occur, therefore, a contactless method is necessary.

We hypothesize that, in ideal scenarios, it is possible to estimate both SpO2 and pulse rate using only facial video recorded with a smartphone's front-facing camera. To test this hypothesis, a dataset of 10 healthy subjects performing various breathing patterns while being recorded with a smartphone camera was collected during ideal lighting conditions.

Using advanced image and signal processing methods to acquire remote photoplethysmography (rPPG) estimates from a patient's forehead, our proposed method can achieve SpO2 estimation results with Arms = 1.34% (accuracy RMS) and MAE ± STD = 1.26 ± 0.68% (mean average error) across a SpO2 range of 92% to 99% (percentage point SpO2) and pulse rate estimation results with Arms = 3.91 bpm (beats per minute) and MAE ± STD = 3.24±2.11 bpm across a pulse rate range of 60 bpm to 90 bpm. We conclude from these results, that remote vital sign estimation using facial videos recorded entirely with a smartphone camera is possible.

Original languageEnglish
Title of host publicationProceedings of the 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society
Number of pages4
Volume2023
PublisherIEEE
Publication date2023
DOIs
Publication statusPublished - 2023
Event45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society - Sydney, Australia
Duration: 24 Jul 202327 Jul 2023
Conference number: 45

Conference

Conference45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society
Number45
Country/TerritoryAustralia
CitySydney
Period24/07/202327/07/2023
SeriesAnnual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
ISSN2694-0604

Fingerprint

Dive into the research topics of 'Remote Estimation of Peripheral Oxygen Saturation and Pulse Rate From Facial Analysis Using a Smartphone Camera'. Together they form a unique fingerprint.

Cite this