Introduction
Photoplethysmography (PPG) is an easy-to-implement measurement method that allows the determination of various psychophysiological indices [1]. It comprises a light source and a photodetector either in the same plane for reflectance mode measurements or facing each other for transmittance mode measurements. PPG can be used to estimate indices such as heart rate (HR) and blood pressure [2], [3] and to evaluate conditions such as stress and emotional status [4], [5]. PPG technology has been incorporated into commercial devices such as pedometers and smartwatches to continuously monitor HR.
When measuring PPG signals, the effects of motion artifacts should be mitigated to prevent performance degradation [1] and improve reliability [6], [7]. Thus, various signal processing techniques, such as filtering, ensemble averaging, and machine learning, have been explored to remove related noise components from PPG measurements [8], [9]. Despite their effectiveness, all these methods are applied after measurement.
A technique to reduce the effects of motion artifacts during measurement consists of leveraging the optical characteristics of biological tissues to determine the optimal light source for PPG. Previous studies have shown that the extent of motion artifacts on PPG signals depends on the measurement light wavelength. For instance, a comparison of green and near-infrared light PPG measurements taken from various body parts demonstrated that green light PPG is more robust to motion artifacts [10]. Other studies examining the extent of motion artifacts using blue, green, and red lights revealed that blue and green lights are more robust to motion artifacts than red light in PPG [11], [12]. This effect of wavelength on robustness may be related to the penetration depths of different wavelengths of light into the skin [13], [14]. In fact, blue and green lights reach shallow regions of relatively hard tissues (e.g., dermis), and measurements are made more reliable by the attachment of the sensor to the skin, reducing the susceptibility to motion artifacts. In contrast, red and near-infrared light PPG signals reach deeper areas of softer tissues (e.g., fat and muscle), which are more affected by motion.
In addition to the above findings, further exploration of PPG is required. First, although the robustness of visible light to motion artifacts has been consistently shown, no study has comprehensively examined PPG using all primary light wavelengths (i.e., blue, green, red, and near-infrared) at the same measurement sites. In fact, motion artifacts have been evaluated using green and near-infrared lights [10] or among the primary colors (i.e., red, green, and blue lights) [11], [12] with sensors attached to different body parts [10], [11]. Considering that motion artifacts differ across body parts, multiwavelength evaluation ranging from visible to near-infrared light along with motion measurement should be conducted at the same physical site [15]. Second, transmittance and reflectance modes in PPG have not been simultaneously addressed. Considering that these two modes are common in PPG [1], the lack of studies considering both is somewhat surprising. In fact, in [10]–[12], only the reflectance mode was evaluated. Thus, data regarding the transmittance mode are scarce, and no data are available on the combination of transmittance and reflectance modes.
In this study, a multiwavelength PPG device was developed to enable simultaneous measurements under transmittance and reflectance modes at the same physical site, and experiments with and without motion artifacts were conducted. Thus, the novelty of this study lies in the comprehensive, wide-range, and multimode comparison of PPG signals acquired at one measurement site (Table 1). This study aimed to determine the extent of motion artifacts in PPG signals according to light wavelengths and measurement modes in terms of HR estimation accuracy.
Methods
A. Participants
Twelve university students (5 women and 7 men; Japanese, Sapporo City residents; age, 22.8 ± 1.1 years; body mass index, 20.2 ± 1.6; at least 12 years of education) were recruited via flyers to participate in this study. Given that previous studies on motion artifacts adopted a relatively small sample size (e.g.,
B. Apparatus
The device for reflectance mode PPG was fabricated with a blue light-emitting diode (LED) (470 nm; SMC470, Ushio Opto Semiconductors, Tokyo, Japan), a green LED (525 nm; SMC525, Ushio Opto Semiconductors), a red LED (660 nm; MC660N, Ushio Opto Semiconductors), a near-infrared LED (810 nm; SMC810, Ushio Opto Semiconductors), and a photodiode (PD) (BPW34BS, OSRAM Opto Semiconductors, Regensburg, Germany) on the same plane (Fig. 1), thus improving the model from previous studies [11], [16]. A separate PD sensor (OSRAM BPW34BS) for transmittance mode PPG was also integrated into the device by placing the source and sensor facing each other on opposite sides of the fingertip (Figs. 1 and 2). Due to the high absorbance of body tissue, the transmittance could not be measured for blue and green light. Thus, the six PPG modes considered in this study were blue, green, red, and near-infrared light in the reflectance mode (RB, RG, RR, and RNIR, respectively) and red and near-infrared light in the transmittance mode (TR and TNIR, respectively).
Light-emitting diode (LED) and photodiode (PD) arrangement in developed photoplethysmography (PPG) sensors. Reflect. = reflectance mode, Transmit. = transmittance mode, NIR = near-infrared.
Sensor attachment (left) and horizontal and vertical motions for experiments (right). For illustration purposes, the motion in the graph exceeds the actual range of movement executed by the participants to achieve the required motion frequency. Reflect. = reflectance mode, Transmit. = transmittance mode, PPG = photoplethysmography.
The four LEDs and two PDs were connected to a dedicated bioamplifier operated by a microcontroller (Mbed LPC1768, NXP Semiconductors, Eindhoven, Netherlands). One cycle of PPG measurements was set to 4 ms, and each LED was sequentially lit for 0.5 ms within the cycle (Fig. 3). The PD measurements were acquired immediately before turning each LED on and off to remove the effect of environmental light by considering the difference between the readings with the LEDs off and on. Therefore, we calculated the components of RB, RG, RR, RNIR, TR, and TNIR PPG based on the following formula:\begin{equation*} \text {PPG} = \text {V}\vert _{\mathrm {LED~on}}- \text {V}\vert _{\mathrm {LED~off}}\tag{1}\end{equation*}
Timing diagram of light-emitting diodes (LEDs) per cycle (4 ms) of photoplethysmography measurements and photodiode (PD) measurements (downward arrows) in reflectance mode (Reflect.) and transmittance mode (Transmit.). (A) to (L) indicate the reading instants of PD at the corresponding downward arrows. See text for details.
Two PD signals through separate but identical amplifier circuits were sampled with a resolution of 12 bits using an analog-to-digital converter (MCP3204, Microchip Technology, Chandler, AZ, USA) connected to the microcontroller. The acquired signals were transformed into six-channel PPG data using (1) at a 250 Hz sampling frequency and transmitted to a computer (MacBook Pro, Apple, Cupertino, CA, USA) via a serial port for storage and processing.
In addition, hand acceleration was measured using a triaxial accelerometer (ADXL345, Analog Devices, Norwood, MA, USA) at a 250 Hz sampling frequency. This sensor was attached to the transmittance stage and connected to the microcontroller. Electrocardiography (ECG) signals from a dedicated device used in our previous studies [11], [12] were also acquired using the analog-to-digital converter at a 1 kHz sampling frequency.
C. Experimental Procedure
The experiment was performed in a quiet
After verifying the reliability of the acquired signals, a 3-minute adaptation period was followed by an experimental period of approximately the same length, as detailed in Fig. 4. The procedure primarily followed that of previous studies [11], [12]. During adaptation, the participants sat quietly and were then asked to wave their right hands horizontally or vertically (Fig. 2) as fast and as rhythmically as possible to achieve a shaking frequency above 6 Hz. The horizontal motion (HM) and vertical motion (VM) were selected for their simplicity over compound motions. The shaking frequency of 6 Hz was targeted to easily separate the PPG motion artifact from the HR signal. As the main bandwidth of PPG is below 5 Hz [17], [18], including the HR fundamental signal at approximately 1–2 Hz and its second harmonics at approximately 2–4 Hz, it is easy to discard motion artifacts over 6 Hz. However, low-frequency components remained given the uncertainty of human movements. For the baseline (BL) condition, the participants kept their right hands still at the level they waved their hands, whereas during rest, the participants kept their right hands down and remained still. The order of execution of HM, VM, and BL was varied and balanced across participants (Fig. 4). The sequence of these three conditions was repeated twice in the same order. All 18-second conditions were separated by rest periods of 9 s.
Experimental procedure to evaluate motion artifacts in multimodal photoplethysmography. The combination of 18-second experimental conditions (Cond A to C) is assigned to one motion type, namely, baseline (no motion), horizontal and vertical motion. The measurement orders were balanced across the participants.
D. Evaluated Measures
The signal-to-noise (S/N) ratio was calculated from each PPG signal with a 16.384-second center period in the 18-second conditions as follows:\begin{equation*} \text {S/N ratio} = 10\cdot \log _{10} (\text {P}_{\mathrm { \textrm {}Signal}}/\text {P}_{\mathrm {Noise}})\tag{2}\end{equation*}
Diagram of signal-to-noise (S/N) ratio calculation. P = power, R-R = R wave to R wave, HR = heart rate, ECG = electrocardiography, PPG = photoplethysmography, a.u. = arbitrary unit.
The beat-to-beat HR for reference was obtained from the R–R interval of the ECG signal, and that of the PPG signal was obtained from peak-to-peak intervals (in milliseconds) of its ac components. The HR was calculated as HR = 60,000/inter-beat interval. The peak detection algorithm was the same as that used in [2]. In brief, a 5 Hz lowpass filter was first applied to detect a set of local minima (valleys) and maxima (peaks) of the PPG signals. More details of this method are available in [19].
E. Data Reduction
The frequencies and
The S/N ratios calculated from the six PPG signals (i.e., RB, RG, RR, RNIR, TR, and TNIR) were averaged across two repetitions to obtain the BL, HM, and VM values. The beat-to-beat HR values derived from the ECG and six PPG signals were averaged for each central 16.384-second period in the 18-second conditions and again averaged across two repetitions to obtain the corresponding values for the motions.
F. Statistical Analysis
To evaluate the experimental results, the frequencies and amplitudes of motion artifacts were compared using paired
The S/N ratios for each PPG type (i.e., RB, RG, RR, RNIR, TR, and TNIR) and condition (i.e., BL, HM, and VM) were evaluated using two-way repeated-measures ANOVA after checking normality by the Shapiro–Wilk test. Again, the Greenhouse–Geisser correction was applied to the degrees of freedom where appropriate, and the REGWQ multiple comparisons were used.
To evaluate the agreement of HR measurements obtained from the six PPG signals and reference ECG HR, geometric mean regression [20] and the Bland–Altman plot [21] were used. For regression, the intercept (fixed bias), slope (proportional bias), and correlation coefficient (Pearson’s
G. Additional Artifact Analysis
Although the participants waved their hands as fast and as rhythmically as possible to easily separate the PPG motion artifact from the HR signal, the motion contained lower-frequency components overlapping with the HR frequency band from 1 to 5.5 Hz, given the uncertainty of human movements [17], [18].
To evaluate this influence, we obtained the sum of the signal power from the triaxial acceleration signals during BL and motion including both HM and VM in the frequency bands of 5.5–10 Hz (P
In addition, to evaluate the effect of P
Results
Fig. 6 shows an example of simultaneous acquisition of the six PPG signals, ECG signal, and accelerometer signal for a participant under BL and motion.
Example of simultaneous recordings of blue, green, red, and near-infrared light reflectance mode (RB, RG, RR, and RNIR, respectively) and red and near-infrared light transmittance mode (TR and TNIR, respectively) photoplethysmography (PPG), electrocardiography (ECG), and triaxial acceleration signals. Red and blue circles represent the peaks and valleys, respectively. a.u. = arbitrary unit.
A. Experimental Conditions
The characteristics of motion artifacts per condition along with the results of the paired
The mean dc levels of the six PPG signals during BL along with the results of repeated-measures ANOVA are summarized in Table 3. Post hoc comparisons revealed that the dc values of RB, RG, RR, and RNIR PPG were larger than those of TR and TNIR PPG.
B. S/N Ratios
The mean S/N ratios for each PPG type (RB, RG, RR, RNIR, TR, and TNIR) and condition (BL, HM, and VM) are summarized in Fig. 7. The Shapiro–Wilk test confirmed the normality of the distributions in all indices (
Mean values of the signal-to-noise (S/N) ratio from three motion conditions and six photoplethysmography (PPG) signals. PPGs in the same level are not significantly different from each other. Vertical bars represent the standard errors of the mean. RB = blue light reflectance mode, RG = green light reflectance mode, RNIR = near-infrared light reflectance mode, RR = red light reflectance mode, TNIR = near-infrared light transmittance mode, TR = red light transmittance mode, BL = baseline, HM = horizontal motion, VM = vertical motion.
C. HR Agreement
Scatter plots of HRs obtained from the six PPG signals against the HR estimated from the ECG signals along with the Bland–Altman plots are shown in Fig. 8. The results of the geometric mean regression and Bland–Altman analysis are summarized in Table 4.
Heart rate (HR) agreement among six photoplethysmography (PPG) signals and electrocardiography (ECG) signals. Plots were generated from 36 data pairs (3 conditions
D. Additional Artifact Analysis
The mean ± SD values of
The mean S/N ratios
Discussion
In this study, the S/N ratio and HR agreement with ECG signals as reference were examined for RB, RG, RR, RNIR, TR, and TNIR PPG using a fabricated PPG device that enables simultaneous measurement of the six PPG signals at the same site under motion artifacts. First, we found that the RB and RG PPG modes show S/N ratios approximately 8 dB higher than TR PPG, that the HR calculated from both modes does not show fixed or proportional bias, and that the Pearson’s correlation is above 0.986. Second, RNIR PPG is superior to TR PPG by approximately 4 dB and comparable to RR PPG.
In addition, the HR calculated from RNIR PPG does not show fixed or proportional bias, reaching a correlation of 0.967, whereas RR PPG shows proportional bias and a correlation of 0.949. Third, the S/N ratios of RR, TNIR, and TR PPGs are comparable, but the fixed and proportional bias are the smallest in TNIR, and the correlation is the largest, reaching 0.959. Finally, the reflectance mode is superior to the transmittance mode by approximately 5 dB overall. Hence, the S/N ratio and HR estimation accuracy during motion decrease in the following order: blue, green, near-infrared, and red light wavelengths and reflectance and transmittance measuring modes.
The mean value of ratio P
However, as it can be decomposed in many sine waves over a period, our findings can also apply to sudden motion. In fact, consistent results were obtained from a previous study considering sudden motion [10]. Therefore, we conclude that our result can be generalized to various types of motions.
Both RB and RG PPG are superior to other PPG modes, which is consistent with the findings from previous studies. However, there are four points worth mentioning. First, the experiment did not address RB, RG, and RR PPG or RG and RNIR PPG alone, but it examined TR and TNIR PPG along with RB, RG, RR, and RNIR PPG simultaneously at the same measurement site, enabling further generalization of the results compared to previous studies. Second, stronger motions were used than those in previous studies. For instance, Matsumura et al. [12] used motions below 0.5 G, and Lee et al. [11] used approximately 9 G, whereas the participants in the present study performed motions up to 24 G, thus thoroughly testing the robustness of the PPG measurements. Third, unlike previous studies [11], [12], this study evaluated the motion spilled out from over 6 Hz intended motion into HR frequency band and examined its effect on PPG signals. As a result, our findings can be applied to a wide range of frequencies and types of motions if considering Fourier analysis over a period. Finally, differences in absolute values were determined instead of relative changes considered in a previous study [11]. Although the relative S/N ratio notably decreases due to motion, maintaining high S/N ratios under intense motion is advantageous for accurately and robustly estimating the HR. As this study evaluated PPG signals in terms of absolute values, its results are more robust and may reflect realistic outcomes from performing activities of daily living.
We found that RB PPG is superior to RG PPG in every aspect, unlike previous studies in which RG is regarded as the best approach [11], [12]. This difference can be attributed to the sensors and LEDs used for PPG. The proposed PPG device contained a small but high-brightness blue light LED and a PD with enhanced blue sensitivity and a relatively high sampling rate, overcoming the disadvantages of RB PPG to increase performance. However, the absolute difference, as in the other studies, is very small, and any approach is convenient in practice.
The robustness to motion artifacts according to the penetration depth of different light wavelengths implies that red light PPG would exhibit higher performance than near-infrared light PPG. However, this is not reflected in the results, possibly because of the inhomogeneous nature of biological tissue. As the probability distribution of optical PPG paths forms banana- or spindle-like shapes [22], RR PPG might mainly probe the dermis, which contains small arteries and arterioles. In contrast, RNIR PPG probes deeper regions, including the subcutaneous plexus, which contains smaller structures, and thus RR PPG shows a lower S/N ratio. In fact, the ac components of red light PPG are small in general. In addition, the relatively high absorbance of red light may lead to a low signal level, further reducing the S/N ratio. Although the dc levels of all reflectance mode PPG signals were set to be equal in this study, the dc level of transmittance mode PPG was approximately 1.2 times (0.8 dB) higher in TNIR than in TR. This difference agrees with the observed difference between TR PPG (4.2 dB) and TNIR PPG (5.0 dB). Therefore, increasing the intensity of red light in TR PPG may enhance the measurements. Nevertheless, such an intensity increase may also improve TNIR PPG, maintaining the relative difference compared to TR PPG. Overall, disregarding specific tasks such as determining SpO2 levels [23] or heat/cold stress [24], red light PPG offers no advantage regarding motion artifact robustness.
Various limitations of this study remain to be addressed. First, the experiment was conducted on a limited population and under specific situations, and hence further studies with more diverse populations and situations are required. For instance, only periodic motion artifacts above 6 Hz were used. Although such motion actually contains frequency components below 6 Hz, lower-frequency and/or aperiodic motion should be specifically addressed. Second, only one type of device was developed, and different LED and PD arrangements should be evaluated. In addition, separate PPG LEDs and PD were used in the transmittance mode, but using stapler or clothespin integrated devices might improve the S/N ratio. Third, a relatively basic HR detection algorithm was implemented, and more sophisticated methods may yield higher accuracy. Fourth, only HR was examined, as HR is the typical and most frequently used application of PPG, but other estimates such as respiratory rate and pulse volume should be calculated and evaluated. In these cases, the signal power should be calculated not from ECG data but from corresponding references. Finally, only reflectance and transmittance modes were analyzed, but modes such as side scatter remain to be assessed [25]. Specifically, sequential alteration from reflectance to transmittance via side scatter can be addressed. For instance, a previous study revealed that the amplitude of the ac component of PPG is the largest when using an intermediate mode between transmittance and side scatter [16], and this setting is also expected to produce the largest S/N ratio under motion artifacts.
Conclusion
This paper presents new evidence on PPG robustness against motion artifacts in terms of multiple light wavelengths and two measuring modes for accurate HR estimation. The S/N ratios obtained from RB, RG, and RNIR using a novel integrated PPG device were higher than the S/N ratio of TR PPG by 7.8, 7.7, and 4.3 dB, respectively. In addition, RB, RG, and RNIR showed negligible fixed and proportional bias for HR estimation. These characteristics may be interpreted in terms of the difference in penetration depth of different light wavelengths into the skin. Moreover, these findings suggest that when measuring PPG for HR estimation, blue and green light followed by near-infrared light in the reflectance mode are the recommended settings. Nevertheless, further investigation is required to 1) include more diverse populations, 2) use sensors with different LED and PD arrangements, and 3) evaluate different motion artifacts.
ACKNOWLEDGMENT
The authors would like to give special thanks to Ms. Akiko Doutani for designing and preparing the figures and Dr. Yasuhiro Yamakoshi for his technical assistance. The funding source, JSPS KAKENHI, played no role in the study design, the data collection, analysis and interpretation, and the writing of the report, or the submission decision. K. Matsumura designed the sensors, developed the circuit and program, conceived and designed the study, performed the experiment and the analysis, and wrote the article. S. Toda performed the experiment and analysis. Y. Kato critically reviewed the study and helped to write the manuscript. All the authors approved the submission of the manuscript in its current form.