Introduction
Human motion measurement is used to obtain information such as body orientation, joint angles, and environmental reaction forces, which are essential foundation in biomechanics, rehabilitation, and human-computer interaction [1]. In healthcare-related applications, motion measurement provides comprehensive joint kinematics and dynamics, thereby enhancing the clinician’s understanding of assessment [2], pathology [3], and treatment options [4]. It has the advantage of being objective and quantitative compared to expert judgement. Currently, the gold standard for measuring human motion is optical motion capture (OMC), in which cameras track the trajectories of optical markers attached to anatomical landmarks [5]. Users can use anatomical landmarks to define joint coordinate systems according to various reporting standards as their needs, such as those proposed by the International Society for Biomechanics (ISB) [6]. Although OMC can provide accurate measurements, it has significant limitations, such as expensive equipment, a strict laboratory environment, and trained operators.
Wireless inertial measurement units (IMUs) are increasingly being used to measure human motion [7]. The low cost of the device, its portability to different environments, and its ease of use for any user make it available to medical institutions and families [8], [9]. An IMU consists of an accelerometer, a gyroscope, and a magnetometer. Commercial inertial motion capture (IMC) systems can estimate sensor orientations with respect to a global reference frame through data fusion [10]. However, magnetic disturbances can affect the orientation estimation. Kinematic constraints of the joint are often used to compensate magnetic disturbances. However, most of these studies are based on the assumption of a one degree-of-freedom joint [11], or the joint axes are parallel to the joint coordinate system (JCS) axes [12], and haven’t conducted in-vivo verification [11], [12]. In addition, the sensor frame is not aligned with the corresponding body segment frame, and determining the rotation matrix to align them has long been a fundamental challenge for IMC application [13]. Although there are various IMU calibration methods [7], most of the researchers haven’t defined the JCS according to the ISB recommendation [6]. The calibration quality, especially for the commonly used functional calibration methods in commercial systems, depends on the quality of the calibration action completion, which will cause calibration errors [7].
Most IMU-based inverse kinematics workflows generate joint angles, such as the OpenSense toolkit in OpenSim [14]. It successfully mitigates drift over long periods of time. However, there was no scaling process for the physiological skeletal model. Moreover, the accuracy of IMC is always verified by comparing it with OMC, and joint angle is the common evaluation index [15], [16]. A customer case of Xsens MVN used projected angles in the sagittal plane for validation and the RMSE errors were very low (1.08° to 1.48°) [17]. Another study validated three-dimensional joint angles in Xsens MVN. The Xsens system determined the flexion/extension joint angle most accurately for all joints (1.71 to 3.99°), while for the other two joint axes, the joint angle errors are larger (1.38 to 6.69°) [18]. They believed that the poor correlation in the other two joint axes was most likely due to differences in the JCS definition of the segments used by the Xsens and OMC systems. Due to the different JCS definitions, the effectiveness of the verification remains unknown.
The lack of consistency between different studies and commercial systems makes it difficult to compare and analyze motion measurement results, which will lead to the inability of some motion analysis conclusions to be popularized and used, limiting the development of this field [19]. Without a common convention for defining JCS using IMU data, it is difficult to propose a conventional measurement and analysis protocol. More importantly, many biomechanical analysis methods are based on anatomical landmarks, such as skeletal scaling [20] and the determination of muscle position and direction [21]. The calculation of anatomical landmark trajectories based on inertial measurement data has not received enough attention, and it is a critical problem to be solved.
A possible solution is to output the anatomical landmark trajectories, allowing the user to define JCS according to their needs, and use joint constraints for orientation correction. Picerno et al. [22] developed a calibration procedure for IMC based on the direct identification of palpable anatomical landmarks. The proposed method achieves excellent accuracy of anatomical landmark trajectories, but uses an additional IMU hosted on a caliper-like device. We wanted to develop a more straightforward approach without additional devices.
Since IMC cannot directly measure spatial position and trajectory, the geometric method can obtain anatomical landmark trajectories. First, we need to estimate the anatomical landmark positions in the respective segment frames. A feasible way is to calculate by regression equation with body height or other body dimensions as the input. Although some studies have obtained a large amount of anthropometric data, these studies have focused on how to scale the bone model with marker points to calculate the segment inertia [23] or muscle modeling [5], since most current biomechanical research is based on directly measured anatomical landmark trajectories by OMC. In addition, much attention has been paid to inertial parameters. Ho et al. [24] determined Chinese body segment parameters using a magnetic resonance imaging method. The percentage of segment length from the proximal and distal ends was given. Ma et al. [25] estimated body segment parameters of Korean adults using the three-dimensional (3D) body scan data from the SizeKorea. However, they only focused on the length of each body segment. Body measurements have a high correlation with racial background [26]. Unfortunately, to our knowledge, there is no such database or regression equations of anatomical landmark positions in segment frames of Chinese people. In addition, there is no database of the knee axis of rotation (AoR) direction, which can be used as joint constraints for orientation correction [27].
In summary, the angular accuracy of inertial motion capture has received considerable attention. However, there is a significant difference between anatomical frames calculated from IMC and OMC. Significant challenges remain in comparing the results of different studies. The development of a general convention for defining the anatomical frame for inertial motion capture is essential. Anatomical landmark trajectories are promising because they can be used to define JCS, just like OMC. A fundamental problem to be solved is the regression equations of the anatomical landmark positions and knee AoR direction in segment frames of Chinese people. Therefore, this paper proposed a method to calculate the trajectories of anatomical landmarks based on IMC data. We used OMC data to establish the regression equations. In addition, we calculated the direction of the knee AoR in femoral and tibia frames as a joint constraint to correct the orientation error of IMC, which improved the accuracy of anatomical landmark trajectories. Experimental results showed a good agreement with OMC.
Anatomical Landmark Trajectories Calculating Method
The process of anatomical landmark trajectory calculation based on inertial measurement data and verification is shown in Fig. 1., which mainly includes five aspects:
Measurement for each subject: we measured the body dimensions, including body height, shank length, knee width, and ankle width, and measured the motion synchronously by IMC and OMC.
OMC data processing for each subject: using the anatomical landmark trajectories measured by OMC, we defined the femoral frame, tibia frame, and knee AoR directions in these frames. Then we can get the anatomical landmark positions in femoral and tibia frames.
OMC data statistics and analysis for all subjects: we calculated the average knee AoR in femoral and tibia frames and regression equations of anatomical landmark positions in femoral and tibia frames of all subjects.
IMC data processing for each subject: using the average knee AoR and the regression equations, we corrected the segment orientations measured by IMC. We calculated the anatomical landmark positions in the femoral and tibia frames. We then calculated the anatomical landmark trajectories for each subject. For verification, it is necessary to unify the global reference frame of IMC and OMC systems. Then we can obtain the trajectory errors.
Correlation and agreement analysis for all subjects: Correlation and agreement analysis were conducted for method verification.
Above all, in this section, we first define the joint coordinate system. Second, we introduce the orientation correction method and the anatomical landmark trajectory calculation method. To compare the two systems, we give the process of unifying the reference system. Finally, we describe the experimental protocol.
A. Joint Coordinate System Definitions
A detailed and efficient understanding of the biomechanics of the lower extremity joint is a prerequisite. This paper discusses the femoral and tibia frames. The pelvis is considered to be fixed. For OMC, the global reference frame
Illustration of the femoral coordinate system and the tibia/fibula coordinate system.
The hip joint is treated as a ball and socket joint, and the position is calculated using the least square method to fit a sphere, with the center and radius of the sphere optimized to fit the trajectories of the EFM and EFL [29]. The femoral frame of each time frame is defined as described in [6].
To define the tibial frame, the knee AoR must first be determined. The direction of the AoR is determined by the relative rotation between the femoral and tibia frames. The rotation matrix describing the cluster of markers on the tibia \begin{equation*} {}^{\textrm {F}}\boldsymbol {R}_{\mathrm {T\_{}cluster}}^{k} =\left [{ { ^{\mathrm {G}}\boldsymbol {E}_{\mathrm {F}}^{k}} }\right]^{T}{ }^{\mathrm {G}}\boldsymbol {E}_{\mathrm {T\_{}cluster}}^{k} \tag{1}\end{equation*}
\begin{equation*} {}^{\textrm {F}}\boldsymbol {R}_{\textrm {Knee}}^{k} ={ }^{\textrm {F}}\boldsymbol {R}_{\mathrm {T\_{}cluster}}^{k+s} \left [{ { ^{\textrm {F}}\boldsymbol {R}_{\mathrm {T\_{}cluster}}^{k}} }\right]^{\textrm {T}} \tag{2}\end{equation*}
\begin{equation*} {}^{\textrm {F}}\boldsymbol {R}_{\textrm {Knee}}^{k} \to {}^{F}\boldsymbol {V}_{\textrm {knee}}^{k}, \boldsymbol {A}_{\textrm {knee}}^{k} \tag{3}\end{equation*}
\begin{equation*} {}^{G}\boldsymbol {V}_{\textrm {knee}}^{k} ={}^{\textrm {G}}\boldsymbol {E}_{\textrm {F}}^{k} { }^{F}\boldsymbol {V}_{\textrm {knee}}^{k} \tag{4}\end{equation*}
Furthermore, there will be moments during the entire sampling when the knee is almost stationary, leading to significant uncertainty in the computed knee AoR, which we want to exclude. The rotation angle during a time step must be greater than a certain threshold, and those \begin{equation*} {}^{\textrm {F}}\boldsymbol {V}_{\textrm {knee}}^{k} =\left [{ {\boldsymbol {E}_{\textrm {F}}^{k}} }\right]^{\textrm {T}}\left [{ {^{G}\boldsymbol {V}_{\textrm {knee}}^{k}} }\right] \tag{5}\end{equation*}
The weighted average knee AoR is then considered to be the average knee AoR in the femoral frame as \begin{equation*} {}^{\textrm {F}}\boldsymbol {V}_{\textrm {knee}}^{average} =\frac {\frac {1}{n}\sum {{\boldsymbol {A}}_{\textrm {knee}}^{k} {}^{\textrm {F}}\boldsymbol {V}_{\textrm {knee}}^{k}} }{\left |{ {\frac {1}{n}\sum {{\boldsymbol {A}}_{\textrm {knee}}^{k} { }^{\textrm {F}}\boldsymbol {V}_{\textrm {knee}}^{k}}} }\right |} \tag{6}\end{equation*}
Note that the \begin{equation*} {}^{\textrm {T}}\boldsymbol {V}_{\textrm {knee}}^{k} =\left [{ {\boldsymbol {E}_{\textrm {T}}^{k}} }\right]^{\textrm {T}}\left [{ {^{G}\boldsymbol {V}_{\textrm {knee}}^{k}} }\right] \tag{7}\end{equation*}
The weighted average knee AoR is then considered to be the average knee AoR in the tibia frame as \begin{equation*} {}^{\textrm {T}}\boldsymbol {V}_{\textrm {knee}}^{average} =\frac {\frac {1}{n}\sum {\boldsymbol {A}_{\textrm {knee}}^{k} {}^{\textrm {T}}\boldsymbol {V}_{\textrm {knee}}^{k}} }{\left |{ {\frac {1}{n}\sum {{\boldsymbol {A}}_{\textrm {knee}}^{k} { }^{\textrm {T}}\boldsymbol {V}_{\textrm {knee}}^{k}}} }\right |} \tag{8}\end{equation*}
Then, we introduce the JCS definitions in IMC. In this paper, we used a commercial motion capture system (FOHEART MAGIC, China, https://foheart.com/en/) in which only the orientation data was used. The orientation of each IMU is expressed relative to the Earth frame. The ideal Earth frame has a z-axis in the opposite direction of gravity, with the y-axis pointing north and the x-axis pointing east. A functional calibration method determines the rotation matrix between the sensor and body frames. The
B. Orientation Correction and Anatomical Landmark Trajectories Calculation
The average knee AoR can be used as a joint constraint for orientation correction. Because no matter what the measurement system is, they share the same knee AoR. We use \begin{equation*} {}^{\textrm {G}}\boldsymbol {r}_{\textrm {T}}^{k} =\hat {{\boldsymbol {e}}}_{\textrm {T}}^{k+s} \left [{ {\hat {{\boldsymbol {e}}}_{\textrm {T}}^{k}} }\right]^{\textrm {T}} \tag{9}\end{equation*}
Using the same method as OMC, we can obtain the average knee AoR in the femoral and tibia frames \begin{equation*} {}^{\textrm {F,T}}a=\arccos \left ({{\frac { ^{\textrm {F,T}}\boldsymbol {v}_{\textrm {knee}}^{average} { }^{\textrm {F,T}}\boldsymbol {V}_{\textrm {knee}}^{average}}{\left |{ { ^{\textrm {F,T}}\boldsymbol {v}_{\textrm {knee}}^{average}} }\right |\left |{ { ^{\textrm {F,T}}\boldsymbol {V}_{\textrm {knee}}^{average}} }\right |}} }\right) \tag{10}\end{equation*}
To align these two AoR vectors, we define the rotation axis in the femoral and tibia frames, respectively \begin{equation*} {}^{\textrm {F,T}}{\textbf {Axis}}={}^{\textrm {F,T}} \boldsymbol {v}_{\textrm {knee}} \times { }^{\textrm {F,T}}\boldsymbol {V}_{\textrm {knee}} \tag{11}\end{equation*}
\begin{equation*} {}^{\textrm {F,T}}{\textbf {Axis}},{}^{\textrm {F,T}}a\to { }^{\textrm {F,T}}\boldsymbol {R}_{\textrm {co}} \tag{12}\end{equation*}
\begin{equation*} {}\boldsymbol {e}_{\textrm {F,T}}^{k} =\hat {{\boldsymbol {e}}}_{\textrm {F,T}}^{k} { }^{\textrm {F,T}}\boldsymbol {R}_{\textrm {co}} \tag{13}\end{equation*}
After the orientation is corrected, the anatomical landmarks trajectories can be calculated. First, the positions of the anatomical landmarks with respect to the segment frames are estimated using regression equations \begin{equation*} \boldsymbol {p}_{\textrm {landmark}} =f\left ({{d_{1},d_{2},\ldots,d_{n}} }\right) \tag{14}\end{equation*}
\begin{equation*} \boldsymbol {t}_{\textrm {EFL,EFM}}^{k} =\left [{ {\boldsymbol {e}_{\textrm {F}}^{k}} }\right]\boldsymbol {p}_{\textrm {EFL,EFM}} \tag{15}\end{equation*}
\begin{equation*} \boldsymbol {t}_{\textrm {knee}}^{k} =\left ({{\boldsymbol {t}_{\textrm {EFL}}^{k} +\boldsymbol {t}_{\textrm {EFM}}^{k}} }\right)/2 \tag{16}\end{equation*}
\begin{equation*} \boldsymbol {t}_{\textrm {LM,MM}}^{k} =\left [{ {\hat {{\boldsymbol {e}}}_{\textrm {T}}^{k}} }\right]\boldsymbol {p}_{\textrm {LM,MM}} +\boldsymbol {t}_{\textrm {knee}}^{k} \tag{17}\end{equation*}
C. Reference Frame Unification
To compare the anatomical landmark trajectories calculated by the IMC system with those measured by the OMC system, we need to unify the reference frames of the two systems. Since these two systems measure the same motion, motion data is used to unify the reference frames. In this paper, hip flexion is used. Considering the hip joint as the origin, we define the initial frame of each system by the following steps:
Step 1:
and\boldsymbol {z} _{0} for IMC and OMC are defined as the unit normal vector of the planes fitted by the knee center trajectories, pointing to the right, respectively.\boldsymbol {Z} _{0} Step 2:
and\boldsymbol {y} _{\mathrm {temp}} for IMC and OMC are defined as the\boldsymbol {Y} _{\mathrm {temp}} -axis and{y} -axis of the femoral frames in the time frameY , respectively.{t} Step 3:
is the unit vector perpendicular to\boldsymbol {x} _{0} and\boldsymbol {y} _{\mathrm {temp}} , and\boldsymbol {z} _{0} is the unit vector perpendicular to\boldsymbol {X} _{0} and\boldsymbol {Y} _{\mathrm {temp}} for IMC and OMC, respectively.\boldsymbol {Z} _{0} Step 4:
and\boldsymbol {y} _{\mathrm {temp}} are not necessarily perpendicular to\boldsymbol {Y} _{\mathrm {temp}} and\boldsymbol {z} _{0} . Therefore\boldsymbol {Z} _{0} =\boldsymbol {y} _{0} and\boldsymbol {z} _{0} \times \boldsymbol {x} _{0} =\boldsymbol {Y} _{0} are calculated for IMC and OMC, respectively.\boldsymbol {Z} _{0} \times \boldsymbol {X} _{0} Step 5:
The initial frames are defined as
= [\boldsymbol {G} _{\mathrm {IMU\_{}init}} ,\boldsymbol {x} _{0} ,\boldsymbol {y} _{0} ] and\boldsymbol {z} _{0} = [\boldsymbol {G} _{\mathrm {OMC\_{}init}} ,\boldsymbol {X} _{0} ,\boldsymbol {Y} _{0} ] for OMC and IMC systems respectively.\boldsymbol {Z} _{0}
Then we can calculate the rotation matrix to unify the reference frames \begin{equation*} \boldsymbol {R}_{\mathrm {IMU\_{}OMC}} =\boldsymbol {G}_{\mathrm {OMC\_{}init}} \left [{ {\boldsymbol {G}_{\mathrm {IMC\_{}init}} } }\right]^{\mathrm {T}} \tag{18}\end{equation*}
The anatomical landmark trajectories calculated by the IMC system, expressed in the reference frame of the OMC system, are \begin{equation*} \boldsymbol {t}_{\mathrm {landmark\_{}OMC}}^{k} =\boldsymbol {R}_{\mathrm {IMU\_{}OMC}} \boldsymbol {t}_{\mathrm {landmark}}^{k} \tag{19}\end{equation*}
\begin{equation*} \boldsymbol {e}_{\mathrm {landmark}}^{k} = \boldsymbol {t}_{\mathrm {landmark\_{}OMC}}^{k} -\boldsymbol {T}_{\mathrm {landmark}}^{k} \tag{20}\end{equation*}
D. Experimental Protocol
To verify the anatomical landmark trajectory calculation method, 38 healthy subjects (20 males, 176.0 ± 5.2cm, 57.8 ± 11.2kg, 24.5 ± 5.0 years old, and 18 females, 162.4 ± 5.0cm, 53.7 ± 7.1kg, 24.2±3.9 years old) were recruited. The study was exempted from IRB approval by the Ethics Committee of the Shanghai Jiao Tong University. All subjects were informed about the experimental procedure and signed an informed consent form for the experiment. A cluster of active markers (infrared LED) was mounted to each lower limb segment using an elastic band. The 6D motion data of the clusters of markers and 3D virtual anatomical landmark trajectories were recorded at 100Hz by two position sensors with three embedded infrared cameras of the OMC system (Optotrak Certus, NDI, Canada). Among these subjects, 16 healthy subjects (6 males, 174.83 ± 4.2cm height, 66.4 ± 11.4kg weight, 24.7 ± 2.4 years old, and 10 females, 161.5 ± 4.62cm height, 54.6 ± 8.7kg, 24.4 ± 1.3 years old) were also mounted with IMUs (FOHEART MAGIC, China).
An embedded fusion algorithm was used to estimate the orientation of the sensor relative to the Earth frame. We didn’t try other fusion algorithms because our main focus was to compute anatomical landmark trajectories. The orientation accuracy of the IMUs is
Placement of IMUs and clusters of markers. The virtual markers are attached to the marker cluster frames. The EFM and MM are on the opposite side of the leg. Subjects were asked to perform a hip flexion.
This work is supported by the National Key Research and Development Program of China (No. 2019YFB1312501). The program aims to develop personalized rehabilitation plans for spinal cord injury patients and determine the motion parameters of rehabilitation robots based on objective motor function assessment. The current gold standard for measuring motor function after SCI is the American Spinal Injury Association (ASIA) Impairment Scale (AIS). Therefore, we designed the experimental protocol according to the ASIA Motor Exam Guide [32]. This paper focuses on the hip and knee joints, and we have selected movements that included both hip flexion and knee flexion. Each subject was asked to lie supine on a wooden bed to simulate a clinical examination scenario, avoid pelvic movement, and perform hip flexion trials. The instructions were: “Please lift and lower your upper leg. Try not to drag your foot on the exam bed.” The motions are shown in Fig. 3.
In addition, to our knowledge, few studies have used anatomical landmark trajectories as an evaluation index. We used another IMC system (Xsens MVN, version 2021.2.0, Netherlands) for comparison. The same OMC system (Optotrak Certus, NDI, Canada) was used and recorded at 100Hz. Two healthy male subjects (29 and 27 years old, 171 and 174 cm, 58 and 63kg) were recruited. IMU sensors (Xsens Link) and the cluster of active markers for optical motion capture were attached to each lower limb segment using elastic bands. Before recording, the subject was asked to perform MVN calibration. The subject first performed an N-pose, standing in an upright and natural position, with the feet parallel and pointing forward with about one foot-width distance in between the feet. We asked the subject to hold the N-Pose for a few seconds. Then, with the indication from the software, the subject was asked to walk straight forward and turn back, then perform the N-pose again (the latest software asks the subject to walk around). After calibration, we asked the subject to lie supine on a wooden examination bed and perform hip flexion and record IMC and OMC data. After recording, we used Reprocess HD in Xsens MVN. We also asked Subject 1 to perform a non-standard calibration. We asked him to flex the knee joint while performing N-Pose. The walking calibration was performed normally. IMC and OMC data were manually synchronized using peak values.
The positions of the anatomical landmarks with respect to the segment frames are estimated using regression equations. For comparison, we compare the results of our OMC measurements with the scaling result of Xsens MVN (version 2021.2.0). Instead of using the sensors to measure actual motion, we keep the sensors still on the table throughout the process. Before each recording, we entered the body height ranging from 150cm to 190cm with a 10cm increments. Other body segment dimensions were automatically adjusted by the software. We then performed the MVN calibration. Since the sensors were not moved, the MVN model was in an N-pose. We recorded the static data for several seconds. Finally, we output the data in.c3d and.xls format. The landmark positions are read from the.c3d file. The joint positions are read from the.xls file. We defined the femoral and tibia frames as mentioned in our paper. Note that we cannot get a knee AoR from static data, so we adopted the Xsens MVN tibia z-axis as the knee AoR instead. According to the MVN user manual, the tibia z-axis is defined as the line from medial to lateral pointing to the right. We then calculated the landmark positions in segment frames for different heights.
All data processing was done in MATLAB 2022a, the data and codes are available at [33].
Results
This Section presents the regression results of anatomical landmark positions in the segment frame, the knee AoR direction, and trajectory errors.
A. Anatomical Landmark Positions in Segment Frames
For OMC data, the femoral and tibia frames were calculated according to the definition proposed in 2.1. Several regression equations were used to calculate the anatomical landmark positions in the segment frames. A k-fold cross validation approach was used. The data were divided into
First, the linear regression using the least square method of anatomical landmark positions in segment frames with respect to body height
Regression results of atomical landmark positions in segment frames, where M is male and F is female.
Second, we introduced shank length as an independent variable for regression analysis. It can be measured laterally (distance between EFL and LM) as
Third, we investigated the relationship between knee width
Finally, we used
We also compare the Xsens MVN scaling results with our OMC measurement results and there are significant errors, as shown in Tab. II and Fig. 4. Since it’s a European company, we believe that the scaling parameters are for European people. We recommend that the scaling of inertial motion capture can take gender and race into account.
B. Knee AoR Orientation
We calculated the directions of the knee AoRs in the femoral and tibial frames of each subject using the OMC data. Then, we averaged all the knee AoRs and calculated the SD of their projection angles in the transverse and frontal planes. The results of the OMC data calculation are shown in Fig. 5., and the values are shown in Tab. III.
Average knee AoR in femoral and tibia frames with ± SD bounds projected in transverse (green) and frontal (red) planes.
C. Anatomical Landmark Trajectories
First, we calculated the anatomical landmark positions in the segment frames. We used the regression equation with the smallest SD from Tab. I to calculate each landmark position in the segment frame. Fig. 6. shows the results of the anatomical landmark trajectories calculated using IMC data compared with the OMC data of one subject. In Fig. 6. (a) and (b), the hip joint is moved to the origin. The trajectories calculated from IMC data are green dots, and the OMC data are blue. The error vectors are shown in pink. Only a subset of the data points are plotted for illustration. 3D skeletal models in three selected time frames are also drawn to better understand the motion. In Fig. 6. (a) represents the result without correction, and we can see that LM and MM are obviously biased to one side (negative y-axis direction), which indicates that the orientation of the knee AoR is biased. It can be better illustrated in In Fig. 6. (c), as the green points (y direction) are above the
Anatomical landmark trajectories calculated from IMC data compared to OMC data. Only a subset of data points are shown for illustration.
The root mean square (RMS) errors of all 16 subjects are shown in Tab. IV. For the results without orientation correction, the errors of MM and ML are relatively large. With orientation correction using the knee AoR, the errors of MM and ML are reduced. Although there are significant differences in the direction of the knee AoR for each person, the correction using the average AoR obtained from the OMC data can still reduce the errors as a whole (23.4±7.4mm to 57.3±27.5mm), about 5.9% to 7.6% of the segment length. Using individual AoR for correction can further reduce the errors (28.0±9.8 mm to 50.0±21.6mm). Note that RMS errors without correction are sometimes lower than those with average AoR correction, and RMS errors with average AoR correction are sometimes lower than those with individual AoR correction, which is strange. This could be because the placement of marker clusters and IMUs is different, and the effect of soft tissue deformation on them is also different. As a result, the estimated knee AoRs may not be the same, causing a slight increase in the errors of EFM and EFL, while still reducing the errors of MM and LM.
The correlation between the two systems is assessed using the Pearson correlation coefficients
The four anatomical landmark trajectories calculated using IMC data (regression equations and average AoR correction) are discussed in three directions. The correlation between the two systems is calculated and averaged for each subject. For each anatomical landmark,
We investigate the influence of anatomical landmark positions in segment frames by analyzing the correlation between trajectory results calculated by regression equations and OMC data. The correlation between these two methods reached
In addition, we investigate the influence of individual knee AoR orientation differences on the orientation correction by analyzing the correlation between the results obtained by the average AoR correction and the individual AoR correction. It shows that the
Furthermore, we calculated the orientation errors by dividing the rotation matrix of the IMC and OMC data and converting it into Euler angles (Z-Y-X), as shown in Tab. V. The results showed that our correction method could reduce the orientation errors to 3.3° to 8.1°. Considering the range of motion (ROM) from the N-pose to the experimental movements of the femoral and tibia frames, the average ROM was 157° and 87°, respectively. Orientation errors are less than 8.6% ROM and are acceptable.
Finally, data from two subjects recorded by Xsens MVN and OMC were also processed. Xsens MVN exported data in C3D format and was processed only to unify the reference frame with OMC. The RMS errors of the anatomical landmark trajectories are shown in Tab. VI. For subject 1, we give results of 2 calibrations, the first calibration is non-standard as described in the experimental protocol. And it shows very large errors. This indicates that the completion quality of the calibration action affects the measurement accuracy. The other three experiments show lager errors than our method. A possible reason is that the regression equations of anatomical landmark positions in segment frames adopted by Xsens MVN are unsuitable for Chinese. We also calculated the orientation errors as shown in Tab. VII. Note that the large ROM from N-pose to experimental movements, and the orientation errors are less than 8.8% ROM on average, similar to our that of our method.
Discussion
We have established regression equations of Chinese anatomical landmark positions in femoral and tibia frames, which is consistent with the recommendation of the ISB. This is groundbreaking and provides a complete set of procedures for future research to establish more comprehensive regression equations, which is the basis for calculating landmark trajectories using IMC data.
The regression equations using the body height as the independent variable can calculate the anatomical landmark positions, but there is a large SD in the y-direction. The shank length can be introduced to improve the accuracy of the regression equations, but only the error of the MM and ML positions in the y direction can be reduced. The knee width can be used to accurately obtain the EFM and EFL positions in the z-direction. However, the measurement of the ankle joint width does not help to significantly improve the positional accuracy of the MM and ML in the x and z directions. Users can select different regression equations for calculation as needed.
Orientation errors have a large influence on the calculation result of the anatomical landmark trajectories. For IMU orientation estimation, we used a commercial inertial motion capture system with an embedded fusion algorithm. We didn’t try other sensor fusion algorithms. We assume that the system has an error of 2° [31]. And we conducted the in-vivo study on a wooden bed, trying to avoid magnetic disturbances. Another source of orientation error is the sensor-to-segment calibration error, since we used functional calibration methods in the commercial system which depends on the quality of the calibration action completion. We tried to correct the orientation error using joint constraints. Unlike other approaches, we didn’t consider the joint axis as one of the segment frames axes [12]. Using the OMC data, we get the statistical average knee axis of Chinese young people. It is obvious that the knee AoR in the femoral frame is not orthogonal to any axis of the femoral frame, while the knee AoR in the tibia frame is almost coincides with the z-axis of the tibia frame. In addition, the SD of the knee AoR projection angles cannot be ignored. We compared the difference and correlation between the results using average AoR and individual AoR for orientation correction. Individual differences in AoR orientation have a negative but not obvious effect on the correction. We didn’t consider the knee joint as a hinge joint and correct the orientation error using individual correction rotation matrices for each time frame [11]. We calculate the average knee AoR direction of the entire measurement, and correct the orientation error using the same correction rotation matrix for each time frame, and the joint angles are three-dimensional. This approach would compensate the magnetic disturbances and the calibration error at the same time.
This paper aims to estimate the anatomical landmark positions in the segment frame and apply the orientation of the segments to all position vectors to obtain trajectories. We haven’t discussed the spatial motion of the pelvis. However, our approach can be combined with other gait measurement methods. Typically, IMU for gait measurement suffers from drift. One of the known approaches is to reset the velocity to zero when the foot hits the ground, namely zero velocity update (ZUPT) [36]. In this method, if the length vector of each segment is known, the drift error can be reduced by taking the orientation as input and calculating the step length vector through the kinematic chains. Our method provides an easy way to obtain the segment length, as it is not easy for the untrained person to measure the joint center.
To our knowledge, few studies have considered the trajectories accuracy of anatomical landmarks. Therefore, we also calculated the orientation error, and the results are comparable with those presented studies using the functional calibration method. Note that the ROM of our study are larger than that of gait measurement. Favre et al. [15] achieved moderate joint angle accuracy (4.0 to 8.1°). Liu et al. [13] proposed a calibration method that effectively suppresses the shaking disturbances, and the orientation errors are 5.8 ± 3.2°. The Xsens MVN native protocols most accurately determined the flexion/extension joint angle, while the joint angle measurements associated with the other two joint axes had lower accuracy (1.38 to 6.69°) [18].
In summary, our method achieves ideal results. Our regression equations for the anatomical landmark positions in the segment frame calculation are in good agreement with the OMC measurement results. Note that the orientation accuracy of our IMU is lower than that of the Xsens MVN. The orientation correction method using the average AoR makes our trajectory error smaller than the Xsens MVN native protocols, and has similar joint angle errors to that of Xsens MVN when ROM is taken into account. However, the individual differences in knee AoR should be considered in future research, as the use of average AoR and individual AoR does not achieve the best correlation. This may be due to other confounding factors not accounted for in this study. For example, the placement of the marker clusters and the IMUs are different, and the effect of soft tissue deformation on them is also different. As a result, the estimated knee AoRs may not be the same, which is why the error of the two anatomical landmarks of the femoral frame slightly increases after orientation correction.
Conclusion
This paper provided a new output format for inertial motion capture, allowing users to define joint coordinate systems according to their needs and compare them more effectively with optical motion capture systems. For the first time, we proposed regression equations of Chinese anatomical landmark positions in a segment frame that conforms to the ISB standard. We also proposed an orientation correction method using joint constraints, which improves the accuracy of anatomical landmark trajectories. Experimental results showed a good agreement with optical motion capture as the gold standard and the accuracy of this method is are similar to that of Xsens MVN. Although there is still a gap in accuracy compared with optical motion capture, this method enables human motion measurement to be used in more scenarios.