Validity and reliability of ankle morphological measurements on computerized tomography-synthesized planar radiographs

Chien Chung Kuo, Hsuan Lun Lu, Tung Wu Lu, Alberto Leardini, Mei Ying Kuo, Horng Chaung Hsu

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: Clinical success of total ankle arthroplasty depends heavily on the available information on the morphology of the bones, often obtained from measurements on planar radiographs. The current study aimed to evaluate the intra-rater, inter-rater and inter-session reliability and the validity of radiograph-based measurements of ankle morphology, and to quantify the effects of examiner experience on these measurements. Methods: Twenty-four fresh frozen ankle specimens were CT scanned, data of which were used to reconstruct 3D volumetric bone models for synthesizing 2D radiographs. Two orthopaedic surgeons with different levels of clinical experience identified twenty landmarks five times on each of the synthesized sagittal and coronal radiographs and repeated the test on a subsequent day within 5 days. The landmarks were used to calculate fourteen morphological parameters. The two-way mixed-effects (ICC3,1), two-way random-effects (ICC2,k) and two-way random-effects (ICC3,k) models were used, respectively, to assess the intra-rater, inter-rater and inter-session reliability of measurements. The validity of the measurements for each examiner was assessed by comparing them with gold standard values obtained from the 2D radiographs projected from the 3D volumetric models using Pearson's correlation analysis and Bland and Altman plots, and the differences were defined as the measurement errors. Results: Most of the morphological parameters were of good to very good intra-rater, inter-session and inter-rater reliability for both examiners (ICC > 0.61). Experience appeared to affect the inter-rater and inter-session reliability, the senior examiner showing greater inter-session ICC values than the junior examiner. Most of the tibial parameters had moderate to excellent correlations with the corresponding gold standard values but were underestimated by both examiners, in contrast to most of the talar parameters that were overestimated and had only poor to fair correlations. Conclusions: Most of the morphological parameters of the ankle can be estimated from radiographs with good to very good intra-rater, inter-session and inter-rater reliability, for both clinically experienced and less experienced examiners. Clinical experience helped increase the reliability of repeated evaluations after a longer interval, such as in a follow-up assessment. It is suggested that critical clinical decisions based on repeated morphology measurements should be made by more experienced surgeons or after appropriate training.

Original languageEnglish
Article number92
JournalBioMedical Engineering Online
Volume15
Issue number1
DOIs
Publication statusPublished - Aug 5 2016

Fingerprint

Computerized tomography
Reproducibility of Results
Ankle
Tomography
Bone and Bones
Bone
Arthroplasty
Orthopedics
Measurement errors

Keywords

  • Ankle morphology
  • Digitally reconstructed radiograph
  • Reliability
  • Validity

ASJC Scopus subject areas

  • Radiological and Ultrasound Technology
  • Biomaterials
  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging

Cite this

Validity and reliability of ankle morphological measurements on computerized tomography-synthesized planar radiographs. / Kuo, Chien Chung; Lu, Hsuan Lun; Lu, Tung Wu; Leardini, Alberto; Kuo, Mei Ying; Hsu, Horng Chaung.

In: BioMedical Engineering Online, Vol. 15, No. 1, 92, 05.08.2016.

Research output: Contribution to journalArticle

Kuo, Chien Chung ; Lu, Hsuan Lun ; Lu, Tung Wu ; Leardini, Alberto ; Kuo, Mei Ying ; Hsu, Horng Chaung. / Validity and reliability of ankle morphological measurements on computerized tomography-synthesized planar radiographs. In: BioMedical Engineering Online. 2016 ; Vol. 15, No. 1.
@article{282a4cc51f6c411a9e19a2d33498f6c5,
title = "Validity and reliability of ankle morphological measurements on computerized tomography-synthesized planar radiographs",
abstract = "Background: Clinical success of total ankle arthroplasty depends heavily on the available information on the morphology of the bones, often obtained from measurements on planar radiographs. The current study aimed to evaluate the intra-rater, inter-rater and inter-session reliability and the validity of radiograph-based measurements of ankle morphology, and to quantify the effects of examiner experience on these measurements. Methods: Twenty-four fresh frozen ankle specimens were CT scanned, data of which were used to reconstruct 3D volumetric bone models for synthesizing 2D radiographs. Two orthopaedic surgeons with different levels of clinical experience identified twenty landmarks five times on each of the synthesized sagittal and coronal radiographs and repeated the test on a subsequent day within 5 days. The landmarks were used to calculate fourteen morphological parameters. The two-way mixed-effects (ICC3,1), two-way random-effects (ICC2,k) and two-way random-effects (ICC3,k) models were used, respectively, to assess the intra-rater, inter-rater and inter-session reliability of measurements. The validity of the measurements for each examiner was assessed by comparing them with gold standard values obtained from the 2D radiographs projected from the 3D volumetric models using Pearson's correlation analysis and Bland and Altman plots, and the differences were defined as the measurement errors. Results: Most of the morphological parameters were of good to very good intra-rater, inter-session and inter-rater reliability for both examiners (ICC > 0.61). Experience appeared to affect the inter-rater and inter-session reliability, the senior examiner showing greater inter-session ICC values than the junior examiner. Most of the tibial parameters had moderate to excellent correlations with the corresponding gold standard values but were underestimated by both examiners, in contrast to most of the talar parameters that were overestimated and had only poor to fair correlations. Conclusions: Most of the morphological parameters of the ankle can be estimated from radiographs with good to very good intra-rater, inter-session and inter-rater reliability, for both clinically experienced and less experienced examiners. Clinical experience helped increase the reliability of repeated evaluations after a longer interval, such as in a follow-up assessment. It is suggested that critical clinical decisions based on repeated morphology measurements should be made by more experienced surgeons or after appropriate training.",
keywords = "Ankle morphology, Digitally reconstructed radiograph, Reliability, Validity",
author = "Kuo, {Chien Chung} and Lu, {Hsuan Lun} and Lu, {Tung Wu} and Alberto Leardini and Kuo, {Mei Ying} and Hsu, {Horng Chaung}",
year = "2016",
month = "8",
day = "5",
doi = "10.1186/s12938-016-0215-9",
language = "English",
volume = "15",
journal = "BioMedical Engineering Online",
issn = "1475-925X",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Validity and reliability of ankle morphological measurements on computerized tomography-synthesized planar radiographs

AU - Kuo, Chien Chung

AU - Lu, Hsuan Lun

AU - Lu, Tung Wu

AU - Leardini, Alberto

AU - Kuo, Mei Ying

AU - Hsu, Horng Chaung

PY - 2016/8/5

Y1 - 2016/8/5

N2 - Background: Clinical success of total ankle arthroplasty depends heavily on the available information on the morphology of the bones, often obtained from measurements on planar radiographs. The current study aimed to evaluate the intra-rater, inter-rater and inter-session reliability and the validity of radiograph-based measurements of ankle morphology, and to quantify the effects of examiner experience on these measurements. Methods: Twenty-four fresh frozen ankle specimens were CT scanned, data of which were used to reconstruct 3D volumetric bone models for synthesizing 2D radiographs. Two orthopaedic surgeons with different levels of clinical experience identified twenty landmarks five times on each of the synthesized sagittal and coronal radiographs and repeated the test on a subsequent day within 5 days. The landmarks were used to calculate fourteen morphological parameters. The two-way mixed-effects (ICC3,1), two-way random-effects (ICC2,k) and two-way random-effects (ICC3,k) models were used, respectively, to assess the intra-rater, inter-rater and inter-session reliability of measurements. The validity of the measurements for each examiner was assessed by comparing them with gold standard values obtained from the 2D radiographs projected from the 3D volumetric models using Pearson's correlation analysis and Bland and Altman plots, and the differences were defined as the measurement errors. Results: Most of the morphological parameters were of good to very good intra-rater, inter-session and inter-rater reliability for both examiners (ICC > 0.61). Experience appeared to affect the inter-rater and inter-session reliability, the senior examiner showing greater inter-session ICC values than the junior examiner. Most of the tibial parameters had moderate to excellent correlations with the corresponding gold standard values but were underestimated by both examiners, in contrast to most of the talar parameters that were overestimated and had only poor to fair correlations. Conclusions: Most of the morphological parameters of the ankle can be estimated from radiographs with good to very good intra-rater, inter-session and inter-rater reliability, for both clinically experienced and less experienced examiners. Clinical experience helped increase the reliability of repeated evaluations after a longer interval, such as in a follow-up assessment. It is suggested that critical clinical decisions based on repeated morphology measurements should be made by more experienced surgeons or after appropriate training.

AB - Background: Clinical success of total ankle arthroplasty depends heavily on the available information on the morphology of the bones, often obtained from measurements on planar radiographs. The current study aimed to evaluate the intra-rater, inter-rater and inter-session reliability and the validity of radiograph-based measurements of ankle morphology, and to quantify the effects of examiner experience on these measurements. Methods: Twenty-four fresh frozen ankle specimens were CT scanned, data of which were used to reconstruct 3D volumetric bone models for synthesizing 2D radiographs. Two orthopaedic surgeons with different levels of clinical experience identified twenty landmarks five times on each of the synthesized sagittal and coronal radiographs and repeated the test on a subsequent day within 5 days. The landmarks were used to calculate fourteen morphological parameters. The two-way mixed-effects (ICC3,1), two-way random-effects (ICC2,k) and two-way random-effects (ICC3,k) models were used, respectively, to assess the intra-rater, inter-rater and inter-session reliability of measurements. The validity of the measurements for each examiner was assessed by comparing them with gold standard values obtained from the 2D radiographs projected from the 3D volumetric models using Pearson's correlation analysis and Bland and Altman plots, and the differences were defined as the measurement errors. Results: Most of the morphological parameters were of good to very good intra-rater, inter-session and inter-rater reliability for both examiners (ICC > 0.61). Experience appeared to affect the inter-rater and inter-session reliability, the senior examiner showing greater inter-session ICC values than the junior examiner. Most of the tibial parameters had moderate to excellent correlations with the corresponding gold standard values but were underestimated by both examiners, in contrast to most of the talar parameters that were overestimated and had only poor to fair correlations. Conclusions: Most of the morphological parameters of the ankle can be estimated from radiographs with good to very good intra-rater, inter-session and inter-rater reliability, for both clinically experienced and less experienced examiners. Clinical experience helped increase the reliability of repeated evaluations after a longer interval, such as in a follow-up assessment. It is suggested that critical clinical decisions based on repeated morphology measurements should be made by more experienced surgeons or after appropriate training.

KW - Ankle morphology

KW - Digitally reconstructed radiograph

KW - Reliability

KW - Validity

UR - http://www.scopus.com/inward/record.url?scp=84982839772&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84982839772&partnerID=8YFLogxK

U2 - 10.1186/s12938-016-0215-9

DO - 10.1186/s12938-016-0215-9

M3 - Article

VL - 15

JO - BioMedical Engineering Online

JF - BioMedical Engineering Online

SN - 1475-925X

IS - 1

M1 - 92

ER -