Inter-clinician variation could cause uncertainty in disease management. This is reported to be high in Retinopathy of Prematurity (ROP), a potentially blinding retinal disease affecting premature inf...
An anonymized survey of ROP images was administered to the expert(s) and the trainee(s) using a study-designed user interface. The results were analyzed for repeatability as well as to identify the le...
Correlation and disagreement between the expert and the trainees were visualized using the Dipstick™ diagram. Intra-clinician repeatability and reclassification statistics were assessed for all. The r...
This novel, automated algorithm quantifies the differences using machine learning techniques. This will help audit the training process by objectively measuring differences between experts and trainee...
Training for image-based ROP diagnosis can be more objectively performed using this novel, machine learning-based automated image analyzer and classifier....
Establishing the reproducibility of expert-derived measurements on CTA exams of aortic dissection is clinically important and paramount for ground-truth determination for machine learning....
Four independent observers retrospectively evaluated CTA exams of 72 patients with uncomplicated Stanford type B aortic dissection and assessed the reproducibility of a recently proposed combination o...
Pre-training ICCs of the four morphologic features ranged from 0.04 (-0.05 to 0.13) to 0.68 (0.49-0.81) between observer 1 and observers 2-4 and from 0.50 (0.32-0.69) to 0.89 (0.78-0.95) between obser...
Manual morphologic feature measurements on CTA images can be optimized resulting in improved inter-observer reliability. This is essential for robust ground-truth determination for machine learning mo...
• Clinical fashion manual measurements of aortic CTA imaging features showed poor inter-observer reproducibility. • A standardized workflow with standardized training resulted in substantial improveme...
Thyroid eye disease (TED) can be difficult to manage. The range of available treatments is expanding rapidly; however, cost is a concern and some patients do not respond. The Clinical Activity Score (...
Prospective reliability analysis....
Nine patients with a spectrum of clinical features of TED were assessed by 6 experienced observers on the same day. Agreement among the observers was analyzed using the Krippendorff alpha....
The Krippendorff alpha for the total CAS was 0.532 (95% CI = 0.199-0.665), whereas alpha values for the individual components of the CAS varied between 0.171 (CI = 0.000-0.334) for lid redness and 0.6...
This study has shown unreliable inter-observer variability in total CAS and most individual CAS components, thus highlighting the need for improving the performance of the CAS or seeking other methods...
A trauma resuscitation is dynamic and complex process in which failures could lead to serious adverse events. In several trauma centers, evaluation of trauma resuscitation is part of a hospital's qual...
In this prospective observational study, validity was assessed by comparing the observed adherence to 28 advanced trauma life support (ATLS) guideline related tasks by video analysis to life observati...
Eleven simulated and thirteen real-life resuscitations were assessed. Overall, the percentage of observed ATLS related tasks performed during simulated resuscitations was 10.4% (P < 0.001) higher when...
Video analysis of trauma resuscitations may be more valid and reliable compared to evaluation by live observers. These outcomes may guide the debate to justify video review instead of live observation...
Most displaced distal radius fractures (DRF) are treated nonoperatively, with reduction and immobilization in a cast. Studies assessing intra- or inter-observer agreement on radiologic measurements of...
Our study is based on the Kuopio Osteoporosis Risk Factor and Prevention (OSTPRE) study. All detected DRFs during the OSTPRE follow-up were retrieved and based on sample size calculations 50 fractures...
For radial inclination, radial shortening, and dorsal/volar tilt, intra- and inter-observer correlations were high (CCC > 0.76). In addition, measurements of wrist angle in a splint had high correlati...
Intra- and inter-observer repeatability of casting position of radial inclination, radial shortening, and dorsal/volar tilt were high whereas intra-articular gap and step had poor correlations....
Non-cystic fibrosis bronchiectasis is a clinically important disease with an estimated 340,000-522,000 persons living with the disease and 70,000 being diagnosed annually. The radiographic diagnosis r...
To examine the inter-observer agreement between two retina specialists in grading diabetic retinopathy (DR) severity in ultra-wide-field fundus photographs....
Two hundred and seventy patients with diabetes, who visited the vitreoretinal specialty at a tertiary eye care hospital, with or without DR underwent comprehensive ophthalmic examination, dilated reti...
The two graders showed agreement in 229/270 images (84.8%) and disagreement in 41/270 images (15.2%). The unweighted kappa for agreement between graders was k = 0.715, SE = 0.037 and the weighted kapp...
The impact of disagreement noted between observers in grading DR on UWF fundus photographs should be considered when utilizing UWF system in clinical studies....
The current paradigm for evaluating computed tomography (CT) system performance relies on a task-based approach. As the Hotelling observer (HO) provides an upper bound of observer performances in spec...
Here we investigated the efficiency of a supervised ML-algorithm used to design a CO for predicting the performance of unconstrained HO. The ML-algorithm was applied either (1) in the estimator for di...
A channelized support vector machine (CSVM) was employed and compared against the CHO in terms of ability to predict HO performances. Both the CSVM and the CHO were estimated with channels derived fro...
The CSVM outperformed the CHO for all types of channels and regularization strategies. Furthermore, even though both COs generalized well to images reconstructed with the same regularization strategy ...
These results argue for introducing the supervised-learning paradigm in the detector function rather than in the operator of the channels when designing a CO to provide an accurate estimate of HO perf...
Patients with tonsillar cancer (TC) often have dental fillings that can significantly degrade the quality of computed tomography (CT) simulator images due to metal artifacts. We evaluated whether the ...
Eighteen patients with TC with dental fillings were enrolled in this study. Contrast-enhanced CT simulator images were reconstructed using the conventional (CT...
GTV...
The use of the MAR algorithm led to the delineation of smaller GTVs and reduced interobserver variations in delineating GTV of the primary tumors in patients with TC....
Qualitative observer-based and quantitative radiomics-based analyses of T1w contrast-enhanced magnetic resonance imaging (T1w-CE MRI) have both been shown to predict the outcomes of brain metastasis (...
