Purpose Outcome of endovascular treatment in acute ischemic stroke patients is depending on the collateral circulation maintaining blood flow to the ischemic territory. We evaluated the inter-rater... Show morePurpose Outcome of endovascular treatment in acute ischemic stroke patients is depending on the collateral circulation maintaining blood flow to the ischemic territory. We evaluated the inter-rater reliability and accuracy of raters and an automated algorithm for assessing the collateral score (CS, range: 0-3) in acute ischemic stroke patients. Methods Baseline CTA scans with an intracranial anterior occlusion from the MR CLEAN study (n=500) were used. For each core lab CS, ten CTA scans with sufficient quality were randomly selected. After a training session in collateral scoring, all selected CTA scans were individually evaluated for a visual CS by three groups: 7 radiologists, 13 junior and 9 senior radiology residents. Two additional radiologists scored CS to be used as reference, with a third providing a CS to produce a 2 out of 3 consensus CS in case of disagreement. An automated algorithm was also used to compute CS. Inter-rater agreement was reported with intraclass correlation coefficient (ICC). Accuracy of visual and automated CS were calculated. Results 39 CTA scans were assessed (1 corrupt CTA-scan excluded). All groups showed a moderate ICC (0.689-0.780) in comparison to the reference standard. Overall human accuracy was 65 +/- 7% and increased to 88 +/- 5% for dichotomized CS (0-1, 2-3). Automated CS accuracy was 62%, and 90% for dichotomized CS. No significant difference in accuracy was found between groups with different levels of expertise. Conclusion After training, inter-rater reliability in collateral scoring was not influenced by experience. Automated CS performs similar to residents and radiologists in determining a collateral score. Show less
Objectives Outcome of endovascular treatment in acute ischemic stroke patients depends on collateral circulation to provide blood supply to the ischemic territory. We evaluated the performance of a... Show moreObjectives Outcome of endovascular treatment in acute ischemic stroke patients depends on collateral circulation to provide blood supply to the ischemic territory. We evaluated the performance of a commercially available algorithm for assessing the collateral score (CS) in acute ischemic stroke patients. Methods Retrospectively, baseline CTA scans (<= 3-mm slice thickness) with an intracranial carotid artery (ICA), middle cerebral artery segment M1 or M2 occlusion, from the MR CLEAN Registry (n = 1627) were evaluated. All CTA scans were evaluated for visual CS (0-3) by eight expert radiologists (reference standard). A Web-based AI algorithm quantified the collateral circulation (0-100%) for correctly detected occlusion sides. Agreement between visual CS and categorized automated CS (0: 0%, 1: > 0- <= 50%, 2: > 50- < 100%, 3: 100%) was assessed. Area under the curve (AUC) values for classifying patients in having good (CS: 2-3) versus poor (CS: 0-1) collaterals and for predicting functional independence (90-day modified Rankin Scale 0-2) were computed. Influence of CTA acquisition timing after contrast material administration was reported. Results In the analyzed scans (n = 1024), 59% agreement was found between visual CS and automated CS. An AUC of 0.87 (95% CI: 0.85-0.90) was found for discriminating good versus poor CS. Timing of CTA acquisition did not influence discriminatory performance. AUC for predicting functional independence was 0.66 (95% CI 0.62-0.69) for automated CS, similar to visual CS 0.64 (95% CI 0.61-0.68). Conclusions The automated CS performs similar to radiologists in determining a good versus poor collateral score and predicting functional independence in acute ischemic stroke patients with a large vessel occlusion. Show less
