A Machine Learning Algorithm to Identify Patients at Risk of Unplanned Subsequent Surgery After Intramedullary Nailing for Tibial Shaft Fractures

Bhandari, M.; Bulstra, A.E.J.; Bzovsky, S.; Doornberg, J.N.; Goslings, J.C.; Hendrickx, L.A.M.; ... ; SPRINT Investigators (2021)

Article / Letter to editor

Objectives: In the SPRINT trial, 18% of patients with a tibial shaft fracture (TSF) treated with intramedullary nailing (IMN) had one or more unplanned subsequent surgical procedures. It is clinically relevant for surgeon and patient to anticipate unplanned secondary procedures, other than operations that can be readily expected such as reconstructive procedures for soft tissue defects. Therefore, the objective of this study was to develop a machine learning (ML) prediction model using the SPRINT data that can give individual patients and their care team an estimate of their particular probability of an unplanned second surgery. Methods: Patients from the SPRINT trial with unilateral TSFs were randomly divided into a training set (80%) and test set (20%). Five ML algorithms were trained in recognizing patterns associated with subsequent surgery in the training set based on a subset of variables identified by random forest algorithms. Performance of each ML algorithm was evaluated and compared based on (1) area under the ROC curve, (2) calibration slope and intercept, and (3) the Brier score. Results: Total data set comprised 1198 patients, of whom 214 patients (18%) underwent subsequent surgery. Seven variables were used to train ML algorithms: (1) Gustilo-Anderson classification, (2) Tscherne classification, (3) fracture location, (4) fracture gap, (5) polytrauma, (6) injury mechanism, and (7) OTA/AO classification. The best-performing ML algorithm had an area under the ROC curve, calibration slope, calibration intercept, and the Brier score of 0.766, 0.954, -0.002, and 0.120 in the training set and 0.773, 0.922, 0, and 0.119 in the test set, respectively. Conclusions: An ML algorithm was developed to predict the probability of subsequent surgery after IMN for TSFs. This ML algorithm may assist surgeons to inform patients about the probability of subsequent surgery and might help to identify patients who need a different perioperative plan or a more intensive approach.

• tibia shaft fracture
• intramedullary nailing
• subsequent surgery
• machine learning
• prediction model

• All authors: Bhandari, M.; Bulstra, A.E.J.; Bzovsky, S.; Doornberg, J.N.; Goslings, J.C.; Hendrickx, L.A.M.; Jaarsma, R.L.; Jeray, K.J.; Kerkhoffs, G.M.M.J.; Petrisor, B.; Ring, D.; Schemitsch, E.H.; Swiontkowski, M.; Sanders, D.; Sprague, S.; Tornetta, P.; Walter, S.D.; Heels-Ansdell, D.; Buckingham, L.; Leece, P.; Viveiros, H.; Mignott, T.; Ansell, N.; Sidorkewicz, N.; Agel, J.; Bombardier, C.; Berlin, J.A.; Bosse, M.; Browner, B.; Gillespie, B.; Jones, A.; O'Brien, P.; Poolman, R.; Macleod, M.D.; Carey, T.; Leitch, K.; Bailey, S.; Gurr, K.; Konito, K.; Bartha, C.; Low, I.; MacBean, L.V.; Ramu, M.; Reiber, S.; Strapp, R.; Tieszer, C.; Kreder, H.J.; Stephen, D.J.G.; Axelrod, T.S.; Yee, A.J.M.; Richards, R.R.; Finkelstein, J.; Gofton, W.; Murnaghan, J.; Schatztker, J.; Ford, M.; Bulmer, B.; Conlan, L.; Laflamme, G.Y.; Berry, G.; Beaumont, P.; Ranger, P.; Laflamme, G.H.; Gagnon, S.; Malo, M.; Fernandes, J.; Poirier, M.F.; McKee, M.D.; Waddell, J.P.; Bogoch, E.R.; Daniels, T.R.; McBroom, R.R.; Vicente, M.R.; Storey, W.; Wild, L.M.; McCormack, R.; Perey, B.; Goetz, T.J.; Pate, G.; Penner, M.J.; Panagiotopoulos, K.; Pirani, S.; Dommisse, I.G.; Loomer, R.L.; Stone, T.; Moon, K.; Zomar, M.; Webb, L.X.; Teasdall, R.D.; Birkedal, J.P.; Martin, D.F.; Ruch, D.S.; Kilgus, D.J.; Pollock, D.C.; Harris, M.B.; Wiesler, E.R.; Ward, W.G.; Shilt, J.S.; Koman, A.L.; Poehling, G.G.; Kulp, B.; Creevy, W.R.; Stein, A.B.; Bono, C.T.; Einhorn, T.A.; Brown, T.D.; Pacicca, D.; Sledge, J.B.; Foster, T.E.; Voloshin, I.; Bolton, J.; Carlisle, H.; Shaughnessy, L.; Obremskey, W.T.; LeCroy, C.M.; Meinberg, E.G.; Messer, T.M.; Craig, W.L.; Dirschl, D.R.; Caudle, R.; Harris, T.; Elhert, K.; Hage, W.; Jones, R.; Piedrahita, L.; Schricker, P.O.; Driver, R.; Godwin, J.; Kregor, P.J.; Tennent, G.; Truchan, L.M.; Sciadini, M.; Shuler, F.D.; Driver, R.E.; Nading, M.A.; Neiderstadt, J.; Vap, A.R.; Vallier, H.; Patterson, B.M.; Wilber, J.H.; Wilber, R.G.; Sontich, J.K.; Moore, T.A.; Brady, D.; Cooperman, D.R.; Davis, J.A.; Cureton, B.A.; Mandel, S.; Orr, R.D.; Sadler, J.T.S.; Hussain, T.; Rajaratnam, K.; Drew, B.; Bednar, D.A.; Kwok, D.C.H.; Pettit, S.; Hancock, J.; Cole, P.A.; Smith, J.J.; Brown, G.A.; Lange, T.A.; Stark, J.G.; Levy, B.A.; Garaghty, M.J.; Salzman, J.G.; Schutte, C.A.; Tastad, L.; Vang, S.; Seligson, D.; Roberts, C.S.; Malkani, A.L.; Sanders, L.; Dyer, C.; Heinsen, J.; Smith, L.; Madanagopal, S.; Frantz-Bush, L.; Coupe, K.J.; Tucker, J.J.; Criswell, A.R.; Buckle, R.; Rechter, A.J.; Sheth, D.S.; Urquart, B.; Trotscher, T.; Anders, M.J.; Kowalski, J.M.; Fineberg, M.S.; Bone, L.B.; Phillips, M.J.; Rohrbacher, B.; Stegemann, P.; Mihalko, W.M.; Buyea, C.; Augustine, S.J.; Jackson, W.T.; Solis, G.; Ero, S.U.; Segina, D.N.; Berrey, H.B.; Agnew, S.G.; Fitzpatrick, M.; Campbell, L.C.; Derting, L.; McAdams, J.; Ponsen, K.J.; Luitse, J.; Kloen, P.; Joosse, P.; Winkelhagen, J.; Duivenvoorden, R.; Teague, D.C.; Davey, J.; Sullivan, J.A.; Ertl, W.J.J.; Puckett, T.A.; Pasque, C.B.; Tompkins, J.F.; Gruel, C.R.; Kammerlocher, P.; Lehman, T.P.; Puffinbarger, W.R.; Carl, K.L.; Weber, D.W.; Jomha, N.M.; Goplen, G.R.; Masson, E.; Beaupre, L.A.; Greaves, K.E.; Schaump, L.N.; Goetz, D.R.; Westberry, D.E.; Broderick, J.S.; Moon, B.S.; Tanner, S.L.; Powell, J.N.; Buckley, R.E.; Elves, L.; Connolly, S.; Abraham, E.P.; Steele, T.; Ellis, T.; Herzberg, A.; Crawford, D.E.; Hart, R.; Hayden, J.; Orfaly, R.M.; Vigland, T.; Vivekaraj, M.; Bundy, G.L.; Miclau, T.; Matityahu, A.; Coughlin, R.R.; Kandemir, U.; McClellan, R.T.; Lin, C.H.H.; Karges, D.; Cramer, K.; Watson, J.T.; Moed, B.; Scott, B.; Beck, D.J.; Orth, C.; Puskas, D.; Clark, R.; Jones, J.; Egol, K.A.; Paksima, N.; France, M.; Wai, E.K.; Johnson, G.; Wilkinson, R.; Gruszczynski, A.T.; Vexler, L.; Mallee, W.H.; Schipper, I.B.; SPRINT Investigators
• Date: 2021-10-01
• Journal: Journal of Orthopaedic Trauma
• Volume: 35
• Issue: 10
• Pages: E381 - E388
• DOI: doi:10.1097/BOT.0000000000002070