Prior applications of machine learning to population health have relied on conventional model assessment criteria, limiting the utility of models as decision supports for public health practitioners. To facilitate practitioner use of machine learning as decision support for area-level intervention, this study developed and applied four practice-based predictive model evaluation criteria (implementation capacity, preventive potential, health equity, and jurisdictional practicalities). We used a case study of overdose prevention in Rhode Island to illustrate how these criteria could inform public health practice and health equity promotion. We used Rhode Island overdose mortality records from January 2016 to June 2020 (N=1,408) and neighborhood-level Census data. We learned two disparate machine learning models, Gaussian process and random forest, to illustrate the comparative utility of our criteria to guide interventions. Our models predicted 7.5-36.4% of overdose deaths during the test period, illustrating the preventive potential of overdose interventions assuming 5-20% statewide implementation capacities for neighborhood-level resource deployment. We described the health equity implications of predictive modeling to guide interventions along urbanicity, racial/ethnic composition, and poverty. In sum, our study discussed considerations to complement predictive model evaluation criteria and inform the prevention and mitigation of spatially dynamic public health problems across the breadth of practice.
Translating predictive analytics for public health practice: A case study of overdose prevention in Rhode Island
American Journal of Epidemiology, 192 (10), 1659-1668. doi: 10.1093/aje/kwad119. PMCID: PMC10558193.