Ascertaining provider-level implicit bias in electronic health records with rules-based natural language processing: A pilot study in the case of prostate cancer

Purpose Implicit, unconscious biases in medicine are personal attitudes about race, ethnicity, gender, and other characteristics that may lead to discriminatory patterns of care. However, there is no consensus on whether implicit bias represents a true predictor of differential care given an absence of real-world studies. We conducted the first real-world pilot study of provider implicit bias by evaluating treatment parity in prostate cancer using unstructured data–the most common way providers document granular details of the patient encounter. Methods and findings Patients ≥18 years with a diagnosis of very-low to favorable intermediate-risk prostate cancer followed by 3 urologic oncologists from 2010 through 2021. The race Implicit Association Test was administered to all providers. Natural language processing screened human annotation using validated regex ontologies evaluated each provider’s care on four prostate cancer quality indicators: (1) active surveillance utilization; (2) molecular biomarker discussion; (3) urinary function evaluation; and (4) sexual function evaluation. The chi-squared test and phi coefficient were utilized to respectively measure the statistical significance and the strength of association between race and four quality indicators. 1,094 patients were included. While Providers A and B demonstrated no preference on the race Implicit Association Test, Provider C showed preference for White patients. Provider C recommended active surveillance (p<0.01, φ = 0.175) and considered biomarkers (p = 0.047, φ = 0.127) more often in White men than expected, suggestive of treatment imparity. Provider A considered biomarkers (p<0.01, φ = 0.179) more often in White men than expected. Provider B demonstrated treatment parity in all evaluated quality indicators (p>0.05). Conclusions In this pilot study, providers’ practice patterns were associated with both patient race and implicit racial preferences in prostate cancer. Alerting providers of existing implicit bias may restore parity, however future assessments are needed to validate this concept.