Oregon Medicaid Paid Births: Validity and Reliability of Birth Certificate Reported Payer and Medicaid Claims Data 2008-2014

Mary Ann Evans^1, , Vivian Siu², Krista Markwardt³ and Sarah Hargand⁴

¹Oregon Health Authority, United States

²Oregon Health Authority, Public Health, Maternal Child Health

³Oregon Health Authority, Center for Health Statistics

⁴Oregon Health Authority, Public Health, Health Promotion and Chronic Disease Prevention

Cite this paper

Mary Ann Evans, Vivian Siu, Krista Markwardt and Sarah Hargand. Oregon Medicaid Paid Births: Validity and Reliability of Birth Certificate Reported Payer and Medicaid Claims Data 2008-2014. American Journal of Public Health Research. 2017; 5(2):36-42. doi: 10.12691/AJPHR-5-2-2

Abstract

Self-reported payer data from the birth certificate is frequently used to identify Medicaid births, but evaluation of validity and reliability is lacking due to the challenges of gaining access to Medicaid data and data complexity. Oregon birth certificate and Medicaid paid claims were linked and compared to assess the validity and reliability of birth certificate reported payer data. Birth certificate data underestimated Medicaid paid births and underestimation grew from 18% in 2008 to 25% by 2014. Birth certificate data had moderate to substantial agreement with Medicaid claims, but reliability declined over time from a Kappa score of .82 to .75. Reliability was substantially lower for younger, less educated, Hispanic, American Indian or Alaskan Native (AIAN), Black or African American (BAA), and Native Hawaiian or Pacific Islander (NHPI) women. Specificity and positive predictive value were above 90% over time and by age, ethnicity, race and education. Sensitivity and negative predictive values declined from 84% and 87% in 2008 to 78% in 2014 and were lower than specificity and positive predictive values. Sensitivity values were higher for younger, less educated, Hispanic, AIAN, BAA and NHPI women. Negative predictive values were lower for younger, less educated, Hispanic, AIAN, BAA and NHPI women. The results document the limitations of birth certificate and strengths of Medicaid data for counting Medicaid paid births and allocating resources for community programs.

Keywords

birth certificate payer, medicaid births, medicaid paid claims, validity, reliability

Copyright

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References

[1]	Buettgens, M., Holahan, J. and Carroll, C. In Timely Analysis of Immediate Health Policy Issues: Health reform across the states: Increased Insurance Coverage and Federal Spending on the Exchanges and Medicaid. Washington D.C.: Urban Institute; 2011, p. 1-8.
[2]	Markus, A., Andres, E., West, K., Garro, N., and Pellegrini, C. Medicaid Covered Births, 2008-2010, in the Context of the Implementation of Health Reform. Women’s Health Issues 2013; 23(5):e273-e280.
[3]	Agency for Healthcare Research and Quality. Healthcare Cost and Utilization Project (HCUP). www.ahrq.gov/research/data/hcup/index.html data accessed July 2016.
[4]	DiGiuseppe, D., Aron, D., Ranbom, L., Harper, D. and Rosenthal, G. Reliability of birth certificate data: A multi-hospital comparison to medical record information. Maternal and Child Health Journal 2002; 6(3):169-79.
[5]	Northam, S., and Knapp, T. The reliability and validity of birth certificates. Journal of Obstetric, Gynecologic, and Neonatal Nursing 2006; 35(1): 3-12.
[6]	Reichman, N. and Hade, E. Validation of birth certificate data: A study of women in New Jersey’s Health Start Program. Annals of Epidemiology 2001; 11(3): 186-93.
[7]	Zollinger, T., Przybylski, M., and Gamache, R. Reliability of Indiana birth certificate data compared to medical records. Annals of Epidemiology 2006; 16(1):1-10.
[8]	Vinikoor, L., Messer, L. Laraia, B., et al. Reliability of variables on the North Carolina birth certificate: A comparison with directly queried values from a cohort study. Pediatric and Perinatal Epidemiology 2010; 24(1):102-112.
[9]	Martin, J., Wilson, E., Osterman, M., Saadi, E., Sutton, S., and Hamilton, B. Assessing the Quality of Medical and Health Data from the 2003 Birth Certificate Revision: Results from Two States. National Vital Statistics Reports 2013; 62(2): 1-20.
[10]	Kane, D. and Sappenfield, W. Ascertainment of Medicaid payment for delivery on the Iowa birth certificate: Is accuracy sufficient for timely policy and program relevant analysis? Maternal Child Health Journal 2014; 18: 970-977.