Evaluation of Reporting Quality of Systematic Reviews on Health Economic Evaluation Studies Based on the CHEERS Statement: An Overview of Reviews
Abstract
Background: Economic evaluations in healthcare are designed to inform decisions by the estimation of cost and effect trade-off of two or more interventions. We aimed to evaluate the standards of systematic reviews on health economic evaluation studies using the CHEERS (Consolidated Health Economic Evaluation Report Standards) tool.Methods: We searched the PubMed database with keywords CHEERS and its complete form in combination with keywords related to cost or economic evaluation without language and time limits until November 17, 2021. The CHEERS tool was then used to include systematic reviews.
Results: Overall, 32 systematic reviews, included 610 primary studies were included. Of the 32 included studies, only 1 study (3.1%) had poor quality, 5 studies (15.6%) had good quality, remaining studies had very good and excellent quality.
Conclusion: Some studies still have problems in expressing the standards. The necessity of standards for reporting economic evaluation studies in the field of health is very serious, and Cheers is one of the most important tools.
1. Stoddart GL, Torrance GW (1987). Methods for the economic evaluation of health care programmes. ed. Oxford [Oxfordshire]; Toronto: Oxford University Press.
2. Nguyen HN, Ly KN, Vo QT (2017). Assessing the quality of health economic evaluation research by cheers instrument: A critical literature review in Laos, Cambodia, and Myanmar. J App Pharm Sci, 7 (6):222-228.
3. Anderson R (2010). Systematic reviews of economic evaluations: utility or futility? Health Econ, 19 (3):350-364.
4. Husereau D, Drummond M, Petrou S, et al (2013). Consolidated health economic evaluation reporting standards (CHEERS) statement. BJOG, 120(6):765-70.
5. De Vet E, De Ridder D, De Wit J (2011). Environmental correlates of physical activity and dietary behaviours among young people: a systematic review of reviews. Obes Rev, 12 (5):e130-42.
6. Thomas H, Micucci S, Ciliska D (2005). Effectiveness of school-based interventions in reducing adolescent risk behaviours: A systematic review of reviews. ed. Effective Public Health Practice Project (EPHPP).
7. Ma H, Jian W, Xu T, et al (2016). Quality of pharmacoeconomic research in China: A systematic review. Medicine (Baltimore), 95 (41): e5114.
8. Zakiyah N, van Asselt AD, Roijmans F, Postma MJ (2016). Economic evaluation of family planning interventions in low and middle income countries; a systematic review. PLoS One, 11 (12):e0168447.
9. Banke-Thomas A, Wilson-Jones M, Madaj B, et al (2017). Economic evaluation of emergency obstetric care training: a systematic review. BMC Pregnancy Childbirth, 17:403.
10. Gillespie B, Chaboyer W, Erichsen-Andersson A, et al (2017). Economic case for intraoperative interventions to prevent surgical-site infection. Br J Surg, 104 (2):e55-e64.
11. Hope SF, Webster J, Trieu K, et al (2017). A systematic review of economic evaluations of population-based sodium reduction interventions. PLoS One, 12 (3):e0173600.
12. Ibrahim NH, Maruan K, Khairy HAM, et al (2017). Economic evaluations on antimicrobial stewardship programme: a systematic review. J Pharm Pharm Sci, 20:397-406.
13. Iribarren SJ, Cato K, Falzon L, et al (2017). What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS One, 12 (2):e0170581.
14. Melendez-Torres G, Auguste P, Armoiry X, et al (2017). Clinical effectiveness and cost-effectiveness of beta-interferon and glatiramer acetate for treating multiple sclerosis: systematic review and economic evaluation. Health Technol Assess, 21 (52):I-352.
15. Velentzis LS, Salagame U, Canfell K (2017). Menopausal hormone therapy: a systematic review of cost-effectiveness evaluations. BMC Health Serv Res, 17 (1):326.
16. Wong CK, Liao Q, Guo VY, et al (2017). Cost-effectiveness analysis of vaccinations and decision makings on vaccination programmes in Hong Kong: A systematic review. Vaccine, 35 (24):3153-3161.
17. Dritsaki M, Rivero-Arias O, Gray A, et al (2018). What do we know about managing Dupuytren’s disease cost-effectively? BMC Musculoskelet Disord, 19:34.
18. Grochtdreis T, König H-H, Dobruschkin A, et al (2018). Cost-effectiveness analyses and cost analyses in castration-resistant prostate cancer: a systematic review. PLoS One, 13 (12):e0208063.
19. Jiang X, Ming W-K, You JH (2019). The cost-effectiveness of digital health interventions on the management of cardiovascular diseases: systematic review. J Med Internet Res, 21 (6):e13166.
20. Ling X-X, Jin J-J, Zhu G-D, et al (2019). Cost-effectiveness analysis of malaria rapid diagnostic tests: a systematic review. Infect Dis Poverty, 8 (1):104.
21. Mendivil J, Appierto M, Aceituno S, et al (2019). Economic evaluations of screening strategies for the early detection of colorectal cancer in the average-risk population: A systematic literature review. PLoS One, 14 (12):e0227251.
22. Sultana M, Sarker AR, Ali N, et al (2019). Economic evaluation of community acquired pneumonia management strategies: A systematic review of literature. PLoS One, 14 (10):e0224170.
23. Anopa Y, Macpherson L, McIntosh E (2020). Systematic review of economic evaluations of primary caries prevention in 2-to 5-year-old preschool children. Value Health, 23 (8):1109-1118.
24. De La Perrelle L, Radisic G, Cations M, et al (2020). Costs and economic evaluations of quality improvement collaboratives in healthcare: a systematic review. BMC Health Serv Res, 20:155.
25. Hao X, Lou H, Bai J, et al (2020). Cost-effectiveness analysis of Xpert in detecting Mycobacterium tuberculosis: A systematic review. Int J Infect Dis, 95:98-105.
26. Niyomsri S, Duarte RV, Eldabe S, et al (2020). A systematic review of economic evaluations reporting the cost-effectiveness of spinal cord stimulation. Value Health, 23 (5):656-665.
27. Ten Ham RM, Klungel OH, Leufkens HG, Frederix GW (2020). A review of methodological considerations for economic evaluations of gene therapies and their application in literature. Value Health, 23 (9):1268-1280.
28. Woods T-J, Tesfay F, Speck P, Kaambwa B (2020). Economic evaluations considering costs and outcomes of diabetic foot ulcer infections: a systematic review. PLoS One, 15 (4):e0232395.
29. Qiu T, Men P, Sun T, Zhai S (2021). Cost-effectiveness of aprepitant in preventing chemotherapy-induced nausea and vomiting: a systematic review of published articles. Front Public Health, 9:660514.
30. Rezapour A, Souresrafil A, Peighambari MM, et al (2021). Economic evaluation of programs against COVID-19: A systematic review. Int J Surg, 85:10-18.
31. Schwander B, Nuijten M, Evers S, Hiligsmann M (2021). Replication of published health economic obesity models: assessment of facilitators, hurdles and reproduction success. Pharmacoeconomics, 39:433-446.
32. Stawowczyk E, Kawalec P (2018). A systematic review of the cost-effectiveness of biologics for ulcerative colitis. Pharmacoeconomics, 36:419-434.
33. Sanyal C, Husereau DR (2019). Community-based services by pharmacists: a systematic review of cost-utility analyses. Value Health, 22 (12):1450-1457.
34. Avanceña AL, Prosser LA (2021). Examining equity effects of health interventions in cost-effectiveness analysis: a systematic review. Value Health, 24 (1):136-143.
35. El Alili M, van Dongen JM, Huirne JA, et al (2017). Reporting and analysis of trial-based cost-effectiveness evaluations in obstetrics and gynaecology. Pharmacoeconomics, 35:1007-1033.
36. Ding H, Xin W, Tong Y, et al (2020). Cost effectiveness of immune checkpoint inhibitors for treatment of non-small cell lung cancer: a systematic review. PLoS One, 15 (9):e0238536.
37. Werner K, Risko N, Burkholder T, et al (2020). Cost–effectiveness of emergency care interventions in low and middle-income countries: a systematic review. Bull World Health Organ, 98 (5):341-352.
38. Galekop MM, Uyl-de Groot CA, Redekop WK (2021). A systematic review of cost-effectiveness studies of interventions with a personalized nutrition component in adults. Value Health, 24 (3):325-335.
39. Husereau D, Drummond M, Augustovski F, et al (2022). Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. Value Health, 25(1):3-9.
40. Miroshnychenko A, Uhlman K, Malone J, et al (2021). Systematic review of reporting quality of economic evaluations in plastic surgery based on the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. J Plast Reconstr Aesthet Surg, 74 (10):2458-2466.
2. Nguyen HN, Ly KN, Vo QT (2017). Assessing the quality of health economic evaluation research by cheers instrument: A critical literature review in Laos, Cambodia, and Myanmar. J App Pharm Sci, 7 (6):222-228.
3. Anderson R (2010). Systematic reviews of economic evaluations: utility or futility? Health Econ, 19 (3):350-364.
4. Husereau D, Drummond M, Petrou S, et al (2013). Consolidated health economic evaluation reporting standards (CHEERS) statement. BJOG, 120(6):765-70.
5. De Vet E, De Ridder D, De Wit J (2011). Environmental correlates of physical activity and dietary behaviours among young people: a systematic review of reviews. Obes Rev, 12 (5):e130-42.
6. Thomas H, Micucci S, Ciliska D (2005). Effectiveness of school-based interventions in reducing adolescent risk behaviours: A systematic review of reviews. ed. Effective Public Health Practice Project (EPHPP).
7. Ma H, Jian W, Xu T, et al (2016). Quality of pharmacoeconomic research in China: A systematic review. Medicine (Baltimore), 95 (41): e5114.
8. Zakiyah N, van Asselt AD, Roijmans F, Postma MJ (2016). Economic evaluation of family planning interventions in low and middle income countries; a systematic review. PLoS One, 11 (12):e0168447.
9. Banke-Thomas A, Wilson-Jones M, Madaj B, et al (2017). Economic evaluation of emergency obstetric care training: a systematic review. BMC Pregnancy Childbirth, 17:403.
10. Gillespie B, Chaboyer W, Erichsen-Andersson A, et al (2017). Economic case for intraoperative interventions to prevent surgical-site infection. Br J Surg, 104 (2):e55-e64.
11. Hope SF, Webster J, Trieu K, et al (2017). A systematic review of economic evaluations of population-based sodium reduction interventions. PLoS One, 12 (3):e0173600.
12. Ibrahim NH, Maruan K, Khairy HAM, et al (2017). Economic evaluations on antimicrobial stewardship programme: a systematic review. J Pharm Pharm Sci, 20:397-406.
13. Iribarren SJ, Cato K, Falzon L, et al (2017). What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS One, 12 (2):e0170581.
14. Melendez-Torres G, Auguste P, Armoiry X, et al (2017). Clinical effectiveness and cost-effectiveness of beta-interferon and glatiramer acetate for treating multiple sclerosis: systematic review and economic evaluation. Health Technol Assess, 21 (52):I-352.
15. Velentzis LS, Salagame U, Canfell K (2017). Menopausal hormone therapy: a systematic review of cost-effectiveness evaluations. BMC Health Serv Res, 17 (1):326.
16. Wong CK, Liao Q, Guo VY, et al (2017). Cost-effectiveness analysis of vaccinations and decision makings on vaccination programmes in Hong Kong: A systematic review. Vaccine, 35 (24):3153-3161.
17. Dritsaki M, Rivero-Arias O, Gray A, et al (2018). What do we know about managing Dupuytren’s disease cost-effectively? BMC Musculoskelet Disord, 19:34.
18. Grochtdreis T, König H-H, Dobruschkin A, et al (2018). Cost-effectiveness analyses and cost analyses in castration-resistant prostate cancer: a systematic review. PLoS One, 13 (12):e0208063.
19. Jiang X, Ming W-K, You JH (2019). The cost-effectiveness of digital health interventions on the management of cardiovascular diseases: systematic review. J Med Internet Res, 21 (6):e13166.
20. Ling X-X, Jin J-J, Zhu G-D, et al (2019). Cost-effectiveness analysis of malaria rapid diagnostic tests: a systematic review. Infect Dis Poverty, 8 (1):104.
21. Mendivil J, Appierto M, Aceituno S, et al (2019). Economic evaluations of screening strategies for the early detection of colorectal cancer in the average-risk population: A systematic literature review. PLoS One, 14 (12):e0227251.
22. Sultana M, Sarker AR, Ali N, et al (2019). Economic evaluation of community acquired pneumonia management strategies: A systematic review of literature. PLoS One, 14 (10):e0224170.
23. Anopa Y, Macpherson L, McIntosh E (2020). Systematic review of economic evaluations of primary caries prevention in 2-to 5-year-old preschool children. Value Health, 23 (8):1109-1118.
24. De La Perrelle L, Radisic G, Cations M, et al (2020). Costs and economic evaluations of quality improvement collaboratives in healthcare: a systematic review. BMC Health Serv Res, 20:155.
25. Hao X, Lou H, Bai J, et al (2020). Cost-effectiveness analysis of Xpert in detecting Mycobacterium tuberculosis: A systematic review. Int J Infect Dis, 95:98-105.
26. Niyomsri S, Duarte RV, Eldabe S, et al (2020). A systematic review of economic evaluations reporting the cost-effectiveness of spinal cord stimulation. Value Health, 23 (5):656-665.
27. Ten Ham RM, Klungel OH, Leufkens HG, Frederix GW (2020). A review of methodological considerations for economic evaluations of gene therapies and their application in literature. Value Health, 23 (9):1268-1280.
28. Woods T-J, Tesfay F, Speck P, Kaambwa B (2020). Economic evaluations considering costs and outcomes of diabetic foot ulcer infections: a systematic review. PLoS One, 15 (4):e0232395.
29. Qiu T, Men P, Sun T, Zhai S (2021). Cost-effectiveness of aprepitant in preventing chemotherapy-induced nausea and vomiting: a systematic review of published articles. Front Public Health, 9:660514.
30. Rezapour A, Souresrafil A, Peighambari MM, et al (2021). Economic evaluation of programs against COVID-19: A systematic review. Int J Surg, 85:10-18.
31. Schwander B, Nuijten M, Evers S, Hiligsmann M (2021). Replication of published health economic obesity models: assessment of facilitators, hurdles and reproduction success. Pharmacoeconomics, 39:433-446.
32. Stawowczyk E, Kawalec P (2018). A systematic review of the cost-effectiveness of biologics for ulcerative colitis. Pharmacoeconomics, 36:419-434.
33. Sanyal C, Husereau DR (2019). Community-based services by pharmacists: a systematic review of cost-utility analyses. Value Health, 22 (12):1450-1457.
34. Avanceña AL, Prosser LA (2021). Examining equity effects of health interventions in cost-effectiveness analysis: a systematic review. Value Health, 24 (1):136-143.
35. El Alili M, van Dongen JM, Huirne JA, et al (2017). Reporting and analysis of trial-based cost-effectiveness evaluations in obstetrics and gynaecology. Pharmacoeconomics, 35:1007-1033.
36. Ding H, Xin W, Tong Y, et al (2020). Cost effectiveness of immune checkpoint inhibitors for treatment of non-small cell lung cancer: a systematic review. PLoS One, 15 (9):e0238536.
37. Werner K, Risko N, Burkholder T, et al (2020). Cost–effectiveness of emergency care interventions in low and middle-income countries: a systematic review. Bull World Health Organ, 98 (5):341-352.
38. Galekop MM, Uyl-de Groot CA, Redekop WK (2021). A systematic review of cost-effectiveness studies of interventions with a personalized nutrition component in adults. Value Health, 24 (3):325-335.
39. Husereau D, Drummond M, Augustovski F, et al (2022). Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. Value Health, 25(1):3-9.
40. Miroshnychenko A, Uhlman K, Malone J, et al (2021). Systematic review of reporting quality of economic evaluations in plastic surgery based on the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. J Plast Reconstr Aesthet Surg, 74 (10):2458-2466.
| Files | ||
| Issue | Vol 53 No 10 (2024) | |
| Section | Review Article(s) | |
| DOI | https://doi.org/10.18502/ijph.v53i10.16699 | |
| Keywords | ||
| Health economics Cost-effectiveness Quality assessment | ||
| Rights and permissions | |
|
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
How to Cite
1.
Dastari F, Tajvar M, Mohammadi A, Karami B. Evaluation of Reporting Quality of Systematic Reviews on Health Economic Evaluation Studies Based on the CHEERS Statement: An Overview of Reviews. Iran J Public Health. 2024;53(10):2214-2225.
