Original Article

Development of Evaluation System for Iranian Health Research Networks: Challenges and Lessons Learned

Abstract

Background: Health research networks (HRNs) are critical components of large-scale systems of production and validation of scientific evidence. As evaluation of research systems is a reliable process to measure efficiency and effectiveness of their activities, we aimed to report the processes of development of evaluation indicators’ for Iranian health research networks and the results of conducted assessment.

Methods: In 2017, for the first time, aim to develop the evaluation framework for national HRNs, following the qualitative approach to assess the quality of research we designed the peer review method as one of the most important tools. This qualitative method was conducted according to experts’ views in specific fields. Key policy makers and stakeholders collaboratively developed a number of criteria for evaluation of research performance of Iranian HRNs. Following the review of conducted studies, benefitting from published guide line, these indicators were defined under 4 main axes of governance and leadership; infrastructures; research products and research impact.

Results: Based on requirements of developed protocol for evaluation of HRNs in Iran, 18 HRNs completed the processes of evaluation. Results show a progressive need for more attention to precise planning of HRNs for achieving to goals. Another point to consider is the attention to documenting processes. The observational system for researches for detection of latest research priority was the most important issues that need to be more addressed by all of networks.

Conclusion: Research evaluation of Iranian HRNs more over creating of constructive positive competition provide an overview of the shortcomings and research challenges could be used for better planning and promotion of the health research system.

1. Oliver K, Lorenc T, Innvær S (2014). New directions in evidence-based policy research: a critical analysis of the literature. Health Res Policy Syst, 12:34.
2. Djalalinia S, Kelishadi R, Qorbani M, et al (2014). Suggestions for better data presentation in papers: an experience from a comprehensive study on national and sub-national trends of overweight and obesity. Arch Iran Med, 17(12):830-6.
3. Kochan T, Bezrukova K, Ely R, et al (2003). The effects of diversity on business performance: Report of the diversity research network. Human Resource Management, 42(1):3-21.
4. Peykari N, Owlia P, Malekafzali H et al (2013). Needs assessment in health research projects: A new approach to project management in Iran. Iran J Public Health, 42(2):158-63.
5. Robinson TE, Rankin N, Janssen A et al (2015). Collaborative research networks in health: a pragmatic scoping study for the development of an imaging network. Health Res Policy Syst,13:76.
6. Rostamigooran N, Esmailzadeh H, Rajabi F et al (2013). Health system vision of Iran in 2025. Iran J Public Health, 42(Supple1):18-22.
7. Keshtkar A, Djalalinia S, Khashayar P et al (2013). Iranian Health Research Networks and Vision of Iran by 2025: A Case of Virtual Health Network in EMRI. Iran J Public Health, 42(Supple1):78-83.
8. Djalalinia S, Talei M, Barhemmat F, et al (2017). Development of Health Research Structures Over the Last 25 Years: Main Achievements and Challenges. Arch Iran Med, 20(11):659-64.
9. Ebadifar A, Baradaran EM, Owlia P, et al (2017). How to Assess Quality of Research in Iran, From Input to Impact? Introduction of Peer-Based Research Evaluation Model in Iran. Arch Iran Med, 20(11): 680-85.
10. Danaei G, Farzadfar F, Kelishadi R, et al (2019). Iran in transition. Lancet, 393(10184):1984-2005.
11. Baradaran EM, Sobhani Z, Eltemasi M, et al (2017). Research Ranking of Iranian Universities of Medical Sciences Based on International Indicators: An Experience From IR of Iran. Arch Iran Med, 20(11): 673-79.
12. Li G, Wu Q, Jin Y, Vanniyasingam T, Thabane L (2018). Key factors of clinical research network capacity building. J Venom Anim Toxins Incl Trop Dis, 24:15.
13. Bian J, Xie M, Topaloglu U et al (2014). Social Network Analysis of Biomedical Research Collaboration Networks in a CTSA Institution. J Biomed Inform , 52:130-40.
14. Djalalinia S, Peykari N, Eftekhari MB, et al (2017). Contribution of health researches in national knowledge production: A scientometrics study on 15-year research products of Iran. Int J Prev Med, 8:27.
15. Watson L (2008). Developing indicators for a new ERA: should we measure the policy impact of education research? Aust J Educ, 52(2):117-28.
16. Green J, Thorogood N (2018). Qualitative methods for health research. 4th ed. Sage Publications Inc, London, pp:249-313.
17. Gyles C (2014). Can we trust peer-reviewed science? Can Vet J, 55(2):109-111.
18. Peykari N, Djalalinia S, Owlia P, et al (2012). Health research system evaluation in IR of Iran. Arch Iran Med, 15(7):394-9.
19. Falahat K, Eftekhari M, Habibi E, et al (2013). Trend of knowledge production of research centers in the field of medical sciences in Iran. Iran J Public Health, 42(Supple1):55-9.
20. Djalalinia S, Owlia P, Forouzan AS, et al (2012). Health research evaluation and its role on knowledge production. Iran J Public Health, 41(2):39-46.
21. Gan X, Fernandez IC, Guo J et al (2017). When to use what: Methods for weighting and aggregating sustainability indicators. Ecol Indic, 81:491-502.
22. Lee BL, Worthington AC (2016). A network DEA quantity and quality- orientated production model: An application to Australian university research services. Omega, 60:26-33.
23. Moore GF, Audrey S, Barker M, et al (2015). Process evaluation of complex interventions: Medical Research Council guidance. BMJ, 350:h1258.
24. Hutschemaekers G, Tiemens B (2006). Evidence-Based Policy. In: Duyvendak, J. W. et. al. (Ed.): Policy, People and the New Professional De-professionalisation and Re-professioanisation in Care and Welfare Amsterdam S. 34-47.
25. Hayes H, Parchman ML, Howard R (2011). A logic model framework for evaluation and planning in a primary care practice-based research network (PBRN). J Am Board Fam Med, 24(5):576-82.
26. Brunson JC, Fassino S, McInnes A, et al (2013). Evolutionary events in a mathematical sciences research collaboration network. Scientometrics, 99:973-98.
27. Liang C, Yu FR (2015). Wireless network virtualization: A survey, some research issues and challenges. IEEE Commun Surv Tutor,17(1):358-80.
28. Qualls LG, Phillips TA, Hammill BG, et al (2018). Evaluating Foundational Data Quality in the National Patient-Centered Clinical Research Network (PCORnet(R)). EGEMS (Wash DC), 6(1):3.
29. Mijumbi R, Serrat J, Gorricho J-L et al (2016). Network function virtualization: State-of-the-art and research challenges. IEEE Commun Surv Tutor,18(1):236-62.
Files
IssueVol 49 No 1 (2020) QRcode
SectionOriginal Article(s)
DOI https://doi.org/10.18502/ijph.v49i1.3057
Keywords
Research network Health Evaluation Iran
Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
1.
DJALALINIA S, TALEI MB, NAJJARI A, BAGHERI M R, AKHONDZADEH S, MALEKZADEH R, EBADIFAR A. Development of Evaluation System for Iranian Health Research Networks: Challenges and Lessons Learned. Iran J Public Health. 2020;49(1):104-113.