Welcome to site of Scientific Works of NDFI (demo).
Login | Register
THE ACADEMY
OF FINANCIAL
MANAGEMENT
.

№ 4/2019

№ 4/2019

Nauk. pr. NDFI 2019 (4): 5–19
https://doi.org/10.33763/npndfi2019.04.005

FINANCES OF EDUCATION AND SCIENCE

PAVLIUK Klavdiia 1

1SESE “The Academy of Financial Management”
OrcID ID : https://orcid.org/0000-0002-9495-6630


Problems of evaluation of scientific activity


In the modern world, the assessment of the quality of scientific research is an important component of state financing, management, and the development of state policy in the field of scientific activity. To manage growing volumes with the changing dynamics of the scientific sector, agencies and policy-sponsors of science use different assessments in accordance with their specific needs. The synthesis of financing systems based on research findings in Europe reflects the use of valuation as part of results-based management. To manage growing volumes with changing dynamics of the scientific sector in foreign countries, various estimates are used in accordance with specific needs. The issues of the quantitative and qualitative assessment of the scientific activity of institutions and scientists are also important for Ukraine since the evaluation of scientific activity is only the beginning, and the processes of European integration require the active application of foreign experience in this area. The features of the evaluation of scientific activity, the complexity of which lies in its very nature, are disclosed. The strategic goals of the system of assessment of scientific activity, the main tasks in achieving these goals are considered. Quantitative and qualitative methods of assessment in the system of science are disclosed. Well-known international as well as national scientometric databases are considered, their characteristics are presented. The trend of a combination of scientometric and expert methods for assessing scientific activity is traced. The issues of using the assessment to create additional incentives for scientific institutions and scientists, including government support programs to increase publication activity, are described in detail, accompanied by the intensification of monitoring aimed at evaluating the effectiveness of these programs, stimulating the publication activity of scientists. A range of proposals is developed to improve approaches to the assessment of scientific institutions and scientists in Ukraine.

Keywords:science management, financing, assessment methods, scientometric bases, assessment quality, incentives


PAVLIUK K. . Problems of evaluation of scientific activity / K. . PAVLIUK // Наукові праці НДФІ. - 2019. - № 4. - C. 5-19.

Article original in Ukrainian (pp. 5 - 19) DownloadDownloads :293
1. Archambault, É., Gagné, É. V. (2004, August). The Use of Bibliometrics in the Social Sciences and Humanities. Retrieved from www.science-metrix.com/pdf/SM_2004_008_SSHRC_Bibliometrics_Social_Science.pdf.
2. Harzing, A.-W. (2017, March). Bibliometrics in the Arts, Humanities, and Social Sciences. Retrieved from harzing.com/blog/2017/03/bibliometrics-in-the-arts-humanities-and-social-sciences.
3. Glaser, J., Oltersdorf, J. (2019, August). Persistent Problems for a Bibliometrics of Social Sciences and Humanities and How to Overcome Them. 17th International Conference On Scientometrics & Informetrics. Retrieved from www.researchgate.net/publication/335490767_Persistent_Problems_for_a_Bibliometrics_of_Social_Sciences_and_Humanities_and_How_to_Overcome_Them.
4. Bornmann, L. (2019). Bibliometrics-based decision trees (BBDTs) based on bibliometrics-based heuristics (BBHs): Visualized guidelines for the use of bibliometrics in research evaluation. doi.org/10.1162/qss_a_00012
5. Daniel, H.‐D. (2005, April). Publications as a measure of scientific advancement and of scientists' productivity. doi.org/10.1162/qss_a_00012
6. Horovyi, V. M. (2015). Quality criteria for research in the context of national interest. Bulletin of the National Academy of Sciences of Ukraine, 6, 74–80. Retrieved from www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?I21DBN=LINK&P21DBN=UJRN&Z21ID=&S21REF=10&S21CNR=20&S21STN=1&S21FMT=ASP_meta&C21COM=S&2_S21P03=FILA=&2_S21STR=vnanu_2015_6_13 [in Ukrainian].
7. Egorov, I. Yu. (2004). Evaluation of the activities of scientific organizations in the UK public sector. Problems of science, 2, 49–56 [in Russian].
8. Kukharchuk, Ye. O. (2014). World scientometric systems. Library Bulletin, 5, 7–11. URL: www.irbis-nbuv.gov.ua/everlib/item/er-0000001610 [in Ukrainian].
9. Mryhlod, O. I., Kenna, R., Holovach, Yu. V., & Berche, B. (2013). On the problem of science evaluation. Bulletin of the National Academy of Sciences of Ukraine, 10, 76–85. Retrieved from www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?I21DBN=LINK&P21DBN=UJRN&Z21ID=&S21REF=10&S21CNR=20&S21STN=1&S21FMT=ASP_meta&C21COM=S&2_S21P03=FILA=&2_S21STR=vnanu_2013_10_11 [in Ukrainian].
10. Medvedieva, A. (2016). Analysis of the system of evaluation of activity of scientific institutions in Ukraine. Scientific works of the National Library of Ukraine named after V. I. Vernadskyi, 43, 270–284. doi.org/10.15407/np.43.270
11. Karpenko, A. V., Budytska, Yu. O. (2017). Theoretical and methodological basics of evaluating scientific practice effectiveness in Ukraine. The Collection of Scientific Works of Kirovohrad National Technical University. Economic Sciences, 31, 51–57. Retrieved from dspace.kntu.kr.ua/jspui/bitstream/123456789/6883/1/6.pdf [in Ukrainian].
12. Kotliarevskyi, Ya. V., Radchenko, A. I., Melnykov, O. V., & Semeniuk, E. P. (2018). Strategic priorities in measuring the publication and publishing works in scholarly research activity. Science and innovation, Vol. 14, No. 5, 5–18. doi.org/10.15407/scine14.05.005
13. Yehorov, I. Yu. (2016). System of integrated indicators for the assessment of scientific-technical and innovation activities in the context of European integration. Science and innovation, Vol. 12, No. 4, 19–21. doi.org/10.15407/scin12.04.019
14. Verkhovna Rada of Ukraine. (2015). About scientific and scientific-technical activity (Act No. 848-VIII, November 26). Retrieved from zakon.rada.gov.ua/laws/show/848-19 [in Ukrainian].
15. Ministry of Education and Science, Youth and Sports of Ukraine. (2012). The procedure for evaluating the development of scientific institution (Order No. 399, April 3). Retrieved from zakon.rada.gov.ua/laws/show/z0629-12#n168 [in Ukrainian].
16. Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015, April 22). Bibliometrics: The Leiden Manifesto for research metrics. doi.org/10.1038/520429a
17. Petrushyna, T. O. (2017). The state of science in Ukraine (based on the assessments of Ukrainian and foreign experts). Bulletin of the National Academy of Sciences of Ukraine, 11, 66–80. doi.org/10.15407/visn2017.11.066
18. Yurevich, M. A. (2014). Methodical problems of researcher productivity assessment. Retrieved from cyberleninka.ru/article/n/metodicheskie-problemy-otsenki-rezultativnosti-issledovatelya [in Russian].
19. Die Vermessung der Wissenschaft: Messung und Beurteilung von Qualität in der Forschung. (2014). ZFHR zeitschrift für hochschulrecht, hochschulmanagement und hochschulpolitik, Juli. URL: elibrary.verlagoesterreich.at/article/99.105005/zfhr201406017301.
20. Horovyi, V. (2015). Quality criteria for research in the context of national interest. Retrieved from nbuviap.gov.ua/index.php?option=com_content&view=article&id=1048:kriteriji-yakosti-naukovikh-doslidzhen-u-konteksti-zabezpechennya-natsionalnogo-interesu-2&catid=105&Itemid=410 [in Ukrainian].
21. Medvedieva, A. (2016). Foreign experience in evaluating the effectiveness of scientific activity. Bulletin of the Book Chamber, 6, 49–51. Retrieved from www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?I21DBN=LINK&P21DBN=UJRN&Z21ID=&S21REF=10&S21CNR=20&S21STN=1&S21FMT=ASP_meta&C21COM=S&2_S21P03=FILA=&2_S21STR=vkp_2016_6_16 [in Ukrainian].
22. Empfehlungen zur Bewertung und Steuerung von Forschungsleistung. (2011, November). www.wissenschaftsrat.de. URL: www.wissenschaftsrat.de/download/archiv/1656-11.pdf.
23. Tcyganov, S. A., Rudtckaia, E. R., & Khrustalev, E. Iu. (2012). Improving competitive mechanisms for supporting and financing scientific, technical and innovative activities. Retrieved from cyberleninka.ru/article/n/sovershenstvovanie-konkursnyh-mehanizmov-podderzhki-i-finansirovaniya-nauchnoy-nauchno-tehnicheskoy-i-innovatsionnoy-deyatelnosti [in Russian].
24. Froghi, S., Ahmed, K., Finch, A. et al. (2012). Indicators for research performance evaluation: an overview. doi.org/10.1111/j.1464-410X.2011.10856.x
25. h-index. (n. d.). Wikipedia. Retrieved from uk.wikipedia.org/wiki/H-%D1%96%D0%BD%D0%B4%D0%B5%D0%BA%D1%81 [in Ukrainian].
26. G-index. (n. d.). Wikipedia. Retrieved from uk.wikipedia.org/wiki/G-index [in Ukrainian].
27. What is Age-Weighted Citation Rate (AWCR). (n. d.). www.igi-global.com. Retrieved from www.igi-global.com/dictionary/private-label-management/55275.
28. The impact factor. (n. d.). Wikipedia. Retrieved from uk.wikipedia.org/wiki/[in Ukrainian].
29. Shtovba, S. D., Shtovba, E. V. (2013). A survey on scientometric indicators for assessment of researcher’s publication activity. Retrieved from ubs.mtas.ru/archive/search_results_new.php?publication_id=19062 [in Russian].
30. Scientific Library of Ukrainian Engineering Pedagogics Academy. (n. d.). Google Scholar and ORCID Scholar Profiles. Retrieved from library.uipa.edu.ua/poslygy/naukovtsiam-fakhivtsiam/naukovtsiam/avtorski-profili-vchenykh-v-google-scholar-ta-orcid.html [in Ukrainian].
31. Kopanieva, Ye. (2012). National indexes of scientific citation. Library Bulletin, 4, 29–35. Retrieved from nbuv.gov.ua/j-pdf/bv_2012_4_4.pdf [in Ukrainian].
32. Quan, W., Chen, B., & Shu, F. (2017). Publish or impoverish: An investigation of the monetary reward system of science in China (1999–2016). Retrieved from arxiv.org/ftp/arxiv/papers/1707/1707.01162.pdf.
33. Didenko, Yu. V., Radchenko, A. I. (2017). Publication activity as a way of scientific communication and ratings race. Bulletin of the National Academy of Sciences of Ukraine, 9, 82–98. doi.org/10.15407/visn2017.09.082
34. Shapoval, Yu. I. (2017, November). Scientific publication as a criterion for the evaluation of scientific activity: the experience of Poland. Retrieved from www.researchgate.net/publication/325967849_Naukova_publikacia_ak_kriterij_ocinki_naukovoi_dialnosti_dosvid_Polsi [in Ukrainian].
35. Sanchez, T. W. (2015). Citation analysis of urban planning scholars in the U.S. doi.org/10.22227/2305-5502.2015.1.3