{"id":1345,"date":"2017-03-12T22:28:31","date_gmt":"2017-03-12T21:28:31","guid":{"rendered":"https:\/\/cpp.web.amu.edu.pl\/?p=1345"},"modified":"2018-05-05T09:45:51","modified_gmt":"2018-05-05T07:45:51","slug":"dr-emanuel-kulczyckis-research-in-scientometrics","status":"publish","type":"post","link":"https:\/\/cpp.amu.edu.pl\/pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/","title":{"rendered":"Dr. Emanuel Kulczycki’s research in „Scientometrics”: building a ranking of national journals in Poland"},"content":{"rendered":"

Emanuel Kulczycki and Ewa A. Rozkosz published a paper in\u00a0Scientometrics<\/em>: „Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland” (

Abstract<\/h2>\n

This article discusses the Polish Journal Ranking, which is used in the research evaluation system in Poland. In 2015, the ranking, which represents all disciplines, allocated 17,437 journals into three lists: A, B, and C. The B list constitutes a ranking of Polish journals that are indexed neither in the Web of Science nor the European Reference Index for the Humanities. This ranking was built by evaluating journals in three dimensions: formal, bibliometric, and expert-based. We have analysed data on 2035 Polish journals from the B list. Our study aims to determine how an expert-based evaluation influenced the results of final evaluation. In our study, we used structural equation modelling, which is regression based, and we designed three pairs of theoretical models for three fields of science: (1) humanities, (2) social sciences, and (3) engineering, natural sciences, and medical sciences. Each pair consisted of the full model and the reduced model (i.e., the model without the expert-based evaluation). Our analysis revealed that the multidimensional evaluation of local journals should not rely only on the bibliometric indicators, which are based on the Web of Science or Scopus. Moreover, we have shown that the expert-based evaluation plays a major role in all fields of science. We conclude with recommendations that the formal evaluation should be reduced to verifiable parameters and that the expert-based evaluation should be based on common guidelines for the experts.<\/p>\n

\u00a0<\/p>","protected":false},"excerpt":{"rendered":"

Emanuel Kulczycki and Ewa A. Rozkosz published a paper in\u00a0Scientometrics: „Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland” (April 2017, Volume 111, Issue 1,\u00a0pp 417\u2013442). The article is available\u00a0here. Abstract This article discusses the Polish Journal Ranking, which is used in […]<\/p>\n","protected":false},"author":2,"featured_media":1812,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_links_to":"","_links_to_target":""},"categories":[39],"tags":[],"yoast_head":"\nDr. Emanuel Kulczycki's research in "Scientometrics": building a ranking of national journals in Poland<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\" \/>\n<meta property=\"og:locale\" content=\"pl_PL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Dr. Emanuel Kulczycki's research in "Scientometrics": building a ranking of national journals in Poland\" \/>\n<meta property=\"og:description\" content=\"Emanuel Kulczycki and Ewa A. Rozkosz published a paper in\u00a0Scientometrics: „Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland” (April 2017, Volume 111, Issue 1,\u00a0pp 417\u2013442). The article is available\u00a0here. Abstract This article discusses the Polish Journal Ranking, which is used in […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\" \/>\n<meta property=\"og:site_name\" content=\"Center for Public Policy Studies\" \/>\n<meta property=\"article:published_time\" content=\"2017-03-12T21:28:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-05-05T07:45:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cpp.amu.edu.pl\/wp-content\/uploads\/2018\/01\/s1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"153\" \/>\n\t<meta property=\"og:image:height\" content=\"234\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Marek Kwiek\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Napisane przez\" \/>\n\t<meta name=\"twitter:data1\" content=\"Marek Kwiek\" \/>\n\t<meta name=\"twitter:label2\" content=\"Szacowany czas czytania\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minuty\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\"},\"author\":{\"name\":\"Marek Kwiek\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/#\/schema\/person\/f8d5958e6a754d53c450a534b8cff8ee\"},\"headline\":\"Dr. Emanuel Kulczycki’s research in „Scientometrics”: building a ranking of national journals in Poland\",\"datePublished\":\"2017-03-12T21:28:31+00:00\",\"dateModified\":\"2018-05-05T07:45:51+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\"},\"wordCount\":556,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/#organization\"},\"articleSection\":[\"Paper\"],\"inLanguage\":\"pl-PL\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\",\"url\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\",\"name\":\"Dr. Emanuel Kulczycki's research in \\\"Scientometrics\\\": building a ranking of national journals in Poland\",\"isPartOf\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/#website\"},\"datePublished\":\"2017-03-12T21:28:31+00:00\",\"dateModified\":\"2018-05-05T07:45:51+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#breadcrumb\"},\"inLanguage\":\"pl-PL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Strona g\u0142\u00f3wna\",\"item\":\"https:\/\/cpp.amu.edu.pl\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Dr. Emanuel Kulczycki’s research in “Scientometrics”: building a ranking of national journals in Poland\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/#website\",\"url\":\"https:\/\/cpp.amu.edu.pl\/\",\"name\":\"Center for Public Policy Studies\",\"description\":\"Adam Mickiewicz University, Pozna\u0144, Poland\",\"publisher\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/cpp.amu.edu.pl\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"pl-PL\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/#organization\",\"name\":\"Center for Public Policy Studies\",\"url\":\"https:\/\/cpp.amu.edu.pl\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pl-PL\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/cpp.web.amu.edu.pl\/wp-content\/uploads\/2016\/10\/CPPS.png\",\"contentUrl\":\"https:\/\/cpp.web.amu.edu.pl\/wp-content\/uploads\/2016\/10\/CPPS.png\",\"width\":362,\"height\":96,\"caption\":\"Center for Public Policy Studies\"},\"image\":{\"@id\":\"https:\/\/cpp.amu.edu.pl\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/#\/schema\/person\/f8d5958e6a754d53c450a534b8cff8ee\",\"name\":\"Marek Kwiek\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pl-PL\",\"@id\":\"https:\/\/cpp.amu.edu.pl\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/635c11ae6f64ead562a2861be84cafd1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/635c11ae6f64ead562a2861be84cafd1?s=96&d=mm&r=g\",\"caption\":\"Marek Kwiek\"},\"url\":\"https:\/\/cpp.amu.edu.pl\/pl\/author\/mkwiek\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Dr. Emanuel Kulczycki's research in \"Scientometrics\": building a ranking of national journals in Poland","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/","og_locale":"pl_PL","og_type":"article","og_title":"Dr. Emanuel Kulczycki's research in \"Scientometrics\": building a ranking of national journals in Poland","og_description":"Emanuel Kulczycki and Ewa A. Rozkosz published a paper in\u00a0Scientometrics: „Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland” (April 2017, Volume 111, Issue 1,\u00a0pp 417\u2013442). The article is available\u00a0here. Abstract This article discusses the Polish Journal Ranking, which is used in […]","og_url":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/","og_site_name":"Center for Public Policy Studies","article_published_time":"2017-03-12T21:28:31+00:00","article_modified_time":"2018-05-05T07:45:51+00:00","og_image":[{"width":153,"height":234,"url":"https:\/\/cpp.amu.edu.pl\/wp-content\/uploads\/2018\/01\/s1.jpg","type":"image\/jpeg"}],"author":"Marek Kwiek","twitter_card":"summary_large_image","twitter_misc":{"Napisane przez":"Marek Kwiek","Szacowany czas czytania":"3 minuty"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#article","isPartOf":{"@id":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/"},"author":{"name":"Marek Kwiek","@id":"https:\/\/cpp.amu.edu.pl\/#\/schema\/person\/f8d5958e6a754d53c450a534b8cff8ee"},"headline":"Dr. Emanuel Kulczycki’s research in „Scientometrics”: building a ranking of national journals in Poland","datePublished":"2017-03-12T21:28:31+00:00","dateModified":"2018-05-05T07:45:51+00:00","mainEntityOfPage":{"@id":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/"},"wordCount":556,"commentCount":0,"publisher":{"@id":"https:\/\/cpp.amu.edu.pl\/#organization"},"articleSection":["Paper"],"inLanguage":"pl-PL","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/","url":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/","name":"Dr. Emanuel Kulczycki's research in \"Scientometrics\": building a ranking of national journals in Poland","isPartOf":{"@id":"https:\/\/cpp.amu.edu.pl\/#website"},"datePublished":"2017-03-12T21:28:31+00:00","dateModified":"2018-05-05T07:45:51+00:00","breadcrumb":{"@id":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#breadcrumb"},"inLanguage":"pl-PL","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/cpp.amu.edu.pl\/dr-emanuel-kulczyckis-research-in-scientometrics\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Strona g\u0142\u00f3wna","item":"https:\/\/cpp.amu.edu.pl\/"},{"@type":"ListItem","position":2,"name":"Dr. Emanuel Kulczycki’s research in “Scientometrics”: building a ranking of national journals in Poland"}]},{"@type":"WebSite","@id":"https:\/\/cpp.amu.edu.pl\/#website","url":"https:\/\/cpp.amu.edu.pl\/","name":"Center for Public Policy Studies","description":"Adam Mickiewicz University, Pozna\u0144, Poland","publisher":{"@id":"https:\/\/cpp.amu.edu.pl\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cpp.amu.edu.pl\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"pl-PL"},{"@type":"Organization","@id":"https:\/\/cpp.amu.edu.pl\/#organization","name":"Center for Public Policy Studies","url":"https:\/\/cpp.amu.edu.pl\/","logo":{"@type":"ImageObject","inLanguage":"pl-PL","@id":"https:\/\/cpp.amu.edu.pl\/#\/schema\/logo\/image\/","url":"https:\/\/cpp.web.amu.edu.pl\/wp-content\/uploads\/2016\/10\/CPPS.png","contentUrl":"https:\/\/cpp.web.amu.edu.pl\/wp-content\/uploads\/2016\/10\/CPPS.png","width":362,"height":96,"caption":"Center for Public Policy Studies"},"image":{"@id":"https:\/\/cpp.amu.edu.pl\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/cpp.amu.edu.pl\/#\/schema\/person\/f8d5958e6a754d53c450a534b8cff8ee","name":"Marek Kwiek","image":{"@type":"ImageObject","inLanguage":"pl-PL","@id":"https:\/\/cpp.amu.edu.pl\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/635c11ae6f64ead562a2861be84cafd1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/635c11ae6f64ead562a2861be84cafd1?s=96&d=mm&r=g","caption":"Marek Kwiek"},"url":"https:\/\/cpp.amu.edu.pl\/pl\/author\/mkwiek\/"}]}},"_links":{"self":[{"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/posts\/1345"}],"collection":[{"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/comments?post=1345"}],"version-history":[{"count":0,"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/posts\/1345\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/media\/1812"}],"wp:attachment":[{"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/media?parent=1345"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/categories?post=1345"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cpp.amu.edu.pl\/pl\/wp-json\/wp\/v2\/tags?post=1345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}