ASIA
30 April 2015
Citations are not enough
Citations are not enough: Academic promotion panels must take into account a scholar’s presence in popular media, argue Asit Biswas and Julian Kirchherr.
Scholars all around the world are almost solely judged upon their publications in (prestigious) peer-reviewed journals. Asit Biswas and Julian Kirchherr argue that publications in the popular media must count as well. After all, these publications are crucial in informing practitioners’ decision-making.
Many of the world’s most talented thinkers may be university professors, but sadly most of them do not shape today’s public debates or influence policies. Indeed, scholars often frown upon publishing in the popular media. “Running an opinion editorial to share my views with the public? Sounds like activism to me”, a professor recently noted at a conference, hosted by the University of Oxford. The absence of professors from shaping public debates and policies seems to have exacerbated in recent years, particularly in the social sciences. During 1930s and 1940s, 20 percent of articles in the prestigious The American Political Science Review focused on policy recommendations. At the last count, the share was down to a meagre 0.3 percent.
Even debates among scholars do not seem to function properly. Up to 1.5 million peer-reviewed articles are published annually. However, many are ignored even within the scientific community: 82 percent of articles published in humanities are not even cited once. Rarely do scholars refer to 32 percent of the peer-reviewed articles in the social and 27 percent in the natural sciences. If a paper is cited, though, this does not imply it has actually been read. According to one estimate, only 20 percent of papers cited have actually been read. We suspect that an average paper in a peer-reviewed journal is read completely at most by no more than 10 people. Hence, impacts of most peer-reviewed publications even within the scientific community are miniscule.
Many scholars aspire to contribute to their discipline’s knowledge and to influence practitioner’s decision-making. However, it is widely acknowledged practitioners rarely read articles published in peer-reviewed journals. We know of no senior policy-maker, or senior business leader who ever reads any peer-reviewed papers, even in recognized journals like Nature, Science or The Lancet.
No wonder: First of all, most journals are prohibitively expensive to access for anyone outside of academia. Even if the current open-access-movement becomes more successful, the incomprehensible jargon and the sheer volume and lengths of papers (mostly unnecessary!) would still prevent practitioners (including journalists) from reading them.
Brevity is central. Many government leaders now maintain a standing instruction to prepare a two-page summary every morning of what the popular media writes about their policies. In India, this practice was started by Indira Ghandi. Ministers in Canada insist on similar round-ups. Governments in the Middle East even summarize discussions on new social media these days. No decision-maker would ever ask for summaries regarding publications and discussions in academic journals. If academics want to have impact on policy makers and practitioners, they must consider popular media, which has never been easy for scholars. This in spite of the fact that media firms have developed many innovative business models to help scholars reach out.
One of the most promising models: Project Syndicate (PS), a non-profit-organization which distributes commentary by the world’s thought leaders to more than 500 newspapers comprising 300 million readers in 154 countries. Any commentary accepted by PS is automatically translated into 12 other languages and then distributed globally to the entire network. However, even if scholars agree regarding the importance of publishing in the popular press, the system plays against them. In order to obtain tenure, scholars must churn out as many peer-reviewed articles as possible, publications in (prestigious) peer-reviewed journals are the key performance indicator within academia: whether anyone reads them or not becomes a secondary consideration.
It may be time to reassess scholars’ performance. For tenure and promotion considerations, scholars’ impacts on policy formulation and public debates should also be assessed.
These publications often showcase the practical relevance and potential application of the research results to solve real world problems. Admittedly, impact is not guaranteed. Particularly most policy-makers already have a reasonably exact idea regarding the policy they would prefer. The policy must, first and foremost, satisfy their plethora of stakeholders. Very few decision-makers look only for the most optimal economic, social, environmental, technical, or political solution. Those who look for scientific evidence, though, would vastly benefit from more scholarly publications in the popular press. Slowly, this is recognized within academia. For instance, the National University of Singapore (NUS) now encourages faculty to list op-eds on their profiles. However, significant more emphasis is still given to publications in so-called high impact journals.
Change is happening very, very slowly.
Julian Kirchherr is a doctoral researcher at the School of Geography and the Environment, University of Oxford. Prior to joining the University of Oxford, Kirchherr was as a management consultant at McKinsey & Company advising governments in Europe, Asia and the Middle East. He also served as a City Councilor in Werl, Germany, as well as a County Councilor in Soest, Germany. Copyright 2011 LSE Impact of Social Sciences
Many of the world’s most talented thinkers may be university professors, but sadly most of them do not shape today’s public debates or influence policies. Indeed, scholars often frown upon publishing in the popular media. “Running an opinion editorial to share my views with the public? Sounds like activism to me”, a professor recently noted at a conference, hosted by the University of Oxford. The absence of professors from shaping public debates and policies seems to have exacerbated in recent years, particularly in the social sciences. During 1930s and 1940s, 20 percent of articles in the prestigious The American Political Science Review focused on policy recommendations. At the last count, the share was down to a meagre 0.3 percent.
Even debates among scholars do not seem to function properly. Up to 1.5 million peer-reviewed articles are published annually. However, many are ignored even within the scientific community: 82 percent of articles published in humanities are not even cited once. Rarely do scholars refer to 32 percent of the peer-reviewed articles in the social and 27 percent in the natural sciences. If a paper is cited, though, this does not imply it has actually been read. According to one estimate, only 20 percent of papers cited have actually been read. We suspect that an average paper in a peer-reviewed journal is read completely at most by no more than 10 people. Hence, impacts of most peer-reviewed publications even within the scientific community are miniscule.
Many scholars aspire to contribute to their discipline’s knowledge and to influence practitioner’s decision-making. However, it is widely acknowledged practitioners rarely read articles published in peer-reviewed journals. We know of no senior policy-maker, or senior business leader who ever reads any peer-reviewed papers, even in recognized journals like Nature, Science or The Lancet.
No wonder: First of all, most journals are prohibitively expensive to access for anyone outside of academia. Even if the current open-access-movement becomes more successful, the incomprehensible jargon and the sheer volume and lengths of papers (mostly unnecessary!) would still prevent practitioners (including journalists) from reading them.
Brevity is central. Many government leaders now maintain a standing instruction to prepare a two-page summary every morning of what the popular media writes about their policies. In India, this practice was started by Indira Ghandi. Ministers in Canada insist on similar round-ups. Governments in the Middle East even summarize discussions on new social media these days. No decision-maker would ever ask for summaries regarding publications and discussions in academic journals. If academics want to have impact on policy makers and practitioners, they must consider popular media, which has never been easy for scholars. This in spite of the fact that media firms have developed many innovative business models to help scholars reach out.
One of the most promising models: Project Syndicate (PS), a non-profit-organization which distributes commentary by the world’s thought leaders to more than 500 newspapers comprising 300 million readers in 154 countries. Any commentary accepted by PS is automatically translated into 12 other languages and then distributed globally to the entire network. However, even if scholars agree regarding the importance of publishing in the popular press, the system plays against them. In order to obtain tenure, scholars must churn out as many peer-reviewed articles as possible, publications in (prestigious) peer-reviewed journals are the key performance indicator within academia: whether anyone reads them or not becomes a secondary consideration.
It may be time to reassess scholars’ performance. For tenure and promotion considerations, scholars’ impacts on policy formulation and public debates should also be assessed.
These publications often showcase the practical relevance and potential application of the research results to solve real world problems. Admittedly, impact is not guaranteed. Particularly most policy-makers already have a reasonably exact idea regarding the policy they would prefer. The policy must, first and foremost, satisfy their plethora of stakeholders. Very few decision-makers look only for the most optimal economic, social, environmental, technical, or political solution. Those who look for scientific evidence, though, would vastly benefit from more scholarly publications in the popular press. Slowly, this is recognized within academia. For instance, the National University of Singapore (NUS) now encourages faculty to list op-eds on their profiles. However, significant more emphasis is still given to publications in so-called high impact journals.
Change is happening very, very slowly.
Note:
This article was originally published on the LSE Impact Blog. It gives the views of the authors, and not the position of the Impact of Social Science blog, nor of the London School of Economics. Please review our Comments Policy if you have any concerns on posting a comment below.About the Authors
Asit Biswas is one of the world’s leading authorities on environmental and water policy. He is the founder and president of the Third World Centre for Water Management in Mexico, and Distinguished Visiting Professor at the Lee Kuan Yew School for Public Policy at the National University of Singapore, the University of Wuhan, China as well as the Indian Institute of Technology. Biswas has been a senior advisor to more than 20 governments, six Heads of United Agencies as well as the Secretary Generals of OECD and NATO.Julian Kirchherr is a doctoral researcher at the School of Geography and the Environment, University of Oxford. Prior to joining the University of Oxford, Kirchherr was as a management consultant at McKinsey & Company advising governments in Europe, Asia and the Middle East. He also served as a City Councilor in Werl, Germany, as well as a County Councilor in Soest, Germany. Copyright 2011 LSE Impact of Social Sciences