Author: Yang Yuqi

"The number of SCI papers is not enough. I'm afraid it will be difficult to graduate."

"SCI papers have been cited too few times, and this year's title is not rated again."

...

Don't panic, the Ministry of Education and the Ministry of Science and Technology have issued documents recently, clearly asking to dismiss the paper "SCI Supreme"!

Data map: Students are studying by Zheng Tao

This document is entitled "Several Opinions on Regulating the Use of Related Indexes of SCI Papers in Colleges and Universities to Establish Correct Evaluation Guides" (hereinafter referred to as "Opinions"), which is jointly issued by the Ministry of Education and the Ministry of Science and Technology. Limitations, and gave relevant guidance on building a correct scientific research evaluation system.

What is a SCI paper?

In the past, to evaluate the pros and cons of the quality of a paper, it was impossible to avoid discussing the evaluation index of SCI. So what exactly is SCI? The Ministry of Education gave the answer in response to a reporter's question:

SCI is an index of scientific citations created in the United States. It is a classification database, just like a book classification card in a library. It uses statistical research fields, directions, and frequency of citations to check the latest literature for science and technology workers, track international academic frontiers, Help with scientific research.

"But the relevant indicators of SCI papers are directly used for scientific research evaluation, which has strong limitations." The person in charge explained that the essence of SCI is a document indexing system, not an evaluation system. He made it clear: "You cannot simply equate SCI papers with high-level papers."

The reason why SCI papers cannot be equated with high-level papers, that is, the number of citations in SCI papers reflects the attention of the papers, and cannot correspond to the level of innovation and substantial contributions. Highly cited papers reflect more academic research hotspots. , But does not directly explain its innovation contribution.

At the same time, the person in charge pointed out that the paper is mainly an expression of basic research results, but the relevant indicators of SCI papers do not fully reflect the contribution of scientific and technological innovation, and are not applicable to the evaluation of technological innovation and achievement transformation.

Data map: In the library of Shandong Normal University, students study seriously. Photo by Sun Hongyi

What are the harmful effects of excessive pursuit of SCI papers?

I have to admit that in the past, related indicators such as the number of SCI papers, number of citations, highly cited papers, impact factors, and derived ESI rankings have become academic evaluations, as well as title evaluations, performance evaluations, talent evaluations, and subject evaluations. , Resource allocation, school rankings and other core indicators.

The above indicators are like a wind vane, which makes the scientific research work of colleges and universities appear excessive pursuit of SCI papers and related indicators, and even the alienation phenomenon with the number of published SCI papers, high impact factor papers, and highly cited papers as the fundamental goals.

"It is necessary to accurately understand SCI papers and related indicators, and to deeply understand the negative impact brought by the paper" SCI Supreme. "

The above "Opinions" pointed out that the current scientific research evaluations have related phenomena such as one-sided, excessive, and distorted use of SCI papers. It is necessary to standardize the use of SCI paper-related indicators in various evaluations, encourage comprehensive evaluation methods combining qualitative and quantitative research Establish a scientific evaluation system, guide the evaluation work to highlight the scientific spirit, innovation quality, and service contributions, and promote the return of colleges and universities to their original academic intentions.

It can be seen that breaking the dissertation "SCI First" and optimizing academic ecology are "arrows on the string and have to be sent."

Data Map: Nearly 100 college students studying in the self-study room.

How to break the paper "SCI Supreme"?

After recognizing the irrationality of the supremacy of the "SCI" ​​thesis, what measures should colleges and universities take to circumvent this reality? The above "Opinions" also give guiding improvement measures:

-Improve subject and school assessments

In the evaluation, it is necessary to highlight the quality and contribution of innovation, and carefully select quantitative indicators. Specifically, it means reducing ranking evaluations of disciplines and schools, and insisting on classification and evaluation by areas. In the evaluation, it is necessary to highlight the quality and contribution of innovation, limit the use of quantitative indicators such as the number of SCI papers, and guide social institutions to carry out scientific evaluation of universities.

——Optimize the evaluation methods of professional titles (positions)

In the evaluation of job titles (positions), it is necessary to establish a classification evaluation index system. The focus of the investigation is suitable personnel and posts. The relevant indicators of SCI papers are not used as the direct basis for the evaluation of job titles (positions), and as a prerequisite for personnel employment. .

——Reverse the utilitarian tendency of assessment and reward

Schools should not set requirements for thesis indicators for departments and individuals, cancel the rewards for individuals and departments directly based on the relevant indicators of SCI theses, and remove the direct link between the relevant indicators of SCI theses and resource allocation and performance rewards.

——Scientific setting of quality standards for degree awards

Guide schools to reasonably set quality standards for degree awards in light of subject characteristics, and it is not appropriate to use indicators such as the number of published SCI papers and impact factors as restrictive conditions for student graduation and degree awards.

——Establish the correct policy orientation

Universities and their competent departments must shoulder the responsibility of leading the construction of academic culture, have self-confidence and determination, and refrain from adopting credibility in public opinion and disseminating information such as rankings compiled with SCI paper-related indicators as the core.

Regarding the specific implementation of the above requirements, the Ministry of Education also clearly stated that "the inspection and rectification of various units will be inspected through supervision and other methods. Units that have not been carefully scrutinized, refused to rectify, and have serious problems will have to interview and report criticism And other ways, and hold leaders accountable. "

Data map: graduation photo of a university student. Photo courtesy

"SCI" ​​is no longer pinned

How to evaluate the academic level?

When a paper no longer focuses on the number of citations and the number of SCI publications, how can we scientifically select a high-quality scientific paper?

In this regard, the relevant person in charge of the Ministry of Education introduced: First of all, we must establish a sound classification and evaluation system. Different types of scientific research work have different output forms. To evaluate the "one-size-fits-all" problem, we must not only look at the thesis, but not at the same time.

Secondly, academic peer evaluation should be improved. Realize the role of peer experts, guide experts in the review not simply replace professional judgment with relevant indicators of SCI papers, provide professional review opinions responsibly, and advocate the establishment of a review expert evaluation reputation system.

Finally, it is necessary to standardize the evaluation review work. Vigorously reduce the "three evaluations" such as project evaluation, talent evaluation, and organization evaluation; fully listen to the evaluation indicators and methods, especially the opinions of science and technology management departments and scientific research personnel; the evaluation method should implement representative evaluation, and streamline and optimize the application materials. It is also required to fill in relevant indexes of SCI papers; the evaluation process should follow the principle of peer evaluation, reasonably group the objects to be evaluated, select appropriate experts, and set the workload reasonably.

Data Figure: A research group of Chongqing University's School of Bioengineering is conducting experiments. Photo by Zhong Xin

Breaking the paper "SCI First", indicating that the paper is not important?

What needs to be clear is that no longer putting too much emphasis on the weight of SCI in evaluating the quality of the paper does not mean that the publication of the paper can be ignored.

"It is the dissertation that SCI is supreme. It does not negate SCI, nor is it against publication." The relevant person in charge of the Ministry of Education explained in response to a reporter's question that the introduction of the document is to reverse the one-sidedness of the relevant SCI papers in the current scientific research evaluation , Excessive, distorted use, etc., will never negate the publication of academic papers.

He emphasized that the thesis is a manifestation of scientific and technological innovation achievements and an important carrier of academic exchanges. We encourage the publication of high-level, high-quality academic papers that have innovative value and reflect the contribution of services, and send a Chinese voice in the international academic community.

"But in academic evaluation, we cannot simply use the relevant indicators of SCI papers to judge the level of innovation; in various evaluation activities, we must use relevant indicators reasonably, adopt a comprehensive evaluation method combining qualitative and quantitative, and guide the evaluation work to highlight the scientific spirit, Innovation quality and service contribution. "