In order to ensure "rigorous standardization, openness and transparency", the subject evaluation is conducted in accordance with the following procedures, and the following procedures are clearly stated in advance to participating units.
1. Data collection Data collection includes two parts: "public data collection" and "unit material submission".
The degree center obtains public data through official data sources such as the Ministry of Education, the Ministry of Science and Technology, the National Natural Science Foundation of China, relevant teaching committees, societies, etc.; it obtains data on participating disciplines through the application of participating units.
2. Data verification The authenticity of assessment data is an important guarantee for the reliability of assessment results.
Data verification mainly includes four aspects: first, screening the data reported by units according to data collection standards; second, developing a special system to verify data repeatedly filled in by multiple units and multiple disciplines; third, using the public system built by the degree center.
*** Information database, develop a special system to check the reported data; fourth, conduct random checks on published academic papers and other data.
This work is one of the most important aspects of subject evaluation, with nearly 10,000 pages of verification feedback materials.
3. Information Disclosure: On the premise of ensuring national information security, some of the information reported by the units will be disclosed online within the participating units, objections from all parties will be accepted, and the objections will be confirmed according to the evaluation standards.
4. Expert questionnaire survey discipline evaluation draws on domestic and foreign experience, adopts the evaluation model of "combination of objective evaluation and subjective evaluation", and invites experts to conduct subjective evaluations on the reputation of the discipline, academic ethics, social contribution and the quality of students after graduation.
Subjective evaluation is carried out through a "questionnaire survey", and generally 50-100 people from each discipline participate in the survey.
In addition to inviting experts in this subject, this evaluation also invited nearly 500 industry and business figures from more than 30 ministries and commissions, including the Ministry of Education, the Ministry of Science and Technology, the Ministry of Culture, and the National Natural Science Foundation of China, as well as large enterprises.
5. Result statistics and release Subject evaluation results are generated according to the principle of "accurate calculation and clustering statistics".
This round of evaluation first accurately calculates the original scores according to the indicator system, and then changes the previous practice of "rounding" to produce parallel rankings, and uses the "clustering statistics" algorithm to cluster those with similar original scores into one category, making the classification more accurate.
There are more scientific and similar units in the same category, which dilutes the ranking and guides units to pay more attention to the advantages and shortcomings of discipline construction.
Taking into account the special circumstances of scientific research institutes, the evaluation data of universities and scientific research institutes are calculated uniformly and arranged separately when published.