Sociological research

SOUTH KAZAKHSTAN STATE PEDAGOGICAL UNIVERSITY

ON MONITORING AND ANALYTICAL ACTIVITIES

  1. Application

  1. This regulation defines the procedure for assessing the satisfaction of consumers of educational services. 
  2. This regulation is the constituent document of the South Kazakhstan state pedagogical University.
  3. This provision is included in the documentation of the quality management system (SKSPU).
  4. This regulation defines the structure of the documentation of the quality management system SKSPU.
  5. This provision does not apply to other institutions without the permission of the rector.

2. Regulatory references

This Regulation is applicable to references of the following normative documents:

ISO 9001-2015 the quality management system. Requirements.

QMS SKSPU  PR 4.02-2018 the quality management system. Procedure. Management of organizational documentation.

QMS SKSPU PR 8.02-2018 the quality management system. Procedure. Corrective and preventive actions.

3.Terms and definitions

In these Rules terms and definitions according to SM ISO 9000:2015, SM ISO 9001:2015 are used.

Question-answer (questionnaire) - a method of obtaining information by means of questions developed in accordance with certain rules of the system of questions.

Sample - a group of persons for whom the study is conducted.

A consumer is an organization or person who uses products/services.

Monitoring-improvement of the decision-making process, as well as systematic collection and processing of information that can be used indirectly as a means of public notification or feedback.

4 Designations and abbreviations

The following abbreviations apply in this Regulation:

IS-international standard; 

RQM-representative of the quality management;

MaMD - Department of management and monitoring;

QS-quality service;

PR-procedure;

QMS-quality management system.

Faculty-teaching staff. 

5. Process description

5.1 General provisions

5.1.1  assessment of customer satisfaction (the algorithm of the process is given in Annex A)

5.1.2 internal consumers are faculty, University staff and students.

External consumers include parents and guardians, the state, enterprises, organizations, individuals.

5.1.3 carry out monitoring customer satisfaction:

  • identification of the process, product or service whose satisfaction is assessed;
  • definition of the category of consumers;
  • determination of relevant indicators of the product, process;
  • preparation of a questionnaire based on these indicators;
  • selection of the research method (for example, a survey in the form of a survey), approval of the survey form, identification of the persons conducting the survey, etc.;
  • the need to choose the method of data processing.

  Customer satisfaction information will determine which direction of activity and how the information will be applied.

  5.1.4 question-the answer (fearing) - way to obtain information with the help system issues, drafted in accordance with certain rules.

 5.1.5 types of questions and answers (questionnaire):

    by number of respondents

  • individual survey (one Respondent);
  • group survey (multiple respondents);

on the completeness of the mass survey coverage (from 100 to 1000 respondents);

  • General (solid);
  • sampling (polling from a sample array)

by type of communication with the Respondent

  • direct survey (with the participation of the researcher-interview);
  • оп indirect survey (correspondence-telephone, Internet).

5.1.6 requirements for the preparation of the questionnaire

Questionnaires have a strict structure and consist of several parts.

The first part is an introduction. It relates directly to the Respondent. It briefly describes the purpose and objectives of the study, emphasizes its essence, how the results are used. Here are the rules for filling out the questionnaire, the confidentiality of answers is guaranteed.

The second part is the main one. It contains questions aimed at obtaining the necessary information. As the questionnaire allows to solve several problems, each of them should correspond to the block of questions. It is recommended to ask questions aimed at awakening interest, simple, "accurate", respondents should be adapted to the active filling of the questionnaire. It can be questions on specific circumstances, quotes. Then the most difficult questions are given to determine motivation, opinion, evaluation.

The third part defines the socio-demographic characteristics of the survey respondents: gender, marital status, education, social origin, profession, place of study or work.

In conclusion, respodent thanks for filling out the questionnaire (in some cases this is done in the introductory part).

5.1.7 Types of survey conducted in SKSPU

Title

Survey

time

Responsible for the implementation

  1. First year student questionnaire

1 time per academic year

Management and monitoring Department (MaMD)

  1. Satisfaction of students with the quality of the educational process at the University

1 time per academic year

MaMD

  1. Professors through the eyes of students (first, second semester)

2 times per academic year

MaMD

  1. Students ' attitude to corruption

1 time per academic year

MaMD

  1. Questionnaire of the 4th year student

1 time per academic year

MaMD

  1. Questionnaire based on the results of specialized (industrial, pedagogical) practice of students

1 time per academic year

MaMD

  1. Determination of professional level of graduates of educational institution among external consumers of educational services

1 time per academic year

MaMD

  1. Assessment of students' learning results in elective disciplines

1 time per academic year

MaMD

 

5.2 Requirements for conducting a questionnaire (questionnaire):

  • clear definition of research objectives;
  • availability of formulations according to the concept of the Respondent;
  • compliance with the principles of social and psychological communication during the survey;
  • take into account the characteristics and competence of respondents;
  • accuracy of respondents ' answers;
  • standardization of survey conditions;
  • collection, presentation of reliable data in the whole University.

5.3 Objectives of the survey:

  • determination of features of subjective estimation of professionalism of teachers by students on the set parameters;
  • defining the requirements of students and employers for educational services;
  • quality control of the educational process;
  • identification of strengths and weaknesses of the external and internal environment of the University;
  • determination of satisfaction with the quality of education, educational services, life and material and technical equipment of the University.

5.4 Methods of information collection

Methods of information collection-a specially designed list of questions, as a means of collecting information from the Respondent - a psychological verbal and communicative method using a questionnaire.

Methods of information collection consist of  5  interrelated stages:

  1. preparation of questionnaire questions;
  2. includes the collection of initial information, unreported data obtained in the course of the study, which should be processed in the future;
  3. preparation of the collected information for processing and its processing;
  4. output of quantitative indicators of processed information;
  5. preparation of a research report containing conclusions and recommendations.

5.5 Organizational requirements for the stage of the survey (questionnaire)

5.5.1 preparing for the survey

1.Preparation and questioning of the responsible employee (supervisor).

2. Responsibilities of the responsible employee:

5.1. prior to the direct conduct of the survey (questionnaire):

  • development of survey methodology and terms of reference for questionnaire text processing;
  • determination of the study sample required to obtain objective and reliable information;
  • survey sampling;
  • notification of the survey of all respondents;
  • distribution of organizational and administrative documentation (order, instructions for conducting a survey) in electronic (paper) form.

   5.2. Date of the survey:

a) verification of the readiness of the venue. If computers are used: availability of computer rooms and specially installed programs;

b) ensuring installation by the specialist of information technologies of the program of survey of computers;

 c) control over the survey of domestic consumers.

 5.5.2 arrangements for the survey

  1. prior to the survey, the responsible specialist should briefly explain to the participants the objectives and goals of the study and indicate the importance of the survey.
  2. it is necessary to pay special attention of respondents to the confidentiality of the questionnaire and the fact that after filling out the questionnaire, the information in it is processed and will be used only in the completed form.
  3. it is necessary to specify that each participant of the questionnaire should fill in the questionnaire independently, without consultations with someone on the content of the answer. In addition, the objectivity and accuracy of the participants ' answers to the questionnaire questions will depend on the correctness of the conclusion on the results of the questionnaire and the effectiveness of the proposals developed on their basis.
  4. the specialist responsible for the organization of the survey should pay special attention to each case that refuses to answer the questionnaire, re-explain the purpose of the survey, show the public importance of the study, emphasize its confidentiality.
  5. work with the questionnaire without a responsible specialist is not allowed.

If the survey is conducted in a computer form, the responsible specialist should briefly explain the procedure for working with the questionnaire.

5.5.3 Information Processing and formulation of survey results

Processing of the received information is carried out with the use of computer equipment in accordance with the main stages in the Department of management and monitoring.

Phase one. Creating a logical data processing scheme:

  • determine the type of document required to collect information;
  • creating a method for encoding it;
  • description of data control and error correction rules;
  • determination of the order and methods of data processing;
  • the definition of the calculation algorithms;
  • formation of quantitative indicators of data obtained in the process of processing;

Second. Mathematical and software for processing research materials providing static reliability.

 Third phase. Preparation for data processing of primary information:

  • grouping of questionnaire questions by features;
  • systematization and coding of questions according to grouping;
  • verification of the completeness of filling out the questionnaire;
  • verification of the information provided;
  • check for ease of processing, i.e. bringing the information in the response processing program in an easily reproducible form;
  • the formation of an array of documents.

Fourth phase. Information processing (calculation of the average value, the definition of correlation, preparation of groups, charts, and graphs.)

According to the results of the survey, after processing and obtaining statistical information, the relevant information is analyzed in order to identify:

  • the level of satisfaction of customers and interested parties;
  • compliance of products and services with the requirements;
  • information on preventive measures on the characteristics of processes, products and services, including areas and opportunities;
  • information about suppliers.

MaMD analyzes the information received in order to identify the strengths and weaknesses of the University in providing educational services.

Data analysis consists of:

  • data collection (questionnaires);
  • analysis using statistical methods (charts, histograms, seedlings and correlation analysis charts);
  • comparison of achieved results with planned results;
  • report preparation, Discussion and decision - making to the appropriate extent;
  • dissemination of information at all levels of management and structural units of the University.

          Data analysis is carried out at meetings of the Academic Council, the rector's office, the coordinating Council for quality, faculties.

Information is sent to the University website.

Recommendations on the results of the survey are sent to the relevant structural units of the University for the purpose of corrective and preventive measures.

Structural units that have received comments and suggestions, carry out corrective and preventive measures.

  5.6 storage, destruction of questionnaires (on paper).

 5.6.1 questionnaires are preliminary considered, checked on terms of reception, are registered on groups, pass primary processing. Questionnaires (on paper) are stored in MaMD with the indication of term of storage within 1 year. Upon expiration, they are destroyed.

  5.6.2 the Electronic version is stored on the computer in a special folder "questionnaire", where all records concerning the questionnaire (for example, records about organizational work, reports, presentations, etc.) in the form of Excel, Microsoft Word are stored.

The head of the Management and monitoring Department is responsible for storage, destruction and distribution.

The work schedule of carrying out of sociological surveys

The questionnaire of the learning process

Form of surveys

The period of the survey

  1.  

Professors through the eyes of students (1,2,3,4 courses)

Electronic questionnaire

I period  - October-December 2019у.

II period - February-March 2020y.

  1.  

Student satisfaction with the quality of the educational process at the University (1,2,3,4 courses) 2019у.

Electronic questionnaire

13.11.2019-31.12.2019у.

  1.  

Questionnaire "Attitude of students to corruption" (1,2,3,4 courses)

Electronic questionnaire

13.11.2019-31.12.2019у.

  1.  

Questionnaire on the results of pedagogical practice (for 2nd year students)

Electronic questionnaire

13.11.2019-31.03.2020у.

  1.  

Questionnaire for students on the results of pedagogical (professional) practice (only for students of 3,4 courses)

Electronic questionnaire

13.11.2019-31.03.2020у.

  1.  

The questionnaire of the graduate on an assessment of results of training to Educational programs (only 4 courses)

Electronic questionnaire

13.11.2019-29.02.2020у.

  1.  

Questionnaire of the employer on assessment of professional level of students- probationers

Handout questionnaire

March 2020у.

  1.  

Application form tenants definition of satisfaction with the level of training of graduates SKSPU

Handout questionnaire

October-December 2019у.

Report

according to the results of sociological research 2018-2019 academic year

          In the educational process of the University, the satisfaction of external consumers and students with the quality of education at the University was assessed. Planned sociological surveys were carried out on the following topics:

  1. Professors through the eyes of students (I half-year)/ computer program Univer;
  2. Professors through the eyes of students (II half-year) (computer questionnaire system);
  3. Satisfaction of University students with the quality of education in the University/ computer program Univer;
  4. Students' attitude to corruption/ computer program Univer;
  5. Questionnaire based on the results of specialized (industrial, pedagogical) practice of students (2-3, 4 courses);
  6. Determination of professional level of University graduates among external consumers of educational services;
  7. Assessment of students ' learning outcomes in elective disciplines;
  8. The level of satisfaction of University professors with the organization of labor.

On behalf of the rector, an unscheduled survey "Evaluation of the heads of departments"was carried out.

Brief results of surveys, conclusion and conclusions are as follows:

          During the 2018-2019 school year were twice conducted the survey "a Teacher by eyes of students", the results of which the total number of respondents 1602 (for the I half-year), accounting for 75% of the total number of students, while the number of respondents for the spring semester - 1565 (1, 2, 3 courses (the second half). The survey was conducted electronically through the "UNIVER" system. The questionnaire determines the answers on a 5-point scale. The results of students ' assessment of teachers are generally satisfactory.

Table 1. The rating of faculties UKGU (the results of the survey «Professors  by eyes of students» 2018-2019 a.y.)

Faculties

1

2

3

4

5

6

7

8

9

10

11

12

13

The overall average score

faculty of natural Sciences

4,74

4,64

4,67

4,67

4,58

4,62

4,58

4,63

4,69

4,63

4,60

4,58

4,66

4,69

Philologies

4,63

4,62

4,72

4,70

4,59

4,59

4,64

4,69

4,63

4,64

4,66

4,66

4,63

4,68

faculty of Professional and Creative

4,93

4,84

4,94

4,96

4,94

4,91

4,93

4,93

4,96

4,93

4,94

4,93

4,95

4,92

Humanitarian аnd Pedagogical

4,76

4,71

4,73

4,72

4,73

4,70

4,75

4,76

4,76

4,72

4,72

4,73

4,71

4,77

Physics-mathematics

4,64

4,62

4,64

4,64

4,63

4,60

4,62

4,62

4,63

4,62

4,62

4,62

4,62

4,69

Physical culture and sports

4,72

4,69

4,69

4,64

4,73

4,62

4,75

4,71

4,72

4,71

4,74

4,67

4,69

4,72

For SKSPU

4,74

4,69

4,73

4,72

4,70

4,67

4,71

4,72

4,73

4,71

4,71

4,70

4,71

4,75

Diagram 1. Ranking of the highest professional indicators by faculties of the University

General information obtained by the results of 1-2 half-year during the academic year at the University, show satisfactory dynamics of evaluation of the quality of educational services of teaching staff: pedagogical skills, the level of complexity of training courses. The overall average score is 4,75-students assess the level of knowledge and skills in the specialty in the classroom teaching staff of universities.

Table 2. Rating of indicators of professional assessment by chairs of the university

Chairs of the university

The overall average score

1

Methods of primary education

4,95

2

Musical education

4,95

3

Vocational training and Arts

4,89

4

English language

4,84

5

Physical culture and  basic military training

4,82

6

Biology

4,81

7

Pedagogy

4,81

8

Russian language and literature

4,80

 

Diagram 2. The rating of the indicators of professionalism in departments SKSPU

          According to the sociological survey "Satisfaction of University students with the quality of the educational process in the University" (computer program Univer), 1419 respondents were interviewed.  According to the results of the survey-84,1% are "completely satisfied" with the training conditions, 15,9% - rated as "mostly satisfied". In General, 85,6% of respondents are satisfied with the work of deans of faculties of the University.

Diagram 3. The estimation of different parties of the educational process students SKSPU

According to the results of the survey "students' Attitude to corruption " 2018-2019 academic year (computer program Univer), 710 respondents were interviewed. 100.0% of respondents noted the absence of corruption in the University.

Diagram 4. Results of the survey «Attitude of students to corruption» 2018-2019 a. y.

According to the results of educational and familiarization practice, 571 students of the University took part in the sociological survey. Familiarization practice for 82.3% of 2nd year students of universities - the possibility of passive perception of the educational process in school. 16.6% of respondents noted the possibility of choosing a future form of employment. More than half of the respondents (60.6%) did not face difficulties in passing the practice. However, 39.4% noted their presence (faculties of natural Sciences, Humanities, Philology, Physics and mathematics). Despite the fact that the practice is mostly passive, 46.7% of respondents note the difficulty in interacting with students (Faculties of natural Sciences, Humanities and Pedagogy, Philology, Physics and mathematics), 40.9%-with teachers and parents (Faculties of natural Sciences, Humanities and Pedagogy).

Diagram 5. Results of the survey of 2nd year students on the results of pedagogical practice 2018-2019 a.y.

In order to improve the quality of practical training and professional skills of students according to the questionnaire of the assessment analysis conducted by students of the University, 621 respondents were interviewed from among the students of 3.4 courses. (83,2% of the total number of students) 74,9% of SKSPU students rated the practice as "excellent", 22% answered "good", 2,9% - "satisfactory". 42,3% note the need to increase additional classes in practical teaching of subjects, 37.2% prefer to conduct pedagogical and psychological training, 20,2% - note the importance of increasing the hours of practice.

Diagram 6. Definition of the results of pedagogical practice by 4th year students of the University

More than 63% of respondents rate the work of subject teachers who provided timely practical advice on "excellent". 36,9% rated subject teachers as "good", as methodological assistance was not as extensive as would be desirable for students-trainees (faculties of natural Sciences, Philology, Physics and Mathematics).

In determining the" professional level of graduates among external consumers of educational services was attended by 188 experts in 33 specialties of the University. 64,7% of employers rate the work of students-trainees of universities as "excellent".  35,3% of employers rate the work of trainees as "good". According to the results of the assessment of employers, innovative technologies and educational and methodical practice are used at a high level.

Diagram 7. Assessment by employers of the results of practical training by students of  3,4 courses of universities

372 students of 4 courses of the University took part in the survey «Assessment of students' learning outcomes in elective disciplines».

The main problems of dissatisfaction of students with the teaching of elective disciplines:

  1. poor quality provision of knowledge in many disciplines of the specialty
  2. some disciplines in the catalogue of elective disciplines are not needed at all
  3. some teachers poorly conducted discipline specialty .

      320 respondents took part in the survey «Satisfaction of University professors with the labor organization». Above 4,7 points on a 5-point scale, the University's faculty assess various aspects of labor organization. The overall average satisfaction score of University professor is 4,76.

Diagram 8. Satisfaction of staff with the main aspects of labor organization in the University

The main results of sociological surveys conducted at the University in 2018-2019a.y.:

  1. According to the students of the University - 54 teachers were assessed by respondents as having high professional pedagogical qualities. 8 departments of universities according to the results of the rating scored the highest number of points from 4,80 to 4,95 points.
  2. 100% of respondents noted the absence of corruption in the University.
  3. 84,1% of respondents are fully satisfied with the quality of the educational process at the University.
  4. 60,6% of 2nd year students note a high level of adaptation to the conditions of practice. 80,9% of respondents positively assess the work of methodologists of universities at practice facilities.
  5. 90,9% of respondents 3,4 courses on the results of specialized (industrial, pedagogical) practice assess the quality of professional and pedagogical practice on the "good" and "excellent".
  6. 64,7% of employers rate the work of students-trainees of universities as "excellent". 35,3% of employers rate the work of trainees as "good".
  7. The overall average satisfaction score of the University staff working conditions-4,76 - on a 5-point scale.