Tez özetleri Astronomi ve Uzay Bilimleri Anabilim Dalı

Development of a Web Based Intelligent Examination System According To

Measurement and Evaluation Criteria in Education
The aim of this study is to prepare a module and to test the effectiveness of the module which categorizes the questions with respect to the cognitive levels, determines the difficulty levels by calculating the related data of item difficulty and item discrimination, automatically tunes the difficulty levels of the questions with reference to the answers given in the process of the exam, and provides person-specific exams both in the classroom and digital environment. The Web-Based Intelligent Examination System developed within the scope of this study makes it possible to prepare questions compatible with the assessment and evaluation criteria in education enabling the measurement of the level of actual learning of the students. By utilizing the prepared questions it would be possible to generate exam forms. The Web-Based Intelligent Examination records the data belonging to the students and the data as a result of the student-system interaction, and can determine the operation order of the system and the questions to be used to evaluate the knowledge level of the student in the light of the information obtained from the records. In addition, this system can improve itself according to the changing needs and student characteristics in due course and adapt itself to the current situation. To achieve its goals, Principles and Methods of Teaching course was selected and exam questions were prepared in line with objectives and achievements of the course. The exam questions were applied to 205 university students all of whom attend the course which was determined as the pilot study. Afterwards, item analyses were finalized and the actual application was completed. In addition, two exam forms, one as Moodle online examination system and the other as a traditional sample without using any specific system were prepared and expert opinions were asked. A questionnaire form including 17 items was prepared by the researcher was improved to determine if these 3 exam forms at present were effective means to prepare appropriate questions with regard to the criteria of Testing and Assessment in education and construct an exam form. The questions were developed by taking the exam preparation criteria in testing and assessment in education and qualities which testing tool was required to have into consideration. Instructors were asked to express their opinions by scoring ranging from 1 to 6 regarding the quality constituents an exam form is to have as an assessment tool in education. Quantitative analysis of the research was completed by utilizing the packet program “SPSS 21 for MacOS X” and items were examined via dependent sample variant analysis.
The results indicated that there was a significant difference between the referee evaluation scores in favor of the exam form, which was prepared by using the Intelligent Exam System in which Expert Agent and individuals interact, comparing the other exam forms according to the qualities that a testing tool is required to include.