| Summary: | 碩士 === 臺南師範學院 === 國民教育研究所 === 87 === The research is to develop a multimedia on-line adaptive testing system by combining with the theory of test and item response, the techniques of network, multimedia and database management, etc.
In the meanwhile, we can explore how the tested students'' feedback in the process of testing and afterwards their attitudes influenced by the means of PC.
We prospect in the future, not only the surroundings of the test can be taken effect in multidimensional but also the establishment and practice of the test can be promoted the function of the auxiliary and verifiable teaching. There are three focuses on the research: first of all, to develop a multimedia on-line adaptive testing system; second, to evaluate the performance of on-line adaptive testing; finally, to discuss the influence of the attribution of computer towards tested students after applying a way of feedback from system in the process of testing.
The research adopts an experiment of nonequivalent-control group designed, the sample schools for the research as Chung Hsiue and Ta Kung Elementary schools in Tainan City and the initial sample for the research as 307 students in total, including 162 boys and 145 girls.
The materials used in the research include computer attitudes scale and multimedia on-line adaptive testing system.
The data is proceeded by the analysis of two-way covariance; the independent variable as experimentation( feedback, non-feedback) and sex; the dependent variable as second tested score of computer attribute and the covariance variable as first tested score of computer attribute. The major result summarized as the followings:
1. The considerable factor of developing multimedia on-line adaptive
testing system:
In the aspect of the hardware, it is essential to consider the capacity of random access memory as huge and speed as fast; the capacity of hard-disk as huge and speed as fast. About the aspect of the software, it must be compatible with the web server and the operation system.
In the feature of test and item-bank, the model of item response theory is based on the feature of item-bank to apply for the approriate one.
The random selection of topics can reduce the high exposure rate of the item so as to prevent from losing its efficiency but it does not promise to provide the best initial item and does not fit with the spirit of the adaptive test.
Therefore, the selective way of the initial item should be well-considered from the field of the content and the control of the item exposure value.
The method of ability estimation, according to the present survey, if adopted Bayes selected method at the first stage and Maximum likelihood estimator as the last stage, it can acquire of the value of estimation of ability in much shorter test.
Among the selected methods, such as the above-mentioned selected methods are upon seeking those purposes not practiced yet and providing the testers the highest standard and abundant informative tests. Generally, there are two applied ways to end the test standard: one as the number of item, the other as the posterior distribution of standard deviation.
To consider the system design, we have to take a consideration whether the testing system and the database system design are comparable.
The web server is based upon the function of its arrangement and management and the support of the database design as a keypoint.
The operation system is based up stability and easy management as a consideration; the connection of the database and web server considered for the opening database connection interface.
The system design for the user must be friendly because the flowchart and screen design must be to planed so as to reduce the testers'' anxiety.
2.to evaluate the performance of the multimedia on-line adaptive testing system:
The performance of the multimedia on-line adaptive testing is not bad, and it tolerates forty students testing in the meantime, the coefficient of correlation of ability estimation score and tested student nature achievements is 0.625 and it is significant. In other words, if the system score of ability estimation is high, the tested students'' nature achievement will be better.
3.the influence of computer attribution in many way of feedback:
There was significant difference existed on computer attitudes for sex. Boys'' computer attitudes are better than girls'' computer attitudes.
There was no significant difference existed on computer attitudes for the way of feedback.
The researches propose further suggestions for teaching, administrator and further research, and let us understand the related research of the on-line adaptive testing system. Also, the researches may help us reach the target of long distance testing and measurement.
|
|---|
