GOR 2001 Homepage

Contributions

Abstracts
Articles

article-info

Indices
first-author-index
complete-author-index

Management - Staff only
Infos

GOR 2001 - content

This is the http://kiwi.uni-psych.gwdg.de/congress/gor-2001/contrib/contrib/silberer-guenter/contrib/osipova-elena/osipova-elena Document.

Main Author: Osipova, Elena M.

Co-Authors: ;

Institution: Interdisciplinary Center for Advanced Professional Education, Saint-Petersburg State University

Contribution Title: Individualization of distance education through adaption. Adaptive assessment

Authors Email: elena@icape.nw.ru

URLs:
http://www.icape.nw.ru


Abstract German (version: 25/06/2002 - 07:47, size: 0)
English: The main advantage of distance education is the possibility to provide individual approach to learners. Individualization may be realized through individual work with instructor or through adaptation of educational materials, computer programs and learning technology systems in general. We can adapt courseware in time (to evolving technologies), interfaces, content, educational process. It is possible to adapt various educational components to individual psychological, physiological and physical characteristics of learners, as well as to individual needs of learners, appearance of new knowledge and information, etc. All of the distance education system components are interconnected and most of them may be adapted: curriculum, course schedule, learning modules/units, tests, examples, etc.
Adaptive assessment may be used for the following purposes: for distance learners to provide self-control, for educators to assess distantly the knowledge acquired by learners, and also to manage educational process. To manage means here 1) to determine the basic level of learner‘s knowledge and assist in composing an individual course schedule; 2) to determine the degree of knowledge perception and work out recommendations on repeating some materials if necessary.
This approach has it‘s advantages especially in the case of continuous learning when we face the problems of difference in levels of basic knowledge of learners, lack of time to study the whole course.
The paper examines the experience in adaptive assessment on the basis of the distance learning course on parallel computing. The recently started project on studies of psycho-social aspects of modern information technologies applications in higher and continuous education is described, together with possible applications of it‘s results to development of adaptive distance learning systems.
Article (version: 25/06/2002 - 07:47, size: 14464)

Individualization of distance education through adaption. Adaptive assessment.


Development of distance education systems (DES) requires thorough analysis, design and maintenance, as development of any information system does. When developing DES, it should be taken into account that DES has typical for information systems features, as well as it's peculiar characteristics, and has higher level of organization than an "ordinary" DE course or program. Most of DES peculiarities are connected with significant influence of human components on DE system.

DES specific functions include, among others, comprehensive and consequent support of educational process and support of DES component's compatibility (software, logical, etc.). It is important to mention that development of adaptive systems and integration of national DE systems within international ones are possible only when applying system's approach to development of distance education systems.

A short overview of the above mentioned aspects of DES development is given below.

Comprehensive and consequent support of educational process. Distance education system is to be built on the basis of some educational structure - chair, faculty, university, consortium, etc. - to provide consistency on organizational, administrative, educational, technical and information levels. All educational functions within a structure should be supported. In such a system three main subsystems are usually identified. They are learner-oriented, instructor-oriented and administrator-oriented DES subsystems. These subsystems interchange with information on educational process and add information to learner records (ideally, learner records should be life-long and transferred between educational institutions, which learner attend during his/her life).

Compatibility of distance education system components. Compatibility is used mainly in the sense of a software term here, as distance education systems undoubtedly should be based on information technologies and Internet. Although, when designing a system, we should consider also compatibility of educational content in the context of national educational standards (not technological) and educational policy of organization. The following compatibility tasks could be mentioned:

  • In order to provide a basis for cooperative use of educational curricula, courses, etc., the agreements concerning interface components and structure of content modules should be specified.
  • In order to ease exchange with educational information, acceptable data formats should be defined.
  • In order to provide retrieval of educational information on Internet, metadata structure and format should be supplied (according international standards preferably).

International learning technology standards. There exists a number of international projects on development of standards for educational information systems, the most advanced are the following:

  • ARIADNE (European Union) http://ariadne.unil.ch/
  • IMS (USA) http://www.imsproject.org/
  • ADL (US department of Defense) http://www.adlnet.org/
  • AICC (US Aviation Industry CBT) http://www.aicc.org/

These organizations are the most active participants in the development of international learning technology standards within IEEE Learning Technology Standards Committee (http://grouper.ieee.org/p1484/). Within this committee the following main directions for standardization exist:

  • Architecture and general system requirements
  • Learner model, instructor model and their interaction models
  • Course development (educational content)
  • Data and metadata
  • Educational management systems

Architecture serves the technological skeleton for building distance education system. Thus, the design tasks for DES architecture development determine the features, which the resulting DE system will have. Let us cite the architecture standard (which is not yet finalized), developed by IEEE LTSC:

"In general, the purpose of developing systems architectures is to discover high-level frameworks for understanding certain kinds of systems, their subsystems, and their interactions with related systems. An architecture … is a framework for designing a range of systems over time, and for the analysis and comparison of these systems. … An architecture promotes the design and implementation of components and subsystems that are reusable, cost-effective and adaptable."

As you see, adaptivity is included in the main characteristics of learning technology systems. Here it has the meaning of "adaptation to technology changes because the adaptation is only incremental change when viewed at the right of level of abstraction, i.e., helps manage change and reduce technical risk". Later in this paper we will consider other aspects of adaptivity, applied to distance education systems.

Another confirmation of importance of this feature can be found in ADL requirements, formulated for educational software. There are six requirements, that are considered to be of vital importance when developing educational information systems. Educational information systems and their components should be:

  • interoperable
  • reusable
  • adaptable
  • durable
  • accessible
  • affordable.

Now we come to the fourth aspect of DE system's development: development of adaptive systems. The main advantage of distance education is the possibility to provide individual approach to learners. Individualization is considered to be an advantage in most educational cases, but in distance learning it is the only way to compensate the lack of personal communication, emotional contact and feedback from instructor. Individualization may be realized through individual work with instructor or through adaptation of educational materials, computer programs and learning technology systems in general.

Individualization can be realized through adaptation of educational materials, computer programs, and learning technology systems in general. The key tasks in providing individualization of distance education are the ones of development of adaptive technologies and dynamic modular courseware building.

The term "adaptivity" of learning technology systems is being used in at least five meanings:

  • adaptivity in time (to development of new hard- and software)
  • interface adaptivity
  • adaptivity of structure and content of DL course
  • learning style adaptivity
  • adaptivity of educational process management.

It is possible to adapt various educational components to individual psychological, physiological and physical characteristics of learners, as well as to individual needs of learners, appearance of new knowledge and information, etc. All of the distance education system components are interconnected and most of them may be adapted: curriculum, course schedule, learning modules/units, tests, examples, etc.

In distance learning environment various components could possess adaptive quality, e.g. learning schedule, course plan, learning modules (volume of new information per module), tests (complexity level), examples. All adaptive components are interconnected and influence each other. For example, adaptive tests can change learning schedule, thus spreading the adaptive quality on this learning environment component.


Adaptive assessment.

Adaptive tests are used for the following purposes: for distance learners to provide self-control, for educators to assess distantly the knowledge acquired by learners, and also for management of educational process. To manage educational process means here 1) to determine the basic level of learner's knowledge and assist in composing of individual course schedule; 2) to determine the degree of knowledge perception and work out recommendations on repeating some materials if necessary.

The simple example of adaptation - adaptive assessment - is demonstrated below.


The mechanism of adaptive testing has advantages especially in the case of continuous learning when we face the problems of difference in levels of basic knowledge of learners, lack of time to study the whole course, etc. In this case, the possibility to generate an individual plan of studies can save learner's time and efforts. As it is hardly possible for a learner to objectively self-evaluate his/her level of knowledge and competence on the subject, the technology of support of individual plan generation plays an important role in increasing effectiveness of education, both in terms of knowledge acquired and time saved.

Procedure of adaptive testing performs the following tasks:

  • determines the basic level of learner's knowledge before studies and generates individual recommendations on studying the course;
  • controls knowledge, acquired during the studies; indicates "problem units" in the course and proposes individual plan for repeating the course units that were not correctly understood and remembered, providing thus the necessary feedback.

This type of testing partially automate the work of instructor, preserving individual approach to learners.

In adaptive test learner may perform one of the two actions:

  • Pass the test: learner receives a questionnaire, which is newly generated every time, the order and composition of questions don't repeat. He/she completes the test and sends the results back to the server. As a feedback, he/she receives HTML-page with evaluation of test results and recommendations on further way of studies.
  • View recommendations, worked out on the basis of previous results of test passing.

Instructor (test developer) may determine the feedback interface and type of recommendations, generated by the program. The procedure of adaptive testing has a special algorithm of test development, including

  • Dividing material into groups.
  • Assigning parameter's values for questions of the group (scores for right and wrong answers). The group has one more parameter – number of questions from the group that will be included in the test.
  • Groups are united in metagroups, each metagroup corresponds to a relatively independent part of educational materials. Each metagroup has it's own parameters: 1) threshold (a number; if the sum of the answers' weights is more than a threshold, this metagroup is excluded from further tests for the learner – he/she knows this unit of educational materials), 2) messages for passing and non-passing the metagroup.

An answer's protocol is generated and stored for each student. An instructor may analyze it, receiving the information on "problem units" and on the changes, necessary to made for the course.

The past experience of our department in development and implementation of adaptive tests in the courses on high-performance computing for supercomputer center, proves the effectiveness of application of adaptive technologies in distance learning.

Research project "Psychosocial aspects of application of modern information technologies in higher education".

Individualization is based on adaptive technologies, the type of technologies that adapt a predefined set of educational materials to individual abilities and demands of learners. If to speak about Internet-based distance learning (or, generally, about computer-based distance learning), in order to provide individualization, we should consider three main fields of studies:

  1. psychosocial characteristics of learners
  2. learner's attitude towards computers
  3. particular learning styles

We have studied the literature and Internet resources, available on the subject, and have defined three main types of questionnaires to use in the research according to the three fields, described above. These are:

  • psychological tests (evaluation of cognitive functions, studies of personality traits, interpersonal communication, studies of psychic state, studies in social-psychological sphere)
  • computer-attitude questionnaires
  • learning styles questionnaires

What criteria (most evident) for building of adaptive systems are expected to be developed among others on the basis of the research conducted:

  • verbal/visual/other learning style - to use for accenting DL course materials on a particular type of media
  • group-based or individual learning - to be used for choosing the communication technology and type of remote studies
  • recommended duration of learning module, quantity of new information, etc.

The research conducted will also help to determine the degree of influence of new information technologies on psychosocial characteristics of various types of learners and work out recommendations on the effective use of information technologies in educational process.

Acknowledgements:

The research on psychosocial aspects of application of new information technologies in higher education is supported by the "Research Support Scheme" of the Open Society Support Foundation, RSS/OSSF № 1488/2000.

References:

1. Osipova E. (2000) Application of adaptive assessment technologies for individualisation of distance learning, Materials of International seminar "Open distance education", 30-31 October, Saint-Petersburg, pps 32-34