Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ NaUKMA Research Pape...arrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
NaUKMA Research Papers Computer Science
Article . 2020 . Peer-reviewed
Data sources: Crossref
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
NaUKMA Research Papers Computer Science
Article
License: CC BY
Data sources: UnpayWall
versions View all 2 versions
addClaim

This Research product is the result of merged Research products in OpenAIRE.

You have already added 0 works in your ORCID record related to the merged Research product.

Use of Analytical Hierarchy Process for Automated Assessing of Students’ Study Projects

Authors: Oletsky, Oleksii; Tryhub, Oleksandr;

Use of Analytical Hierarchy Process for Automated Assessing of Students’ Study Projects

Abstract

The problem of applying multicriteria optimization on the basis of the analytical hierarchy process (AHP) for a specific subject domain is regarded in the paper. Namely, the situation when some students’ study projects should be compared and assessed with the aid of automated algorithm-based tools for grading especially if these projects are nearly of the same quality level is considered. It is well-known that using the classical graduation scale of pairwise comparisons preferences, suggested by T.Saati and commonly used in AHP, may lead to not very good results. The reason for this is that the difference between the automatically evaluated grades of the projects may become unacceptably large even though all of the projects are good enough and deserve good grades. On the other hand, a competitive and comparative approach to grading study projects should be preserved.In order to mitigate this problem, many authors proposed to apply alternative scales of pair comparisons, which are sometimes referred to as transitive ones. Constructing such scales should imply introducing some parameter that determines how many times the next graduation in the scale of preferences in pair comparisons matrices is bigger than the previous one. Typically this parameter is a rational value between 1 and 2 whereas 2 is the least graduation of preferences in the standard Saati scale. The main issue is how to find out appropriate values of this parameter in order to meet the requirements of the certain task.For exploring this question, some numerical experiments have been carried out and are reported in this paper. According to the typical algorithm of estimations, some projects executed by students have been compared pairwise by each criterion separately. Then the chosen criteria have been compared pairwise as well, and the linear convolution method has been applied for getting final grades. The reported experiments show that for the task of automated grading of students’ study projects alternative transitive scales described above can provide more adequate results than using the standard Saati scale, and the best choice of the parameter for this specific task is about 1.1.All experiments have been carried out with the help of the author software toolkits developed for the purposes of exploring AHP and of applying it for various practical tasks. Some screenshots illustrating the main points of reported experiments are supplied.Manuscript received 20.05.2020

У статті досліджено задачу багатокритеріальної оптимізації, яку розв’язують методом аналізу ієрархій. Розглянуто ситуацію, коли потрібно порівняти та ранжувати студентські роботи (проекти), приблизно одного рівня якості. Продемонстровано, що в таких випадках класичний метод аналізу ієрархій, запропонований Т. Сааті, призводить до отримання досить «грубих» числових результатів (глобальних пріоритетів), коли виявляється, що робота одного студента суттєво переважає роботу іншого (хоча це не так, бо розглядали роботи приблизно одного рівня). Запропоновано використати альтернативну шкалу попарних порівнянь, яка даватиме змогу отримувати в таких випадках більш адекватні числові результати.Проведено відповідні чисельні розрахунки із використанням авторської програмної системи, результати яких наведено у вигляді скріншотів.Матеріал надійшов 20.05.2020

Related Organizations
Keywords

транзитивні шкали, automated assessing, study project, багатокритеріальна оптимізація, автоматизоване оцінювання, software system, навчальний проект, pair comparisons, analytical hierarchy process, попарні порівняння, transitive scales, multicriteria optimization, метод аналізу ієрархій, програмна система

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    3
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
3
Average
Average
Average
gold