A systematic literature review of automated feedback generation for programming exercises

Tooltips in the table provide descriptions of the abbreviations and symbols ( ).

Feedback content Technique Adaptability Evaluation
KTC KC KM KH EM
Name Lang Ex TR TPR EXP EXA TF CE SE SI PI EC TPS IM KMC MT CBM AT BSA PT IBD EX DA Other ST MS TD ED SM Other ANC ANL LO SU TA
(Ala-mutka04)Unknown3
(Allemang91)Imp/OO3
(Chang00)Imp/OO2
(Dadic11)Imp/OO3
(Fischer06)Imp/OO3
(Ghosh02)Imp/OO3
(Gulwani14)Imp/OO3
(Hasan88)Imp/OO3
(He94)Imp/OO2
(Hong04)Log3
(Jackson00)Imp/OO3
(Jin12)Imp/OO3
(Jin14)Imp/OO2
(Keuning14)Imp/OO3
(Kim98)Imp/OO3
(Lazar14)Log3
(Mandal07)Imp/OO3
(Naur64)Imp/OO3
(Rosenthal02)Imp/OO3
(Ruth76)Imp/OO3
(Sant09)Imp/OO3
(Shimic12)Imp/OO2
(Singh13)Imp/OO3
(Striewe11)Imp/OO3
(Vujosevic-Janicic13)Imp/OO3
ACT Programming Tutor (APT)Multi2
ADAPTLog3
AnalyseCImp/OO3
APROPOS2Log3
Ask-ElleFun3
ASSYSTImp/OO3
At(x)Multi3
AutoGraderImp/OO3
AutoLEPImp/OO3
AutoStyleImp/OO3
AutoTeachImp/OO3
BIPImp/OO3
BridgeImp/OO2
CamusImp/OO3
CeilidhMulti3
CheckpointMulti3
CHIRONImp/OO3
COALAImp/OO2
Code HuntImp/OO3
CourseMarker/CourseMasterMulti3
CSTutorImp/OO3
CtutorImp/OO2
C-tutorImp/OO3
datlabImp/OO3
DISCOVERImp/OO2
EASyImp/OO3
ELM-PE/ELM-ART (II)Fun3
ELPImp/OO2
FIT Java TutorImp/OO3
FLIPImp/OO3
GAME (2, 2+)Multi3
GraceImp/OO2
HabiProImp/OO2
INCOMLog3
InSTEPImp/OO2
INTELLITUTOR (II)Imp/OO2
IPTSImp/OO2
ITAPImp/OO3
ITEM/IPImp/OO3
JACKImp/OO3
Java SenseiImp/OO2
JITSImp/OO2
J-LATTEImp/OO2
KohImp/OO2
LAURAImp/OO2
LISP tutorFun2
LudwigImp/OO3
MarmosetMulti3
MENO-IIImp/OO3
Online JudgeImp/OO3
PASSImp/OO2
PATTIEImp/OO3
Pex4FunMulti3
PHP ITSImp/OO3
PRAMLog3
ProgramCriticImp/OO3
ProgTestImp/OO3
ProPAT_deBUGImp/OO3
ProPLImp/OO2
PROUSTImp/OO3
SCENTFun3
Scheme-roboFun3
SIPLeS-IIImp/OO3
SmalltalkerImp/OO2
SOPImp/OO3
submitImp/OO3
Submit!Multi3
TalusFun3
Test My CodeImp/OO3
TestovidMulti3
UgoLog3
VC Prolog TutorLog3
Virtual Programming LabMulti3
Web-CATMulti3
WebToTeachImp/OO3
WebWork-JAGImp/OO3