A systematic literature review of automated feedback generation for programming exercises

• Final paper: A Systematic Literature Review of Automated Feedback Generation for Programming Exercises. Hieke Keuning, Johan Jeuring and Bastiaan Heeren. To appear in ACM Transactions on Computing Education (TOCE), 2018
• Paper on first results: Towards a Systematic Review of Automated Feedback Generation for Programming Exercises. Hieke Keuning, Johan Jeuring and Bastiaan Heeren. Proceedings of ITiCSE 2016 . Extended Version, Technical report , data table.

Tooltips in the table provide descriptions of the abbreviations and symbols ( ).

			Feedback content													Technique									Adaptability						Evaluation
			KTC		KC		KM					KH																					EM
Name	Lang	Ex	TR	TPR	EXP	EXA	TF	CE	SE	SI	PI	EC	TPS	IM	KMC	MT	CBM	AT	BSA	PT	IBD	EX	DA	Other	ST	MS	TD	ED	SM	Other	ANC	ANL	LO	SU	TA
(Ala-mutka04)	Unknown	3
(Allemang91)	Imp/OO	3
(Chang00)	Imp/OO	2
(Dadic11)	Imp/OO	3
(Fischer06)	Imp/OO	3
(Ghosh02)	Imp/OO	3
(Gulwani14)	Imp/OO	3
(Hasan88)	Imp/OO	3
(He94)	Imp/OO	2
(Hong04)	Log	3
(Jackson00)	Imp/OO	3
(Jin12)	Imp/OO	3
(Jin14)	Imp/OO	2
(Keuning14)	Imp/OO	3
(Kim98)	Imp/OO	3
(Lazar14)	Log	3
(Mandal07)	Imp/OO	3
(Naur64)	Imp/OO	3
(Rosenthal02)	Imp/OO	3
(Ruth76)	Imp/OO	3
(Sant09)	Imp/OO	3
(Shimic12)	Imp/OO	2
(Singh13)	Imp/OO	3
(Striewe11)	Imp/OO	3
(Vujosevic-Janicic13)	Imp/OO	3
ACT Programming Tutor (APT)	Multi	2
ADAPT	Log	3
AnalyseC	Imp/OO	3
APROPOS2	Log	3
Ask-Elle	Fun	3
ASSYST	Imp/OO	3
At(x)	Multi	3
AutoGrader	Imp/OO	3
AutoLEP	Imp/OO	3
AutoStyle	Imp/OO	3
AutoTeach	Imp/OO	3
BIP	Imp/OO	3
Bridge	Imp/OO	2
Camus	Imp/OO	3
Ceilidh	Multi	3
Checkpoint	Multi	3
CHIRON	Imp/OO	3
COALA	Imp/OO	2
Code Hunt	Imp/OO	3
CourseMarker/CourseMaster	Multi	3
CSTutor	Imp/OO	3
Ctutor	Imp/OO	2
C-tutor	Imp/OO	3
datlab	Imp/OO	3
DISCOVER	Imp/OO	2
EASy	Imp/OO	3
ELM-PE/ELM-ART (II)	Fun	3
ELP	Imp/OO	2
FIT Java Tutor	Imp/OO	3
FLIP	Imp/OO	3
GAME (2, 2+)	Multi	3
Grace	Imp/OO	2
HabiPro	Imp/OO	2
INCOM	Log	3
InSTEP	Imp/OO	2
INTELLITUTOR (II)	Imp/OO	2
IPTS	Imp/OO	2
ITAP	Imp/OO	3
ITEM/IP	Imp/OO	3
JACK	Imp/OO	3
Java Sensei	Imp/OO	2
JITS	Imp/OO	2
J-LATTE	Imp/OO	2
Koh	Imp/OO	2
LAURA	Imp/OO	2
LISP tutor	Fun	2
Ludwig	Imp/OO	3
Marmoset	Multi	3
MENO-II	Imp/OO	3
Online Judge	Imp/OO	3
PASS	Imp/OO	2
PATTIE	Imp/OO	3
Pex4Fun	Multi	3
PHP ITS	Imp/OO	3
PRAM	Log	3
ProgramCritic	Imp/OO	3
ProgTest	Imp/OO	3
ProPAT_deBUG	Imp/OO	3
ProPL	Imp/OO	2
PROUST	Imp/OO	3
SCENT	Fun	3
Scheme-robo	Fun	3
SIPLeS-II	Imp/OO	3
Smalltalker	Imp/OO	2
SOP	Imp/OO	3
submit	Imp/OO	3
Submit!	Multi	3
Talus	Fun	3
Test My Code	Imp/OO	3
Testovid	Multi	3
Ugo	Log	3
VC Prolog Tutor	Log	3
Virtual Programming Lab	Multi	3
Web-CAT	Multi	3
WebToTeach	Imp/OO	3
WebWork-JAG	Imp/OO	3