This literature review on remote labs in higher education examined the empirical research on learning benefits of such labs. The aim of this study was to investigate what kinds of learning outcomes... Show moreThis literature review on remote labs in higher education examined the empirical research on learning benefits of such labs. The aim of this study was to investigate what kinds of learning outcomes were examined, how these effects were examined, and which findings these studies provided. Effects that were examined in the reviewed articles (k=23) concerned cognitive, behavioral, and affective learning outcomes. Overall, results showed positive findings with respect to all three types of learning outcomes: students gained conceptual knowledge, were engaged in the lab, and were satisfied with learning in a remote lab context. However, evaluation approaches of the learning outcomes were quite superficial, because examining the educational benefits of the remote labs was not the main focus of most articles. Future research should address this issue to provide more rigorous evidence about possible benefits of remote labs on student learning in higher education. Show less
Blankenstein, F.M. van; Saab, N.; Rijst, R.M. van der; Danel, M.S.; Bakker-van den Berg, A.S.; Broek, P.W. van den 2019
Research skills are important for university graduates, but little is known about undergraduates' motivation for research. In this study, self-efficacy beliefs and intrinsic motivation for several... Show moreResearch skills are important for university graduates, but little is known about undergraduates' motivation for research. In this study, self-efficacy beliefs and intrinsic motivation for several research activities were measured three times during an undergraduate research project (N = 147 students). In order to promote self-efficacy for writing and collaboration, a collaboration script was developed and tested on half of the students. Twelve students were interviewed three times to gather in-depth information about motivational and self-efficacy beliefs. All measures except intrinsic motivation for research increased significantly during the project. Interview results suggest that enactive mastery and positive social interdependence promoted self-efficacy. Feelings of relatedness seemed to promote intrinsic motivation for writing. Lack of autonomy and low perceived relevance may explain why motivation for research remained stable. The script had no impact on self-efficacy beliefs. Relatedness, autonomy and positive social interdependence may boost motivation for research, but more evidence is needed. Show less
Blankenstein, F.M. van; Trutescu, G.; Rijst, R.M. van der; Saab, N. 2019
The learning benefits of peer assessment and providing peer feedback have been widely reported. However, it is still not understood which learning activities most facilitate the acquisition of... Show moreThe learning benefits of peer assessment and providing peer feedback have been widely reported. However, it is still not understood which learning activities most facilitate the acquisition of feedback skills. This study aimed to compare the effect of a modeling example, i.e., a model that demonstrated how to give feedback, on the acquisition of feedback skills. The participants were second-year bachelor students in pedagogical sciences (N = 111). They were assigned randomly to a practice condition, in which they practiced giving feedback on oral presentations, or a modeling example condition, in which a teacher demonstrated how to give feedback on a good and a bad presentation. Students then gave feedback to a presenter in a video (direct feedback measure). One week later, they gave each other peer feedback on oral presentations (delayed feedback measure). On the direct feedback measure, students in the modeling example condition used assessment criteria more often in their feedback, and produced significantly more overall feedback, and significantly more positive and negative judgments than students in the practice condition. There was no significant difference in the amount of elaboration and feed-forward between the two conditions. On the delayed feedback measure, there were no significant differences between the two experimental conditions. The results suggest that, at least in the short term, a modeling example can stimulate the use of assessment criteria and judgments in feedback. The results and implications for future research and practice are discussed. Show less
Mouw, J.M.; Saab, N.; Janssen, J.; Vedder, P. 2019
High-quality helping behavior is essential for effective peer interaction and learning. This study focused on ethnic group composition and the quality of group interaction as predictors of... Show moreHigh-quality helping behavior is essential for effective peer interaction and learning. This study focused on ethnic group composition and the quality of group interaction as predictors of individual mathematics performance. Video-observations of 92 fifth-grade students working in groups balanced on mathematics performance level were analyzed. We expected a difference in the quality of interaction and test scores of native and non-native students. Multilevel analysis identified process regulation and giving answers as positive predictors of mathematics performance, whereas giving or applying explanations contributed negatively. Non-native students generally had lower achievement scores than native students. Non-native students working in ethnically heterogeneous groups performed better than did students working in homogenous groups. Homogeneous groups used more high-quality helping behaviors and engaged more often in task-oriented behavior. Heterogeneous groups engaged more often in low-quality helping behaviors. Working with native students may have been conducive to non-native students’ understanding of word problems in realistic mathematics education. Show less
Admiraal, W.F.; Post, L.; Guo, P.; Saab, N.; Makinen, S.; Rainio, O.; ... ; Danford, G. 2019
Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’... Show morePeer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g = 0.91 [0.41, 1.42]) and compared to self-assessment (g = 0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g = 0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions. Show less
Commitment to teaching is a recurring topic in both research and policy discussions on teaching and the teaching profession. We investigated factors explaining differences in student-teachers’... Show moreCommitment to teaching is a recurring topic in both research and policy discussions on teaching and the teaching profession. We investigated factors explaining differences in student-teachers’ commitment to the teaching profession and to student learning, and their intentions to enter the teaching profession. Student-teachers (n = 3,246) from one University College in Tanzania completed a Commitment-to-Teaching questionnaire. Bandura’s Social-Cognitive Theory was used to explain the findings. Differences in student-teachers’ commitment were explained by personal characteristics (i.e., student-teachers’ sense of self-efficacy), environmental factors (i.e., perceived influence of significant others and school conditions), and learning experiences (i.e., student-teachers’ attitudes towards the teaching profession, their teaching subjects, and satisfaction with the teacher education programme). Implications for practice and for research on student-teachers’ commitment to teaching are discussed. Show less
Kraal, A.; Van den Broek, P.; Koornneef, A.; Ganushchak, L.; Saab, N. 2019
“Een masteropleiding die scholen helpt om een transitie te realiseren, om eigentijds en toekomstgericht onderwijs te creëren.”, dat was de wens vanuit de onderwijssector. Nu, twee jaar later,... Show more“Een masteropleiding die scholen helpt om een transitie te realiseren, om eigentijds en toekomstgericht onderwijs te creëren.”, dat was de wens vanuit de onderwijssector. Nu, twee jaar later, studeren de eerste studenten van de Teammaster Transitie in Onderwijs met Technologie (3TO) af. Een bijzondere opleiding waarin schoolleiders én leraren samen leren en samen werken aan het creëren van toekomstgericht onderwijs in hun eigen school. Show less
Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’... Show morePeer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g = 0.91 [0.41, 1.42]) and compared to self-assessment (g = 0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g = 0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions. Show less
During the early stages of secondary education students’ motivation and performance levels decline. This study employed a case study approach to evaluate a learning environment called GUTS;... Show moreDuring the early stages of secondary education students’ motivation and performance levels decline. This study employed a case study approach to evaluate a learning environment called GUTS; Differentiated Challenging of Talent in School. GUTS was specifically designed to raise performance and motivation through a combination of (a) talent lessons as an intrinsic motivator and (b) a higher promotion standard as an extrinsic incentive. Participants were 156 students who started secondary education in grade 7 in school year 2013/2014, and participated in GUTS for three successive school years. Performance and motivation measures were longitudinally collected between grades 7 and 9 and were analysed in comparison to previous cohorts of students at the same school and students at other schools. Additionally, measures of well-being and self-esteem were included to explore possible collateral effects of the intervention. The GUTS cohort displayed generally higher levels of performance and motivation than the comparison groups. However, the GUTS cohort still showed the decline of performance and motivation between grades 7 and 9 that was also observed in the comparison groups. This study showed that performance and motivation levels were increased without collateral damage to the students’ overall sense of well-being and self-esteem, while GUTS was not a strong enough intervention to counter the motivation and performance decline over time. Possible reasons for the persistent decline of student performance and motivation are discussed in terms of various factors at the level of GUTS, the educational context and the needs of the developing adolescent. Show less
Blankenstein, F.M. van; Saab, N.; Rijst, R.M. van der; Danel, M.S.; Bakker-Van den Berg, A.S.; Broek, P.W. van den 2018
Research skills are important for university graduates, but little is known about undergraduates’ motivation for research. In this study, self-efficacy beliefs and intrinsic motivation for several... Show moreResearch skills are important for university graduates, but little is known about undergraduates’ motivation for research. In this study, self-efficacy beliefs and intrinsic motivation for several research activities were measured three times during an undergraduate research project (N = 147 students). In order to promote self-efficacy for writing and collaboration, a collaboration script was developed and tested on half of the students. Twelve students were interviewed three times to gather in-depth information about motivational and self-efficacy beliefs. All measures except intrinsic motivation for research increased significantly during the project. Interview results suggest that enactive mastery and positive social interdependence promoted self-efficacy. Feelings of relatedness seemed to promote intrinsic motivation for writing. Lack of autonomy and low perceived relevance may explain why motivation for research remained stable. The script had no impact on self-efficacy beliefs. Relatedness, autonomy and positive social interdependence may boost motivation for research, but more evidence is needed. Show less
Huisman, B.A.; Saab, N.; Driel, J.H. van; Broek, P.W. van den 2018
Within the higher education context, peer feedback is frequently applied as an instructional method. Research on the learning mechanisms involved in the peer feedback process has covered aspects of... Show moreWithin the higher education context, peer feedback is frequently applied as an instructional method. Research on the learning mechanisms involved in the peer feedback process has covered aspects of both providing and receiving feedback. However, a direct comparison of the impact that providing and receiving peer feedback has on students’ writing performance is still lacking. The current study compared the writing performance of undergraduate students (N = 83) who either provided or received anonymous written peer feedback in the context of an authentic academic writing task. In addition, we investigated whether students’ peer feedback perceptions were related to the nature of the peer feedback they received and to writing performance. Results showed that both providing and receiving feedback led to similar improvements of writing performance. The presence of explanatory comments positively related both to how adequate students perceived the peer feedback to be, as well as to students’ willingness to improve based upon it. However, no direct relation was found between these peer feedback perceptions and students’ writing performance increase. Show less
Huisman, B.A.; Saab, N.; Driel, J. van; Broek, P. van den 2018
Within the higher education context, peer feedback is frequently applied as an instructional method. Research on the learning mechanisms involved in the peer feedback process has covered aspects of... Show moreWithin the higher education context, peer feedback is frequently applied as an instructional method. Research on the learning mechanisms involved in the peer feedback process has covered aspects of both providing and receiving feedback. However, a direct comparison of the impact that providing and receiving peer feedback has on students’ writing performance is still lacking. The current study compared the writing performance of undergraduate students (N = 83) who either provided or received anonymous written peer feedback in the context of an authentic academic writing task. In addition, we investigated whether students’ peer feedback perceptions were related to the nature of the peer feedback they received and to writing performance. Results showed that both providing and receiving feedback led to similar improvements of writing performance. The presence of explanatory comments positively related both to how adequate students perceived the peer feedback to be, as well as to students’ willingness to improve based upon it. However, no direct relation was found between these peer feedback perceptions and students’ writing performance increase. Show less
Espin, C.A.; Saab, N.; Pat-El, R.; Boender, P.D.M.; Veen, J. van der 2018
Curriculum-Based Measurement (CBM) is a system for monitoring the progress of and evaluating instructional program effectiveness for students with learning difficulties. Although a large amount of... Show moreCurriculum-Based Measurement (CBM) is a system for monitoring the progress of and evaluating instructional program effectiveness for students with learning difficulties. Although a large amount of research has been conducted on CBM, little has focused on the interpretation and use of the data for instructional decision-making, despite the fact that it is data use that leads to performance gains. In this study, we examine factors affecting the interpretation of CBM data. Specifically, we examine the effect of CBM graph patterns on ease of graph interpretation. Thirty college/university students completed a two-part study in which they viewed various slope-to-goal and slope-to-slope patterns of CBM-graphed data and answered decision-making questions. Response times and accuracy were measured. Results revealed that graph patterns differed in terms of ease of interpretation. Differences depended on the type of question. Implications for interpretation and use of CBM data for decision-making are discussed. Show less
Students in secondary education inevitably favour some subjects more than other subjects. This appraisal may affect how motivation relates to performance in these subjects. Whereas autonomous... Show moreStudents in secondary education inevitably favour some subjects more than other subjects. This appraisal may affect how motivation relates to performance in these subjects. Whereas autonomous motivation is generally linked to positive school outcomes, the effect of controlled motivation is less clear. This study specifically focused on the associations of controlled motivation with performance in the context of favoured and disfavoured subjects. In the present study, secondary school students (N = 918) identified 2 favoured and 2 disfavoured subjects. Hierarchical linear modelling was performed to investigate the relationship of autonomous and controlled motivation with performance in these subjects. Results showed that autonomous motivation positively related to performance in both types of subjects. The association of controlled motivation with performance was negative in both contexts, and more negative in disfavoured subjects. For teaching practice, this means that teachers should always stimulate autonomous motivation, even for negatively appraised subjects. Show less