ラベル Note from readings の投稿を表示しています。 すべての投稿を表示
ラベル Note from readings の投稿を表示しています。 すべての投稿を表示

Rublic use in higher education




Two studies suggested that rubric use was associated with improved academic performance, while one did not.

A rubric has three essential features: evaluation criteria, quality definitions, and a scoring strategy.

Quality definitions provide a detailed explanation of what a student must do to demonstrate a skill, proficiency or criterion in order to attain a particular level of achievement

Rubrics are often used by teachers to grade student work but many authors argue that they can serve another, more important, role as well: When used by students as part of a formative assessment of their works in progress, rubrics can teach as well as evaluate

The purposes of this review are to examine the type and extent of empirical research on rubrics at the post-secondary level and to stimulate research on rubric use in post-secondary teaching.

is there evidence that rubrics can be used as formative assessments in order to promote learning and achievement in higher education, as opposed to rubric use that serves only the purposes of grading and accountability?

graduate and undergraduate students value rubrics because they clarify the targets for their work, allow them to regulate their progress and make grades or marks transparent and fair.

There is evidence of both positive responses and resistance to rubric use by college and university instructors.

One striking difference between students’ and instructors’ perceptions of rubric use is related to their perceptions of the purposes of rubrics. Students frequently referred to them as serving the purposes of learning and achievement, while instructors focused almost exclusively on the role of a rubric in quickly, objectively and accurately assigning grades.

the use of rubrics to rate student work enabled an instructor to pinpoint the areas of weakness and thereby identify needed improvements in the instruction.

These studies lend support to the view that rubrics have the potential to act as ‘instructional illuminators’ (Popham 1997, 75).

Several studies have shown that rubrics can allow instructors and students to reliably assess performance.

the clarity of the language in a rubric is a matter of validity because an ambiguous rubric cannot be accurately or consistently interpreted by instructors, students or scorers (Payne 2003).

The implication seems to be that simply handing out a rubric cannot be expected to have an impact on student work:

The research reports little study of the validity of the rubrics used.

Future studies should report how the validity of a rubric was established, and the scoring reliability, including rater training and its contribution towards achieving inter-rater reliability, and perhaps even the correlation between rubric-referenced scores and other measures of performance.

Influences on the assessment of graduate attributes in higher education



Hughes, C. & Barrie, S. (2010). Influences on the assessment of graduate attributes in higher education. Assessment & Evaluation in HIgher Education, 35(3), pp. 325-334.

outcomes-based approach to the quality assurance of standards in higher education

advocacy for the establishment of constructive alignment between learning outcomes and assessment without acknowledging other factors that need to be addressed in planning for the effective assessment of graduate attributes.

Assessment often takes the form of tasks such as essays and examinations conducted within the boundaries of discrete courses or modules, traditions which remain unquestioned and unchallenged because of their long association with particular disciplines.

Though outcomes-based approaches to curriculum have been responsible for a shift of focus to the assessment of student learning as a more valid demonstration

that graduate attributes are most effectively embedded in assessment when they frame curriculum development and when students are engaged as active partners in directing their own learning through negotiation of assessment tasks, collection of evidence of progress in relation to specific attributes,


Student perceptions of e-portfolio



D.U. Bolliger & C.E. Shepherd (2010): Student perceptions of ePortfolio
integration in online courses, Distance Education, 31:3, 295-314

electronic portfolios (ePortfolios) – digitized, computer or Web-based versions of traditional portfolios

Online learning environments are also beginning to incorporate ePortfolios to promote knowledge acquisition, facilitate collaboration, and implement authentic assessment.

Many adults who pursue graduate studies opt to enrol in online programs.

When students believe that relationships exist among classmates, they feel connected – which can lead to a sense of belonging (Lee & Robbins, 1998).

ePortfolios may also facilitate supervision.

Although the design and development of ePortfolios is considered an individual task, some researchers advocate the inclusion of social activities to foster collaboration and peer review among online students.

Online students primarily interact and communicate with information technologies that lack audio-visual and nonverbal cues.

little research has addressed their influence on student perceptions of connectedness and communication, the value of the integration of an ePortfolio assignment, and learning in online programs.

little research has addressed their influence on student perceptions of connectedness and communication, the value of the integration of an ePortfolio assignment, and learning in online programs.

However, not all participants valued examining program requirements and goals.

Participants stated they enjoyed the ePortfolio when they were able to align the assignment with their own goals.

Results indicate ePortfolio integration benefited some – but not all

Fewer than half of the participants indicated ePortfolios helped them to communicate
better with their peers or program faculty.

ePortfolios may help to develop connectedness between students, faculty members, and programs.

findings suggest they do influence student perceptions and could become part of a larger plan to increase community among distance education students.

Yet, results from this study suggest that ePortfolios may help mentoring too.

the extent to which the integration and formative peer evaluation of ePortfolios foster connectedness and improve the quality of communication over time is unknown.

Although this study suggests ePortfolios can be a valuable tool for some students in distance education programs, findings indicate not all students benefit.

Integrating a variety of open-source software and/or Web 2.0 tools in the development of ePortfolios and providing learners with options and choices pertaining to their use may provide some learners with the level of personalization they desire.


Models of self-assessment



Maddalena Taras (2010): Student self-assessment: processes and consequences,
Teaching in Higher Education, 15:2, 199-209

This paper examines models of self-assessment in higher education (HE).

This paper examines the basic process of each model and what tutors provide to
learners in the way of training, support and materials for learners to carry out the
self-assessment.

‘self-evaluation’ and ‘self-appraisal’

The defining characteristics of self-assessment is the involvement of students in
identifying standards and/or criteria to apply to their work and making judgements
about the extent to which they have met these criteria and standards. (Boud 1991, 5,
in Boud 1995, 12)

Self-assessment has been shown to support student learning.

Within this framework, involvement of learners at all stages and at all levels of decision
making (or at least explain the decisions) is a critical aspect which supports learning.

essential premise of including learners in assessment.

Self-marking at its most basic can be seen as a behaviourist model of learning because it takes a model answer as a frame and compares it systematically to the learners’ work.

Sadler (1989) notes the use of a range of exemplars has been shown to help learners to understand the requirements of assessment.

self-assessment is a continual cycle which should focus learners on producing work to their maximum potential and that the final piece of work would in fact not have a note of weaknesses as these would have been addressed.

On the other hand, reducing the pressure of the graded context may be more conducive

The Learning Contract Design (LCD) was developed in the context of self-directed learning (Boyd, Adeyemi-Bero, and Blackhall 1985; Cowan 1984, 1988)

This model was developed in the mid-1980s and is one of the few and earliest examples where graded assessment is placed in the hands of the learners and where the student’s mark contributes to the final student grades.

What is particularly interesting and unique about this experiment is that it is within a holistic context of both learning and assessing,

supporting learner autonomy and independence in assessment would be a logical and expected procedure, particularly since it reflects the rhetoric and aims of HE

Self-marking at its most basic can be seen as a behaviouristic model of learning because it takes a model answer as a frame and compares it systematically to the learners’ work.

The standard model would be on the mid-line of the continuum with potential for moving in either direction depending on learning involvement.

the standard model which is essentially separate from the tutor assessment and permits learners to consider their work against criteria and standards, and has the advantage of encouraging learner independence.

Types and methods of assessment



Biggs, J.B., & Tang, C. (2007). Aligning assessment tasks with intended learning outcomes: principles (Ch. 9). Teaching for quality learning at university (3rd ed., pp. 163-194). Maidenhead, UK: McGraw-Hill/Society for Research into Higher Education & Open University Press.
Assessment tasks should comprise an authentic representation of the course ILOs (intended learning outcomes).

Self- and peer – assessment are particularly helpful TLAs for training students to reflect on the quality of their own work.

A valid or authentic assessment must be of the total performance, not just aspects of it.

In making holistic assessments the details are not ignored. The question is whether, like
the bricks of a building or the characters in a novel, the specifics are tuned to create an
overall structure or impact (p. 184)

In order to assess learning outcomes holistically, it is necessary to have a conceptual
framework that enables us to see the relationship between the parts and the whole.
Teachers, like journal editors, need to develop their own framework. (p. 185)

Self-assessment: What points do Biggs & Tang make about self-assessment on p. 187?

 
James, R. McInnes, C. & Devlin, M. (2002) Assessing learning in Australian universities. Retrieved February 13, 2007 from University of Melbourne website.



It is a matter of urgency that assessment is addressed in a way that acknowledges the multiplicity of inter-related issues and concerns.

Assessment needs to motivate and challenge the learner, to stimulate learning and to provide feedback.

Assessment strategies must accommodate all the purposes of assessment, which need to be addressed, including accreditation and quality assurance, but without a strong commitment to assessment’s role for learning, there is a danger that this role will largely be lost.

If assessment suffers from being an afterthought in the course design process, feedback is distanced even further, rarely being considered in a strategic way.

it must be acknowledged that the practice of assessment is multifaceted requiring a range of skills such as design, student support, communication, clarification and the application of standards, stimulating
and enhancing student engagement with the task, and feedback, and, although each facet warrants consideration in its own right,

Managing a complex issue such as assessment demands an integrated approach as well as one that takes account of the context in which assessment takes place.

There is a false (but widely held) view that marks are a systematic and consistent reflection of the quality of students’ work (indeed, the system depends on it!). In reality, many studies document that marking systems are an unreliable means for grading student work (see, e.g. Hartog and Rhodes 1935; Laming 1990; Newstead and Dennis 1994; QAA 2006).

It takes considerable thought and reflection to design assessment for complex learning, in particular assessments which are challenging and fit for purpose. Further challenges are then posed by the need for staff to be highly skilled and trained in assessment in order to ensure effectiveness.

Learning in a structured environment is underpinned by students’ understanding of the assessment standards and processes used by the disciplinary community into which they are being inducted.

summative assessment generates marks and regulates whether students can pass through a specific boundary when moving towards accreditation. Formative assessment, on the other hand, gives students information about how their learning is progressing.

Summative assessments are often considered to be more resource-intensive (than formative) because of the administrative workload required to verify and record the results.

Many formative assessment tasks are allocated a proportion of the summative marks to ensure students undertake the work.

It may be that summative assessment based on programme outcomes can provide a more accurate reflection of student achievement, allowing formative assessment to support learning.

Developing a consistent assessment strategy and coherence between strategy and implementation is dependent on a clear and widely agreed view about the role and position of assessment in relation to the continuums.

A comparison of norm-referencing and criterion-referencing methods for determining student grades in higher education

For large student cohorts (such as in senior secondary education), statistical moderation processes are used to adjust or standardise student scores to fit a normal distribution.

There is a strong culture of norm-referencing in higher education.

In contrast, criterion-referencing, as the name implies, involves determining a student’s grade by comparing his or her achievements with clearly stated criteria for learning outcomes and clearly stated standards for particular levels of performance. The goal of criterion-referencing is to report student achievement against objective reference points that are independent of the cohort being assessed.

Which of these methods is preferable? Mostly, students’ grades in universities are decided on a mix of both methods, even though there may not be an explicit policy to do so.

Norm-referencing, on its own — and if strictly and narrowly implemented — is undoubtedly unfair. With norm-referencing, a student’s grade depends – to some extent at least – not only on his or her level of achievement, but also on the achievement of other students.

Criterion-referencing requires giving thought to expected learning outcomes: it is transparent for students, and the grades derived should be defensible in reasonably objective terms – students should be able to trace their grades to the specifics of their performance on set tasks.

Best practice in grading in higher education involves striking a balance between criterion-referencing and norm-referencing.