rubrics and grading forms: improving the quality of … rubric: scoring rubrics include one or more...

11
TEL@SHEF STEP-BY-STEP The University of Sheffield Supporting Learning through Technology Page 1 www.sheffield.ac.uk/cics/tel [email protected] Rubrics and Grading Forms: Improving the quality of assessment Preparation: Access to a course in MOLE (My Online Learning Environment) An assignment already set up. In order to access your Turnitin account, you will need to have an assignment set up in a course area in MOLE. (This does not need to be a real one – you can set one up as hidden, simply to allow you to access your Turnitin area. See sheet on ‘Setting up an Assignment’ to see how to do this.) Time needed: 20mins-40mins Why use Rubrics and Grading forms? Rubrics and Grading forms, more commonly known as marking or assessment criteria are used to help assess how well a student has performed in a submitted piece of work across a range of competencies. They are often used to assist in assigning a mark to that work. For more information on using assessment criteria, please refer to LeTS (Learning and Teaching Services) toolkit: http://www.shef.ac.uk/lets/toolkit/f-a/assessment In Turnitin, you can create your own assessment forms in an electronic format, which can then be utilised in the same manner as traditional paper-based assessment criteria. The most immediate benefits of using Turnitin Rubrics and Grading forms are: You can make the criteria available to students, which helps them to understand what is expected from them and why they have received the grade they have on a piece of work Once created, you can attach a Turnitin Rubric or Grading Form to any assignment You can share Rubrics and Grading Forms with colleagues Once a Rubric or Grading Form has been set up and attached to an assignment, it allows for quicker marking You can tailor Rubrics and Grading Forms quickly and easily to different assignments. Terminology: Turnitin uses American terminology, which may not be clear to new users.

Upload: duongtu

Post on 09-Apr-2018

234 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 1

www.sheffield.ac.uk/cics/tel

[email protected]

Rubrics and Grading Forms: Improving the quality of assessment

Preparation:

Access to a course in MOLE (My Online Learning Environment)

An assignment already set up. In order to access your Turnitin account, you will need to

have an assignment set up in a course area in MOLE. (This does not need to be a real

one – you can set one up as hidden, simply to allow you to access your Turnitin area. See

sheet on ‘Setting up an Assignment’ to see how to do this.)

Time needed: 20mins-40mins

Why use Rubrics and Grading forms?

Rubrics and Grading forms, more commonly known as marking or assessment criteria are

used to help assess how well a student has performed in a submitted piece of work across a

range of competencies. They are often used to assist in assigning a mark to that work. For

more information on using assessment criteria, please refer to LeTS (Learning and Teaching

Services) toolkit:

http://www.shef.ac.uk/lets/toolkit/f-a/assessment

In Turnitin, you can create your own assessment forms in an electronic format, which can

then be utilised in the same manner as traditional paper-based assessment criteria.

The most immediate benefits of using Turnitin Rubrics and Grading forms are:

You can make the criteria available to students, which helps them to understand

what is expected from them and why they have received the grade they have on a

piece of work

Once created, you can attach a Turnitin Rubric or Grading Form to any assignment

You can share Rubrics and Grading Forms with colleagues

Once a Rubric or Grading Form has been set up and attached to an assignment, it

allows for quicker marking

You can tailor Rubrics and Grading Forms quickly and easily to different assignments.

Terminology:

Turnitin uses American terminology, which may not be clear to new users.

Page 2: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 2

www.sheffield.ac.uk/cics/tel

[email protected]

A rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions

and examples that illustrate the attribute(s) being measured, and a rating scale for each dimension.

Dimensions are generally referred to as criteria, the rating scale as levels, and definitions as

descriptors. (Wikipedia)

This is an example of a Rubric:

Rubrics are typically created on a grid and guide students to the expected standards of the

work expected. We may call these ‘assessment or marking criteria’.

Different types of Rubrics in Turnitin

Rubrics allow for different types of scoring and there are three main types in Turnitin.

1. Standard Rubric: This rubric is selected by clicking the % symbol at the base of the

Rubric window. This means that criteria created will be weighted by a certain

percentage. There are also grading scale values available. When attached to an

assignment, this Rubric can calculate and input the overall grade within GradeMark,

based on your grading scale selections.

Page 3: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 3

www.sheffield.ac.uk/cics/tel

[email protected]

2. Custom Rubric: This Rubric is denoted by a ‘Pencil’ symbol. This type of Rubric allows you to enter any numerical and text value into the Rubric cells themselves. This allows for the most control over scoring or grading. When attached to an

assignment, this Rubric will calculate and input the overall grade within GradeMark, based on your scale and cell selections.

In the example below, Criterion 1 is the most important feature of the assignment and can be worth 50% of the marks for top students, whilst criterion 2 is worth 30% and Criterion 3 worth just 20%. The percentages actually earned by the students depend on the quality of their work under that criterion.

In this example here, each criterion is worth 25% of

the whole assignment. Scoring an A in a certain

criterion would give the student the full 25%, whilst

scoring a D would only give a student 10%. Anything

below a D would not be scored.

Page 4: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 4

www.sheffield.ac.uk/cics/tel

[email protected]

3. Qualitative Rubric: This Rubric is selected by choosing the ‘0’ symbol at the base of the Rubric. This type of Rubric is for entering text, describing what each grade looks like, without awarding a grade for it. As such, it is used as a guide for marking and does not interact with the grading mechanism in Turnitin GradeMark. The marker can still award a grade, but it is not done automatically through the Rubric.

Grading Forms: Whilst rubrics provide a highly-structured and comprehensive set of standards by which to evaluate student work, they can be time-consuming if all you really want to do is evaluate student work quickly, based on a set of predefined criteria or learning goals.

Turnitin’s new Grading Forms are simple rubrics that allow an instructor to give free-form feedback and scores for students spread across a list of criteria.

This would be known in UK English as a ‘Feedback

form’.

Note that Grading forms can be used without a ‘paper assignment’ being submitted, so they can be used to assess work such as a musical performance.

Page 5: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 5

www.sheffield.ac.uk/cics/tel

[email protected]

Step-by-step guide

This guide will show you how to set up rubrics and grading forms, both for immediate use

and as a template for use with further assignments.

Access your Turnitin Account through MOLE

1. Go to https://www.sheffield.ac.uk/

2. At the top of the page, log into MUSE (My University of Sheffield Environment)

3. My Services (at the top of the page again) > MOLE

4. You need to have as assignment set up, which will act as a ‘door’ to your Turnitin area. You do

not need to use a real assignment – it can just be one that you set up quickly to provide access

to Turnitin.

5. Click on Messages, which is in the top right-hand corner of the screen:

You are now in your Turnitin Account.

Go to your Library to create your Rubric or Grading Form

6. Click on Libraries > Rubric/Form Manager and then pull down the list to select ‘Create new

rubric’ OR ‘Create New Grading Form’.

Think

You will need to decide whether to use a rubric, or a grading form, or both.

Consider the advantages and disadvantages of using a rubric and a grading

form:

a) for the tutor marker

b) for the student

c) in terms of time and management of feedback

Which type of Rubric ‘scoring’ will be most appropriate for your work?

(Standard, Custom or Qualitative)

Click on View/Complete

Page 6: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 6

www.sheffield.ac.uk/cics/tel

[email protected]

7. Begin by giving your Rubric or Grading Form a name, possibly the name of the module :

e.g. MLT201 French

8a. Filling in the details of a Rubric

Begin by clicking on the Criterion headings and overtyping them. This will be items such as

Subject knowledge, Language, Ideas, Accuracy. Your headings will need to be quite short as

Turnitin only allows 13 characters.

Click onto either the from the base of the Rubric, depending on the

type of scoring you wish to choose.

Click and type over the ‘Scale’ words to define your scale (e.g. A,B,C or I, IIi, III)

Begin typing into each square to define the criteria and provide a descriptor of what each

level looks like.

Click ‘Save’ in the bottom right-hand corner

8b. Filling in the details of a Grading Form

Begin by clicking on the Criterion headings and overtyping them. This will be items such as

Subject knowledge, Language, Ideas, Accuracy. You have 30 characters.

If you want to, you can type into each box to give some details about what is covered by that

criterion.

Click ‘Save’ in the bottom right-hand corner

8.

Your Rubric / Grading Form has been created and is ready for future use.

Libraries

Rubric / Form Manager

Pull down menu > Create

New Rubric OR Create

New Grading Form

Page 7: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 7

www.sheffield.ac.uk/cics/tel

[email protected]

9. Using your Rubric or Grading Form with an assignment

Add a TurnitinUK assignment as you would normally and in the Options, go to the final section:

Pull down the list and select the name of the Rubric or Grading Form that you want to use.

Click Submit.

What your student now sees:

When your student access their assignment in MOLE, there is a place to click in order to access

the full Rubric, which will help students to know what your expectations are.

10. How to give grades and feedback using your Rubric or Grading Form

Access your assignment in the usual way:

Log into MOLE

Click on the required Module

Click on the Assignment (View/Complete)

Click on Messages

Click on Assignment In-Box

Click on the pen under the word ‘Grade’

You can then use GradeMark or your normal method of marking to examine your student’s

work.

On the right-hand side of your GradeMark window, click on the ‘grid’ icon at the base of the

column.

Page 8: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 8

www.sheffield.ac.uk/cics/tel

[email protected]

Using a Rubric:

This is the form that will be generated

when using a Rubric. The marker can

simply click on the grade for each of the

criteria and a final result out of 100 (or the

number selected by the tutor) will be

given. This can then be added to Turnitin’s

mark section and will be posted to the

student’s work.

Click on the Rubric icon at the base of the

right column in order to use your Rubric

for marking.

Page 9: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 9

www.sheffield.ac.uk/cics/tel

[email protected]

Using a Grading Form:

This shows how a tutor can enter free text

and, if required, a score. The scores will be

added together to give an overall grade

and the tutor is able to articulate feedback

as short comments or as longer text.

Page 10: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 10

www.sheffield.ac.uk/cics/tel

[email protected]

11. Attaching Criterion to notes in Grade Mark

Mark-criterion association is the ability to associate marks (bubble comments or QuickMark®

comments) on the student’s assignment with criteria in the rubric or grading form in Turnitin. The

association will appear both on the mark and on the criterion in the rubric or grading form.

Both instructors and students will see the association between marks and criteria.

12. Exporting and Importing Rubrics

If you and your colleagues are teaching the same modules, you will want to share your rubrics. You

can do this by exporting your copy and sending it to your colleague or your colleague can export one

to send to you for import.

Go to your library (MOLE > Module > Click on Turnitin Assignment > Messages > Library)

Select a Rubric or Grading Form from the pull-down list.

Go to the top right-hand corner and click on the icon to share where you will be given the

option to Import or Export

To Export: Select Export > Save as > Give your Rubric a name (it will save as a .rbc file type)

To import: Select Import>

The tutor can add a ‘Quick mark’ by

clicking into the student’s text and

then add a comment. Then using

the ‘pull-down’ menu, select the

Criterion to which the annotation

relates.

Page 11: Rubrics and Grading Forms: Improving the quality of … rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions and examples that illustrate

Error! AutoText entry not defined.

T h e U n i v e r s i t y o f S h e f f i e l d

TEL@SHEF STEP-BY-STEP

The University of Sheffield Supporting Learning through Technology

Page 11

www.sheffield.ac.uk/cics/tel

[email protected]

o Browse to locate the Rubric you would like to import

o Click on Import

o Click on the menu in the top right hand corner of the area and it will now list

your new rubric, so you can select it for opening.

Need more help?

Face-to-face training courses are available through CICS. Please see the LMS for the

latest availability or email [email protected]