rubrics and grading forms: improving the quality of … rubric: scoring rubrics include one or more...
TRANSCRIPT
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 1
www.sheffield.ac.uk/cics/tel
Rubrics and Grading Forms: Improving the quality of assessment
Preparation:
Access to a course in MOLE (My Online Learning Environment)
An assignment already set up. In order to access your Turnitin account, you will need to
have an assignment set up in a course area in MOLE. (This does not need to be a real
one – you can set one up as hidden, simply to allow you to access your Turnitin area. See
sheet on ‘Setting up an Assignment’ to see how to do this.)
Time needed: 20mins-40mins
Why use Rubrics and Grading forms?
Rubrics and Grading forms, more commonly known as marking or assessment criteria are
used to help assess how well a student has performed in a submitted piece of work across a
range of competencies. They are often used to assist in assigning a mark to that work. For
more information on using assessment criteria, please refer to LeTS (Learning and Teaching
Services) toolkit:
http://www.shef.ac.uk/lets/toolkit/f-a/assessment
In Turnitin, you can create your own assessment forms in an electronic format, which can
then be utilised in the same manner as traditional paper-based assessment criteria.
The most immediate benefits of using Turnitin Rubrics and Grading forms are:
You can make the criteria available to students, which helps them to understand
what is expected from them and why they have received the grade they have on a
piece of work
Once created, you can attach a Turnitin Rubric or Grading Form to any assignment
You can share Rubrics and Grading Forms with colleagues
Once a Rubric or Grading Form has been set up and attached to an assignment, it
allows for quicker marking
You can tailor Rubrics and Grading Forms quickly and easily to different assignments.
Terminology:
Turnitin uses American terminology, which may not be clear to new users.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 2
www.sheffield.ac.uk/cics/tel
A rubric: Scoring rubrics include one or more dimensions on which performance is rated, definitions
and examples that illustrate the attribute(s) being measured, and a rating scale for each dimension.
Dimensions are generally referred to as criteria, the rating scale as levels, and definitions as
descriptors. (Wikipedia)
This is an example of a Rubric:
Rubrics are typically created on a grid and guide students to the expected standards of the
work expected. We may call these ‘assessment or marking criteria’.
Different types of Rubrics in Turnitin
Rubrics allow for different types of scoring and there are three main types in Turnitin.
1. Standard Rubric: This rubric is selected by clicking the % symbol at the base of the
Rubric window. This means that criteria created will be weighted by a certain
percentage. There are also grading scale values available. When attached to an
assignment, this Rubric can calculate and input the overall grade within GradeMark,
based on your grading scale selections.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 3
www.sheffield.ac.uk/cics/tel
2. Custom Rubric: This Rubric is denoted by a ‘Pencil’ symbol. This type of Rubric allows you to enter any numerical and text value into the Rubric cells themselves. This allows for the most control over scoring or grading. When attached to an
assignment, this Rubric will calculate and input the overall grade within GradeMark, based on your scale and cell selections.
In the example below, Criterion 1 is the most important feature of the assignment and can be worth 50% of the marks for top students, whilst criterion 2 is worth 30% and Criterion 3 worth just 20%. The percentages actually earned by the students depend on the quality of their work under that criterion.
In this example here, each criterion is worth 25% of
the whole assignment. Scoring an A in a certain
criterion would give the student the full 25%, whilst
scoring a D would only give a student 10%. Anything
below a D would not be scored.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 4
www.sheffield.ac.uk/cics/tel
3. Qualitative Rubric: This Rubric is selected by choosing the ‘0’ symbol at the base of the Rubric. This type of Rubric is for entering text, describing what each grade looks like, without awarding a grade for it. As such, it is used as a guide for marking and does not interact with the grading mechanism in Turnitin GradeMark. The marker can still award a grade, but it is not done automatically through the Rubric.
Grading Forms: Whilst rubrics provide a highly-structured and comprehensive set of standards by which to evaluate student work, they can be time-consuming if all you really want to do is evaluate student work quickly, based on a set of predefined criteria or learning goals.
Turnitin’s new Grading Forms are simple rubrics that allow an instructor to give free-form feedback and scores for students spread across a list of criteria.
This would be known in UK English as a ‘Feedback
form’.
Note that Grading forms can be used without a ‘paper assignment’ being submitted, so they can be used to assess work such as a musical performance.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 5
www.sheffield.ac.uk/cics/tel
Step-by-step guide
This guide will show you how to set up rubrics and grading forms, both for immediate use
and as a template for use with further assignments.
Access your Turnitin Account through MOLE
1. Go to https://www.sheffield.ac.uk/
2. At the top of the page, log into MUSE (My University of Sheffield Environment)
3. My Services (at the top of the page again) > MOLE
4. You need to have as assignment set up, which will act as a ‘door’ to your Turnitin area. You do
not need to use a real assignment – it can just be one that you set up quickly to provide access
to Turnitin.
5. Click on Messages, which is in the top right-hand corner of the screen:
You are now in your Turnitin Account.
Go to your Library to create your Rubric or Grading Form
6. Click on Libraries > Rubric/Form Manager and then pull down the list to select ‘Create new
rubric’ OR ‘Create New Grading Form’.
Think
You will need to decide whether to use a rubric, or a grading form, or both.
Consider the advantages and disadvantages of using a rubric and a grading
form:
a) for the tutor marker
b) for the student
c) in terms of time and management of feedback
Which type of Rubric ‘scoring’ will be most appropriate for your work?
(Standard, Custom or Qualitative)
Click on View/Complete
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 6
www.sheffield.ac.uk/cics/tel
7. Begin by giving your Rubric or Grading Form a name, possibly the name of the module :
e.g. MLT201 French
8a. Filling in the details of a Rubric
Begin by clicking on the Criterion headings and overtyping them. This will be items such as
Subject knowledge, Language, Ideas, Accuracy. Your headings will need to be quite short as
Turnitin only allows 13 characters.
Click onto either the from the base of the Rubric, depending on the
type of scoring you wish to choose.
Click and type over the ‘Scale’ words to define your scale (e.g. A,B,C or I, IIi, III)
Begin typing into each square to define the criteria and provide a descriptor of what each
level looks like.
Click ‘Save’ in the bottom right-hand corner
8b. Filling in the details of a Grading Form
Begin by clicking on the Criterion headings and overtyping them. This will be items such as
Subject knowledge, Language, Ideas, Accuracy. You have 30 characters.
If you want to, you can type into each box to give some details about what is covered by that
criterion.
Click ‘Save’ in the bottom right-hand corner
8.
Your Rubric / Grading Form has been created and is ready for future use.
Libraries
Rubric / Form Manager
Pull down menu > Create
New Rubric OR Create
New Grading Form
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 7
www.sheffield.ac.uk/cics/tel
9. Using your Rubric or Grading Form with an assignment
Add a TurnitinUK assignment as you would normally and in the Options, go to the final section:
Pull down the list and select the name of the Rubric or Grading Form that you want to use.
Click Submit.
What your student now sees:
When your student access their assignment in MOLE, there is a place to click in order to access
the full Rubric, which will help students to know what your expectations are.
10. How to give grades and feedback using your Rubric or Grading Form
Access your assignment in the usual way:
Log into MOLE
Click on the required Module
Click on the Assignment (View/Complete)
Click on Messages
Click on Assignment In-Box
Click on the pen under the word ‘Grade’
You can then use GradeMark or your normal method of marking to examine your student’s
work.
On the right-hand side of your GradeMark window, click on the ‘grid’ icon at the base of the
column.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 8
www.sheffield.ac.uk/cics/tel
Using a Rubric:
This is the form that will be generated
when using a Rubric. The marker can
simply click on the grade for each of the
criteria and a final result out of 100 (or the
number selected by the tutor) will be
given. This can then be added to Turnitin’s
mark section and will be posted to the
student’s work.
Click on the Rubric icon at the base of the
right column in order to use your Rubric
for marking.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 9
www.sheffield.ac.uk/cics/tel
Using a Grading Form:
This shows how a tutor can enter free text
and, if required, a score. The scores will be
added together to give an overall grade
and the tutor is able to articulate feedback
as short comments or as longer text.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 10
www.sheffield.ac.uk/cics/tel
11. Attaching Criterion to notes in Grade Mark
Mark-criterion association is the ability to associate marks (bubble comments or QuickMark®
comments) on the student’s assignment with criteria in the rubric or grading form in Turnitin. The
association will appear both on the mark and on the criterion in the rubric or grading form.
Both instructors and students will see the association between marks and criteria.
12. Exporting and Importing Rubrics
If you and your colleagues are teaching the same modules, you will want to share your rubrics. You
can do this by exporting your copy and sending it to your colleague or your colleague can export one
to send to you for import.
Go to your library (MOLE > Module > Click on Turnitin Assignment > Messages > Library)
Select a Rubric or Grading Form from the pull-down list.
Go to the top right-hand corner and click on the icon to share where you will be given the
option to Import or Export
To Export: Select Export > Save as > Give your Rubric a name (it will save as a .rbc file type)
To import: Select Import>
The tutor can add a ‘Quick mark’ by
clicking into the student’s text and
then add a comment. Then using
the ‘pull-down’ menu, select the
Criterion to which the annotation
relates.
Error! AutoText entry not defined.
T h e U n i v e r s i t y o f S h e f f i e l d
TEL@SHEF STEP-BY-STEP
The University of Sheffield Supporting Learning through Technology
Page 11
www.sheffield.ac.uk/cics/tel
o Browse to locate the Rubric you would like to import
o Click on Import
o Click on the menu in the top right hand corner of the area and it will now list
your new rubric, so you can select it for opening.
Need more help?
Face-to-face training courses are available through CICS. Please see the LMS for the
latest availability or email [email protected]