<P ALIGN=CENTER><B>Administration</B></P>
-<p>The first table on this screen shows how the the overall grades for the
- submissions are calculated. The overall grades are a weighted sum of
- two components.</p>
-
-<ol><li>The teacher's grade for the student's (initial) assessment of their own work.
- This can be termed the "grading grade". Once the student has
- submitted their work the assessment is not revised. The student is NOT asked
- to re-assess their work each time they resubmit their work. The grade given to
- student's assessment is relavant to the student's performance but it is not as
- important as the (teacher's) assessment of the work. In general it should be
- given a lower weight than...
-<li>The grade given by the teacher to the student pieces of work. These
- assessments are the normally the main assessment element of an exercise
- assignment. When the students are allowed to make
- more than one submission the teacher can decide whether the final grade
- for the exercise should be the average grade of a student's submissions or
- the grade from the student's best submission.
-</ol>
+<p>This page allows the teacher to see the one or more descriptions for the
+ Exercise, the student assessments and the student submissions. These items
+ can be retitled, viewed or deleted by using the various links on the page.
+ The page also shows which piece of works have been submitted after the
+ deadline, that is those submitted late.</p>
-<p>These two components are weighted as deemed appropriate for the
- assignment. The teacher can, for example, weight the (initial) assessment grade
- (the grading grade) very low, even zero. In this case the student grade is
- determined largely by or entirely by the grades given to their submissions. The
- two weighting factors can be changed at any time during the exercise, the effect
- of any change on the grades seen in the Grades page and in the Final Grades
- list is immediate.</p>
+<p>The first table on this screen shows the teacher's submission(s). Normally
+ there is only one. This is the decsription of the exercise, it will
+ normally contain instructions on what work should be done. If the teacher
+ has submitted more then one description they are listed here. Note that
+ once the Exercise is underway these submissions should <b>NOT</b> be
+ deleted. It is, however, safe to delete the teacher submissions while the
+ Exercise is still in the Set Up phase.</p>
-<p>The second table is used to set the two options for the League Table. This table
- is (optionally) shown to the students at the end of the assignment. If the
- number of entries is set to a number larger than zero then the table is
- displayed to the student when the assignment is in its final phase. The other
- option determines whether student names are shown in the table. Note the League
- Table as seen by the teacher always shows studnet names regardless of this setting.
+<p>The second table shows the student's (initial) assessment of their own work.
+ It shows the grade the student has given their work. If the teacher has
+ assessed the work, this table will also contain the "grading
+ grade" awarded to his assessment. This grade reflects how well the
+ student's assessment agrees with the teacher's assessment. The student's
+ assessment can be viewed. There is link on that page to change the grading
+ grade should the teacher wish to do so.</p>
+
+<p>The third table lists the submissions and their grades if the teacher has
+ assessed them. Submissions can be regraded or safely deleted. An asterix
+ (*) against a submission means that the student is allow to submit another
+ piece of work. For a particular student, this option can be easily changed
+ by simply re-assessing their submission and clicking on the appropriate
+ button at the foot of the assessment page, the assessment itself need not
+ be changed. Late work is shown with the date submitted in red. The late
+ flag can be cleared by clicking on the link.</p>
-<p>The Administration page also lists the teacher's submissions (the decriptions of
- the Exercise), the students' (initial) assessment of their own work, and the students'
- submissions. These tables allow all these items, where appropriate, to be re-titled,
- deleted, viewed or re-assessed. This part of the page can be used to monitor the
- students' progress throughout the course of the exercise.
-</p>
--- /dev/null
+<p align="center"><b>Comparison of Assessments</b></p>
+
+<p>In an exercise it is usual for a piece of work to be assessed twice. A
+ student assesses their work before submitting it and the teacher then
+ (re)assesses the work. The teacher's assessment uses the student's
+ assessment as the starting point. An exercise allows the teacher to award
+ a proportion of the grade to the student's assessment, the remainder of
+ the grade is allocated to the teacher's assessment of the work. (The
+ maximum grades for these are called "Grade for Student
+ Assessments" and "Grade for Submissions" respectively.) Note
+ that the grade from the student's assessment is not used. The student's
+ assessment is given a grade based on how well it matches the teacher's
+ assessment.</p>
+
+<p>The degree of agreement between the student's and teacher's assessment is
+ based on the differences between the scores in individual elements
+ (actually the squared differences are used). The mean of these differences
+ must to converted into a meaningful grade. The "Comparison of
+ Assessments" option allows the teacher a degree of control on how
+ these comparisons are converted into grades.</p>
+
+<p>To get some idea on what effect this option has, take the (fairly simple)
+ case of an assessment which has ten Yes/No questions. For example the
+ assessment might use questions like "Is the chart correctly formatted?",
+ "Is the calculated profit $100.66?", etc. Assume there are ten such
+ questions. When the "Very Lax" setting is chosen, prefect
+ agreement between the student's and teacher's assessment gives a grade of
+ 100%, if there is only one question which does not match the grade is 90%,
+ two disagreements give a grade of 80%, three
+ disagreements 70%, etc.. That might seem very reasonable and you might be thinking
+ why is this option called a "Very Lax" comparison. Well, consider
+ the case of a student doing a completely random assessment where the
+ answers of the ten questions are simply
+ guessed. On average this would result in five of the ten questions being
+ matched. So the "monkey's" assessment would get a grade of around
+ 50%. The situation gets a little more sensible with the "Lax"
+ option, then
+ the random assessment gets around 20%. When the "Fair" option is
+ chosen, random guessing will result in a zero grade most of the
+ time. At this level, a grade of 50% is given when the two assessments agree
+ on eight questions of the ten. If three questions are in disagreement then
+ the grade given is 25%. When the option is set to "Strict" having
+ two questions out of sync gives a grade of 40%. Moving into the "Very
+ Strict" territory a disagreement in just two questions drops the grade to
+ 35% and having a single question in disagreement gives a grade of 65%.</p>
+
+<p>This example is sightly artifical as most assessments usually have elements
+ which have a range of values rather than just Yes or No. In those cases the
+ comparison is likely to result in somewhat higher grades then the values
+ indicated above. The various levels (Very Lax, Lax, Fair...) are given so
+ that the teacher can fine tune the comparisons. If they feel that the grades
+ being given for assessments are too low then this option should be moved
+ towards the "Lax" or even "Very Lax" choices. And
+ alternatively, if the grades for the student's assessments are, in general,
+ felt to be too high this option should be moved to either the
+ "Strict" or "Very Strict" choices. It is really a
+ matter of trial and error with the best starting point being the
+ "Fair" option.</p>
+
+
it is helpful to give details of what is considered excellent, average
and poor.
-<LI>The SCALE of the assessment element. There are a number of prefined
+<LI><p>The SCALE of the assessment element. There are a number of prefined
scales. These range from simple Yes/No scales, through multipoint scales to
a full percentage scale. Each element has its own scale which should be choosen
to fit the number of possible variations for that element. Note that the scale
- does NOT determine the element's importance when calculating the overall
+ does NOT determine the element's importance when calculating the overall
grade, a two point scale has the same "influence" as a 100 point
- scale if the respective elements have the same weight...
+ scale if the respective elements have the same weight...</p>
+
+ <p>If custom scales are set up in the course, these can be used. Note,
+ however, that this type of scale is used as a multi-point scale and that
+ only the first and last items of the scale are shown. For example, if the
+ custom scale "Very Wet, Wet, Damp, Dry" is created in the course,
+ this can be used and it will be shown as a four point scale labeled
+ "Very Wet" at one end of the scale and "Dry" at the
+ other.</p>
<LI>The WEIGHT of the assessment element. By default the elements are given the same
importance when calculating the overall grade of the assignment. This can be
two levels, others have three, up to five levels. The criteria can be weighted. The levels
are scored 0, 1, 2, up to 4. The grade for the assessment is a weighted sum of these
scores.
-</P>
\ No newline at end of file
+</P>
<p>The table on this screen lists the overall grades and their breakdown. The first grade is
the grade for the (inital) assessment. This is added to the grades given to each
- submission. The Weights row gives the factors used in the calculation of the overall
- grade from these two grades. The final grade given for this assignment will either be
+ submission. The final grade given for this assignment will either be
the average of these overall grades or the overall grade of the best submission.
<p>The League table optionally lists the best submissions. The number of entries in
- the table is set on the Administration page, if that number is set to zero then
+ the table is set as one of the Exercise parameters. If that number is set to zero then
the League Table is not displayed. The table is in grade order with the best submission
first. Only a student's best submission is shown in the table.</p>
-<p align="center"><b>The Grade of the Exercise</b></p>
+<p align="center"><b>The Grade of the Submissions</b></p>
-<p>This value determines the maximum grade which can be awarded in
- the exercise. The range is 0 to 100%.. This value can be changed at
- any time during the exercise. Any change has an immediate effect in
- the Grades page, the grades given to assessments and submissions and the
- display of the final finals and the League Table (if the assignment is
- in that phase).</p>
+<p>This value determines the maximum grade which can be awarded to a submission.</p>
+
+<p>The overall grade for the exercise is the sum of the grade of the student's
+ assessment and the grade from their submissions. Thus if the (maximum)
+ grade for the student's assessment is set to 30 and the (maximum) grade for
+ submissions is 70 the (maximum) grade for the exercise is 100.</p>
+
+<p>This value can be changed at any time and the effect on the grades seen by
+ the students (and the teacher) is immediate.</p>
+
it, you will <b>not</b> be asked to re-assess your "new" piece of
work. You only make this assessment "first time round".</p>
-<p>This (initial) assessment of your work is looked at by the teacher and they
- can add comments and grade it. You will be able to see these comments and
- the grade given to your assessment may form part of the final grade you
- receive from this Exercise.</p>
+<p>This (initial) assessment of your work is compared to the teacher's
+ assessment of your work. The closer the two assessments match the higher
+ will be your "grading grade". This grade is usually a smaller
+ grade than the grade you are given for your work. The final grade for the
+ exercise is these two grades added together.</p>
+
+<p>Once you have submitted your own work the teacher will grade it using the
+ same assessment form. You will be able to see their scores for your work
+ and their comments. Their grade will normally form the main part of the
+ final grade you receive from this Exercise.</p>
<p><b>For the Teacher</b></p>
-<P ALIGN=CENTER><B>Grading of Assessments</B></P>
+<p align=center><b>Grade of Student Assessments</b></p>
-<p>In the first half of this page the Student Assessment of their own work is shown.
- This assessment should be graded (out of a maximum of 20). It represents an
- assessment of the work shown in the second of the Link boxes. (The topmost
- link box is the description of the exercise itself.) The "Grading Grade"
- should normally be explained in a comment which you enter in the Teacher's
- Comment box. The grade should reflect the accuracy of the assessment, an
- assessment which gives a low grade to a poor piece of work should receive
- a higher Grading Grade than one which gives a low mark to a good piece of
- work, for example.</p>
+<p>This is the maximum grade given to the assessments make by students of their
+ own work. That is, the grade for their self assessments. The actual grades
+ for the assessments are calculated by the exercise module by comparing the
+ student's assessment with the teacher's assessment. This grade is a
+ "grading grade" and is <i><b>not</b></i> the maximum grade given
+ to the work, that grade is called "Grade for Submission".</p>
+
+<p>A student's grade for the exercise is the sum of this grade and the grade
+ for their submission(s). Thus if the (maximum) grade for the Student
+ assessments is set at 20 and the (maximum) grade for submission is set to
+ 80, then the (maximum) grade for the exercise is 100.</p>
+
+<p>This value can be changed at any time and the effect on the grades seen by
+ the students (and the teacher) is immediate.</p>
-<p>In the second half of this page there is a blank Assessment Form for your
- own assessment of the piece of work from the student.</p>
-
\ No newline at end of file
it is helpful to give details of what is considered excellent, average
and poor.
-<LI>The SCALE of the assessment element. There are a number of prefined
+<LI><p>The SCALE of the assessment element. There are a number of prefined
scales. These range from simple Yes/No scales, through multipoint scales to
a full percentage scale. Each element has its own scale which should be choosen
to fit the number of possible variations for that element. Note that the scale
does NOT determine the element's importance when calculating the overall
grade, a two point scale has the same "influence" as a 100 point
- scale if the respective elements have the same weight...
+ scale if the respective elements have the same weight...</p>
+
+ <p>If custom scales are set up in the course, these can be used. Note,
+ however, that this type of scale is used as a multi-point scale and that
+ only the first and last items of the scale are shown. For example, if the
+ custom scale "Very Wet, Wet, Damp, Dry" is created in the course,
+ this can be used and it will be shown as a four point scale labeled
+ "Very Wet" at one end of the scale and "Dry" at the
+ other.</p>
<LI>The WEIGHT of the assessment element. By default the elements are given the same
importance when calculating the overall grade of the assignment. This can be
--- /dev/null
+<p align=center><b>League Table</b></p>
+
+<p>This option controls the display of a League Table at the end of the
+ exercise. If displayed, the league table displays a list of the best pieces
+ of work submitted in the exercise. If the number of entries is set to zero
+ then a League Table is not displayed in the last phase of the exercise.</p>
+
--- /dev/null
+<p align=center><b>League Table Names</b></p>
+
+<p>This option controls whether the student's names are displayed in the League
+ Table shown at the end of the exercise. By default names are not shown,
+ that is, the table is anonymous.</p>
+
<p>Before the students can submit their work they must complete the assessment
form. Once they have completed the assessment they are shown the upload form.
- The students can revise their work in the light of their self assessment. The teacher
- sees student's (self) assessment and an assessment form to grade the student's
- submission. This is a "dual assessment form". At the end of this
- form the teacher can either ask the student to re-submit the work or not.</p>
+ The students can revise their work in the light of their self assessment.
+
+<p>Once student work has been submitted the teacher can begin assessing it. The link "Student Submissions for Assessment" displays a page showing those peices of work which have not been assessed. The oldest submission is at the top of the page. The assessment form for each of these submissions is initially based on the student's own assessment of their work. The teacher can change those assessments and add any comments. At the end of the two buttons let the teacher decide whether the student can re-submit the work or not.</p>
-<p>If the student chooses to re-submit, the teacher can re-assess the work. The
+<p>If the teacher has decided to allow the student to re-submit and they have done so, the teacher is how the new piece of work. In this case the assessment form will contain the teacher's old assessment. The
same option, re-submit or not, allows the teacher to control this cycle of
re-submission and assessment. If students are allowed to put in multiple pieces
of work into the Exercise, the teacher should decide whether the final grades
the students examples of the best pieces of work submitted...</p>
<p>The students (and the teacher) can also be shown a "League Table"
- of the student submissions. These are listed in order of grade, the top submission
- is first. Here the grade given to the submission is teacher's
- grade. If a student submitted more than one piece of work only their best piece
- of work is shown in this table. If the number of entries in the table is set to
- zero then this table is not displayed.</p>
+ of the student submissions. These are listed in order of grade, the top
+ submission is first. Here the grade given to the submission is teacher's
+ grade. If a student submitted more than one piece of work only their best
+ piece of work is shown in this table. If the number of entries in the table
+ is set to zero then this table is not displayed.</p>
</ol>
-<p>The student's grade is a weighted combination of the teacher's grading of their
- (initial) assessment and the teacher's grading of their work. The two weighting
- factors are initally set to unity. They can changed (on the Administration page)
- at any time during the exercise and the grades shown both the students and the
- teacher always reflect the current weighting factors.</p>
+<p>The student's grade for the Exercise is the sum of their grading grade of
+ their (initial) assessment and the grade for their submission(s). The
+ maximum values for these grades are given when the Exercise are set up.
+ However, these maximum values can be changed (by updating the Exercise)
+ at any time during the exercise and the grades shown both the students
+ and the teacher always reflect the current maximum values.</p>
<p>At any phase of the assignment the teacher can open the "Administration"
- page. This shows the current values of the two weighting factors and allows the teacher
- to change them. It lists the students' assessments (of their own work) and the
+ page. It lists the students' assessments (of their own work) and the
submissions of the students. The teacher can use this page to assess and re-assess
- submissions, grade and re-grade assessments, delete submissions and assessments,
+ submissions, re-grade assessments, delete submissions and assessments,
and generally watch the progress of the assignment.</p>
<IMG VALIGN=absmiddle SRC="<?php echo $CFG->wwwroot?>/mod/exercise/icon.gif"> <B>Exercise</B>
<UL>
-<P>An Exercise is a simple but powerful assignment. In an exercise the teacher
-asks the students to do a piece of practical work. It could be writing an essay
-or a report, preparing a presentation, or setting out a spreadsheet, etc. When
-the student has done the task they must first self-assess their work before
-submitting it to the teacher. Once submitted the teacher can assess both the
-student's assessment and the piece of work itself. The teacher can give
-feedback to the student and ask the student to improve the work and re-submit
-it or not as the case may be.</p>
+<P>An Exercise is a simple but powerful assignment. In an exercise the teacher asks the students to do a piece of practical work. It could be writing an essay or a report, preparing a presentation, etc. When the student has done the task they must first self-assess their work before submitting it to the teacher. Once submitted the teacher assesses the piece of work itself. The teacher can give feedback to the student and ask the student to improve the work and re-submit it or not. The final grade is based on how well the student assessed their own work and the work itself.</p>
</UL>
<IMG VALIGN=absmiddle SRC="<?php echo $CFG->wwwroot?>/mod/exercise/icon.gif"> <B>Exercise</B>
<P>An Exercise is a simple but powerful assignment. In an exercise the teacher
-asks the students to do a piece of practical work. It could be writing an essay
-or a report, preparing a presentation, or setting out a spreadsheet, etc. When
-the student has done the task they must first self-assess their work before
-submitting it to the teacher. Once submitted the teacher can assess both the
-student's assessment and the piece of work itself. The teacher can give
-feedback to the student and ask the student to improve the work and re-submit
-it or not as the case may be.</p>
+ asks the students to do a piece of practical work. It could be writing an
+ essay or a report, preparing a presentation, or setting out a spreadsheet,
+ etc. When the student has done the task they must first self-assess their
+ work before submitting it to the teacher. Once submitted the teacher can
+ assess both the student's assessment and the piece of work itself. The
+ teacher can give feedback to the student and ask the student to improve
+ the work and re-submit it or not as the case may be. The final grade is
+ based on how well the student assessed their own work and the work itself.</p>
<p>Before the start of the exercise the teacher sets up the exercise by
<ol> <li>Creating a Word document or HTML file which introduces the exercise
<li>Adding the textual elements and choosing the options in the Assessment
Form. This form is used by both the students and the teacher to assess the
work produced in the exercise. There are various types of assessment
- which can be used (see the help on "Grading Stratgey")
+ which can be used (see the help on "Grading Stratgey")
</ol></p>
<p>In large classes, the teacher may find to helpful to create more than one version
their work and the assessment before they actually submit their work, and
probably they should be encouraged to do so!</p>
-<p>Once a student has submitted their work both their assessment and the
- piece of work itself becomes available to the teacher. The assessments can be
- graded and there is a box for comments. The teacher can also access the piece
- of work (using the student's assessment as a starting point) and make a
- decision whether to ask the student to re-submit an improved version of the
- work or not.</p>
+<p>Once a student has submitted their work both their assessment and the piece
+ of work itself becomes available to the teacher. The teacher accesses the
+ pieces of work (using the student's assessment as a starting point) and
+ make a decision whether to ask the student to re-submit an improved
+ version of the work or not.</p>
<p>If the teacher feels that the student's piece of work could be improved, the
student can be given the opprtunity to re-submit. If this is taken up the
of a final grades.</p>
<p>When all the submissions have been graded, the exercise is moved to the
- final phase. Further student submissions are now not allowed. The students
- can now see their final grades together with the grades given to
- their submissions. A student's grade for the exercise is a weighted combination
- of the teacher's grade for their self-assessment and the teacher's grade for that
- work. (The grade given by the student is <b>not</b> used.) For the submissions
- themselves the grade is teacher's assessment. The weights used for the two
- grades (the grading grade and the actual grade for the work) can be set and
- changed at any time during the assignment (the weights are set on the
- Administration page).</p>
+ final phase. Further student submissions are now not allowed. The students
+ can now see their final grades together with the grades given to their
+ submission(s). A student's grade for the exercise is the sum of the
+ student's "grading grade", a measure of the agreement between
+ the student's assessment and the teacher's assessment of the student's
+ (first) submission, and the teacher's grade(s) for the student's
+ submission(s). (The grade given by the student in their assesment is
+ <b>not</b> used.) </p>
<p>When the teacher allows students to resubmit work, the teacher should
consider how to set the option which controls how the student's final grade
<P ALIGN=CENTER><B>Number of Comments, Elements, Bands, Criteria or Rubrics</B></P>
-<P>The number entered here determines how many items will be used in
+<p>The number entered here determines how many items will be used in
the assessments. Depending on the type of grading strategy, this number
gives the number of comments, assessments elements, bands, criteria or
categories (sets) of criteria in a rubric. Typically an assignment will have
- something between 5 to 15 assessment items, the
- actual number depending on the size and complexity of the assignment.
+ something between 5 to 15 assessment items, the actual number depending on
+ the size and complexity of the assignment.</p>
<p>During the set up phase of the exercise this number can safely be adjusted.
- Increases the number will cause extra blank elements to be displayed in the
- asessemnt form. Reducing the number will remove elements from the end
+ Increasing this number will cause extra blank elements to be displayed in the
+ asessemnt form. Reducing this number will remove elements from the end
of the assessment form.</p>
-<P>All assessments have a General Comments field. For a "No
+<p>All assessments have a General Comments field. For a "No
Grading" assignment the value given here determines the
number of additional comment areas. It can be specified as zero and results
- in the assessment having only a single General Comments area.
-
-</P>
+ in the assessment having only a single General Comments area.</p>
+
projects / moodle.git / commitdiff