Loop: Course & Module Evaluation

loop-banner-bilingual_TEACHpage_875px.jpg

Loop is the new web application for delivering course and module evaluation to students and reporting tools for staff.

It replaces the previous use of Blackboard and QuestionMark Perception (QMP).

The main features and benefits of this new system are:

  • A single url gives you easy access to the tool, wherever you are: http://loop.southwales.ac.uk
  • 'Always on’ service for students so your learners can review their courses and modules throughout the academic year.
  • Works for all USW students. Using the single url, all students, including franchise and those on cross-sessional programes (for example, February or March intakes) can log in and evaluate their modules and course(s).
  • Responsive design, which means Loop is ideal for you to use with mobile devices.
  • Reduced question sets simplify the choices In comparison to previous years, making it quicker and easier to use, and less confusing or daunting for your students:

    1) Course evaluation consists of 11 Likert-scale questions with 1 open text question.
    2)Module evaluation consists of 5 Likert questions with 3 open text questions.

  • Reporting functionality is adapted to your role
    1)Course and module reporters
    2)School and Faculty reporters

  • Special features for reporting at a Course level
    1)Uses a Red/Amber/Green 'RAG’ rating system to quickly highlight overall performance.
    2)Access to qualitative feedback from students.

Students logging into Loop will be shown a list of courses and modules which they are currently enrolled on.

Loop_Student_Dashboard_031116.jpg

The student dashboard shows the titles of the courses and modules and the current year of course study. It also shows the date of the last evaluation received against an 'Evaluate’ button.

There is also a language-switcher which swaps the interface between Welsh and English.

Theme: The teaching on my course


1. Staff are good at explaining things.

2. Staff have made the subject interesting.

3. The course is intellectually stimulating.

4. My course is challenging me to achieve my best work.


Theme: Learning opportunities


5. My course is providing me with opportunities to explore ideas or concepts in depth.

6. My course is providing me with opportunities to apply what I have learnt.


Theme: Assessment and Feedback


7. The criteria used in marking have been clear in advance.

8. Marking and assessment has been fair.

9 Feedback on my work has been timely.

10. I have received helpful comments on my work.


Theme: Academic Support


11. I have been able to contact staff when I needed to.

12. I have received sufficient advice and guidance in relation to my course.


Theme: Organisation and Management


13. The course is well organised and is running smoothly.

14. The timetable works efficiently for me.


Theme: Learning resources


15. The IT resources and facilities provided have supported my learning well.

16. The library resources (e.g. books, online services and learning spaces) have supported my learning well.

17. I have been able to access course-specific resources (e.g. equipment, facilities, software, collections) when I needed to.


Theme: Learning community


18. I feel part of a community of staff and students.

19. I have had the right opportunities to work with other students as part of my course.


Theme: Student Voice


20. The students’ union (association or guild) effectively represents students’ academic interests.


Theme: Overall Satisfaction


21. Overall, I am satisfied with the quality of the course.

22. What one thing would you change about your experience so far at the University of South Wales?

Theme: The teaching on my course


1. Staff are good at explaining things.

2. Staff have made the subject interesting.

3. The course is intellectually stimulating.

4. My course is challenging me to achieve my best work.


Theme: Learning opportunities


5. My course is providing me with opportunities to explore ideas or concepts in depth.

6. My course is providing me with opportunities to bring information and ideas together from different topics.

7. My course has provided me with opportunities to apply what I have learnt.


Theme: Assessment and Feedback


8. The criteria used in marking have been clear in advance.

9. Marking and assessment has been fair.

10. Feedback on my work has been timely.

11. I have received helpful comments on my work.


Theme: Academic Support


12. I have been able to contact staff when I needed to.

13. I have received sufficient advice and guidance in relation to my course.

14. Good advice was available when I needed to make study choices on my course.


Theme: Organisation and Management


15. The course is well organised and is running smoothly.

16. The timetable works efficiently for me.

17. Any changes in the course or teaching have been communicated effectively.


Theme: Learning resources


18. The IT resources and facilities provided have supported my learning well.

19. The library resources (e.g. books, online services and learning spaces) have supported my learning well.

20. I have been able to access course-specific resources (e.g. equipment, facilities, software, collections) when I needed to.


Theme: Learning community


21. I feel part of a community of staff and students.

22. I have had the right opportunities to work with other students as part of my course.


Theme: Student Voice

23. I have had the right opportunities to provide feedback on my course.

24. Staff value students’ views and opinions about the course.

25. It is clear how students’ feedback on the course has been acted on.

26. The students’ union (association or guild) effectively represents students’ academic interests.


Theme: Overall Satisfaction


21. Overall, I am satisfied with the quality of the course.

22. What one thing would you change about your experience so far at the University of South Wales?

Theme: Module Experience


1. I am satisfied with my experience on this module.

2. Please let us know which one thing you would change about your experience on this module?

All staff logging into the system will be presented with a dashboard which shows a list of modules and courses. The number of evaluation responses received are shown and can be accessed by clicking the blue Responses box.

course_and_module_dashboard.jpg

For course and module reporters the reporting screen will appear as follows:

course_reporting_module_and_course_example.jpg

Course and module reporters can choose to filter on the following fields:

In the Report tab

  • Date range
  • Course Type
  • Year of study
  • Include final year

In the Instance tab

  • Academic Session
  • Campus Location
  • Mode of Study

Academic Subject Managers and Heads of School are classified as School Reporters and can monitor progress and report on courses and modules aligned to subjects in a school via the dashboard.

For school reporters the dashboard will appear as follows:

school_dashboard.jpg

For school reporters the reporting screen will appear as follows:

course_reporting_school_and_faculty_example.jpg

School reporters can choose to filter on the following fields:

The Report tab

  • Date range
  • Subject
  • Course Type
  • Year of study
  • Include final year

The Instance tab

  • Academic Session
  • Campus Location
  • Mode of Study

The Person tab

(please note that in order to ensure anonymity for students these filters are only available when searching multiple courses/modules)

  • Gender
  • Age
  • Residential Status

DeansDeputy DeansHeads and Assistant Heads of Faculties are classified as Faculty Reporters and can report on progress and report on courses and modules aligned to subjects in multiple schools within a faculty.

For faculty reporters the dashboard will appear as follows:

faculty_dashboard.jpg

For faculty reporters the reporting screen will appear as follows:

course_reporting_school_and_faculty_example.jpg

Faculty reporters can choose to filter on the following fields:

The Report tab

  • Date range
  • School
  • Subject
  • Course Type
  • Year of study
  • Include final year

The Instance tab

  • Academic Session
  • Campus Location
  • Mode of Study

The Person tab

(please note that in order to ensure anonymity for students these filters are only available when searching multiple courses/modules)

  • Gender
  • Age
  • Residential Status

In relation to the list of modules and courses you see when you log into the Loop system:

  • The list is based on the information held on ICIS and shows modules and courses with a currently valid specification where staff are listed as a ‘Course Leader’, Module Leader or ‘Contributor’.
  • You can amend staff details in ICIS directly from Loop by selecting the linked code shown in brackets.
  • If you can’t see a course or module and believe you need to be added to ICIS then for Course corrections contact your Quality Administrator and for Module corrections contact the Module Leader.

Likert scale and Red/Amber/Green 'RAG’ rating system

The key section shows the colour coding used to denote responses and the Rag-rating icons used.

Note that the Rag-rating applies only to the first question for course reports (overall satisfaction). The system agregates all the positive responses and displays a score. This is the same scoring as used in the NSS.

loop_RAG_sytem.jpg

Roll over the bar for more detail.

Loop_roll_over_detail.jpg

loop_view_edit_filters.jpg

  • Edit Filters button – Use this button to return to the report builder screen while keeping all the selected filters in place. (Note that if you use the browser’s ‘back’ button all filters will be lost).
  • View Filters – Use this collapsible page element to reveal the filters chosen for the report.

Question response section

The main body of the report shows the responses to each question with a row for each Course, Module, School or Subject (depending on the users role and the report chosen).

Course report (example)

If a number of individual courses are selected, the course report will display a row for each course selected whilst at the top the cumulative total for all courses selected is displayed.

loop_course_report_example.jpg

On roll-over, the responses received are now expressed as a ratio of the total number of students enrolled and as a percentage (NEW FEATURE).

Module report (example)

The module report has all the features of the course report, however the module responses received are broken down into the course instances where that module is taught. Remember though that this will only be from course instances where evaluations have been received.

loop_module_report_example.jpg

The text (or Freetext) comments received will only be shown when individual courses or modules have been selected (boxes ticked) in Step 2 of the reporting process.

loop_step2_reporting_process.jpg

Note that if “all’ has been chosen during this step then text comments are not shown.

loop_text_comments.jpg

For a Module Report the text comments are grouped by the course instance the students are enrolled on, for example:

loop_course_qualitative_feedback.jpg

NEWS AND UPDATES

Catch up on improvements and new features:

Additional features to be released:

  • Output to .csv
  • Blackboard module and Course Organisation integration
  • Welsh language switch for staff reporting
  • Technical changes to improve performance
  • Number of responses received to be shown in the Report builder screen
  • A method of reminding non-completers with a chase email