Acceptance Tests and Outcomes

Test Case 01:Web Based Interface

PASS

Test Description: Access to web interface via EASE Authentication

Date tested: 02/03/16 additonal testing June 2016

Tested by:  Stephannie Hay / Wesley Kerr / Crystal Webster

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

1.1

1.2, 1.3

MUST

Log into application URL using EASE.

User logs in without any error messages and is taken to the appropriate screen.

 PASS

Grouper not intituitive need to use Hugh Brown's wiki and make documentation

Pass by all testers

1.2

1.1

MUST

User searches for and selects a course to create.

User can start to free type/paste an ID into the search box and a list of course to select from appears, user can then select the relevant course.

 PASS

Problems with the search for users as the whole list appears including 2009 courses when typing keyword.

The scroll doesn't allow you to scroll down to latest courses, need to use the course code and year.

Pass by all testers

1.3

1.1

MUST

User searches for and selects a course to create, the cancels out of the process.

User can start to free type/paste an ID into the search box and a list of course to select from appears, user can then select the relevant course then unselect the course/cancel process as required.

 PASS

No cancel button, have to navigate away from the Add Members option.

This can be done, note that no prompt to say you are navigating away from data appears.

Pass by all testers

Test Case 02: Creation of Courses

PASS (exception 2.3)

Test Description: Create a course in Moodle

Date tested: 02/03/16 , 10/03/16 and June 2016

Tested by: Stephannie Hay (Wesley Kerr and Crystal Webster did not test mainly relate to lack of available data/time)

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

2.1

2.1, 2.4, 2.5

MUST

User searches for, selects and then clicks create within application.

Within Moodle the course should be created with the relevant information added into the correct fields. The course is then visible within Moodle and is linked to the correct course category. It can be viewed through the course category tree or searched for.

PASS

Course ID is in a different format to previous version.

In 2015-16 created Children, Education and Social Justice, Mathematics in Primary Education and in 2016/17 created Land Use and Food Security.

Pass by all testers

2.2

2.1, 2.4, 2.5

MUST

Test the scenario where a course is delivered twice a year:

• User searches for a course that is delivered in semesters 1 and 2, selects the first one and creates within application. User then searches for the semester 2 course, selects and creates that course in the application.

Within Moodle two distinct courses will be created with the relevant course information in the correct fields. The courses are then visible within Moodle and are linked to the correct course category. They can be viewed through the course category tree or searched for.

PASS

Passed  by Stephanie Hay

Wesley Kerr and Crystal Webster did not test mainly relate to lack of available data/time

2.3

2.3 - 2.5

MUST

User adds Resource List block to course that has been automatically created in Moodle. Any Talis Resource Lists appear in the block. The block matches courses to resource lists in Talis using the course code, the user should not need to do anything.

FAIL

This was expected. We can either do the work now on the building block or wait until Service Management confirm how the course code will appear within Grouper - JIRA TEL025-24 added for reference

Test Case 03: Creation of Accounts

PASS

Test Description: Accounts are created for student and staff members who do not exist on Moodle.

Date tested: 02/03/16, June 2016

Tested by: Stephannie Hay, Wesley Kerr, Crystal Webster

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

3.1

3.1, 3.2, 4.1

MUST

When a user creates a course and enrolments any user not already in Moodle has an account created.

New user accounts will be created and can be searched for within Moodle. All specified fields are filled in and the authentication method is Shibboleth.

FAIL

(PASS)

Not all students were created

TEL025-13

Retested and passed by all testers

Test Case 04: Create Enrolments

PASS

Test Description: Users are enrolled on courses as required

Date tested: 02/03/16, 10/03/16, June 2016

Tested by: Stephannie Hay, Wesdley Kerr, Crystal Webster

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

4.1

4.2, 4.3

MUST

When a user selects a course to be created in Moodle the enrolments as they stand are created in Moodle. If any users need accounts created they are created, see test 3.1.

Enrolments are added into Moodle with the correct roles e.g. Student or Instructor on the relevant courses.

FAIL

(PASS)

Only 2 students and the course owner enrolled

TEL025-13 created

Retested and passwed by all testers

4.2

4.4

MUST

Newly enrolled students users have been added to the Student Help course.

Newly enrolled students have been added as students onto the Student Help course unless already enrolled.

PASS

2 newly created students not on student help course

TEL025-14 created

Retested 10/03/16 Enrolled as a student. Daniel Lee s1226252

4.3

4.4

MUST

Newly enrolled staff users have been added to the Staff Help course.

Newly enrolled staff users have been added as students onto the Staff Help course unless already enrolled.

PASS

The new course owner not on staff help course

TEL025-14 created

Retested 10/03/16 Enrolled as a student. Tom MacIntyre, Lauren Sandford and Sharron Ogle

Wesley Kerr / Crsytal did not test relates to lack of available data and Time

Test Case 05: Update Enrolments

PASS

Test Description: If enrolments are updated in EUCLID the changes are reflected in Moodle

Date tested: 10/03/16, June 2016

Tested by: Stephannie Hay

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

5.1

5.1

MUST

Update enrolments

Enrolments are updated, new students added as expected to the relevant courses.

FAIL

(PASS)

New students added via Test EUCLID and wasn't added (s1444984) and (s1441815), interestingly they are in Grouper. However, the feed is populated by EUGEX not Grouper.

TEL025-21 created

Retested and passed by Stephanie Hay and Wesley Kerr, Crystal Webster did not test relates to lack of available data / time

5.2

5.2

MUST

Delete enrolments

Where a student is removed from a course in EUCLID a student is then removed from the course within Moodle

FAIL

(PASS)

2 students removed. 1 from Test EUCLID (s1337383) and 1 by me in Grouper (s1334397) neither removed from course and Lucy (s1337383) is still in Grouper. Of course realised that removing student in Grouper won't work as enrolments coming from EUGEX

TEL021-22 Created

Retested and passed by Stephanie Hay and Wesley Kerr, Crystal Webster did not test relates to lack of available data / time

5.3

5.3

MUST

Manually added staff remain on the course after update

When a course’s enrolments are updated any manually added staff should remain enrolled on the course.

PASS

Not sure if this has passed as it looks like the course simply didn't update

Retested and passed by Stephanie Hay and Wesley Kerr, Crystal Webster did not test relates to lack of available data / time

Test Case 06: Update courses

N/A

Test Description: When the course information changes within EUCLID this is fed through to Moodle

Date tested: N/A

Tested by:

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

6.1

6.1

SHOULD

Information is changed within EUCLID and the course management process is run

If the course code, course name or category information has changed this is then updated in Moodle

N/A

Test Case 07: Category Structure

PASS

Test Description: Course is created in the correct place within the Category structure and categories are created within Moodle as necessary

Date tested: 10/03/16, June 2016

Tested by: Stephannie Hay, Wesley Kerr

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

7.1

7.1

MUST

New course created from application.

Course is put into the category hierarchy in the correct area and can be accessed through the category tree structure within Moodle.

PASS

I can create a course using the hierarchy, not to see if this causes anything to fail!

Retested by Stephannie Hay and Wesley Kerr, Crystal Webster did not test

7.2

7.1

MUST

New course created from application without relevant category already in Moodle

In the case where a course is being created which doesn’t sit in the existing categories the application will create a new category to link it to.

N/A

The system only courses creats courses through Grouper can be in this set of categories, any other courses have to be created manually in a similar structured category tree. Essentially this test is redundant as it will fail but we wouldn't create a course this way.

Test Case 08: Courses

Pass/Fail – Not Applicable

Test Description: Courses can be selected to have their enrolments fed into a hub course

Date tested: N/A

Tested by: N/A

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

8.1

8.1

SHOULD

Various courses for a particular programmes are selected for a ‘hub’ course. When the user selects the hub course the enrolments from the child courses are fed into the hub course. The hub course can now be accessed by all the enrolled users. The child courses remain active on Moodle with all their enrolments functioning as normal

 N/A

 N/A

Test Case 09: Integration within Moodle Admin

Pass/Fail – Not Applicable

Test Description: The application for managing courses should be able to be accessed from within Moodle

Date tested: N/A

Tested by: N/A

TEST ID

BRD ref

P

Test scenario and expected outcome

Pass/Fail

Comments

9.1

9.1

COULD

User logs into Moodle, goes to Site Admin and accesses the application.

User is able to run all the tests detailed above through Moodle, Moodle’s roles and permissions control access to the area.

 N/A

 N/A

Ref

Test Scenario and Acceptance Criteria

Tested By

Date Tested

Outcome (PASS / FAIL)

10.1

Check Staff account. There should be firstname, surname, username, Authentication Method: Shibboleth and email address

Stephannie Hay

10/03/16

PASS - Accounts created, some anomalies but mostly related to bad data in test system

10.2

Check Student account. There should be firstname, surname, username, Authentication Method: Shibboleth and email address. The student email address should take the form sXXXXXXX@sms.ed.ac.uk

Stephannie Hay

10/03/16

FAIL - Email doesn't contain sms TEL025-19 created

PASS - Tested and students are now being created with the sms in their email address but not in the username (this is correct). Staff are also creating normally. JIRA closed.

Ref

Notes on Test and/or Test Outcome

BRD Ref

JIRA Test Log Ref

Issue Summary

Impact on UAT Sign Off

Being managed separately via support however developer resource not available until August - risks aligned to testing (see meeting notes on TEL025)

Project Manager

Karen Stirling

12/07/16

Project Sponsor

Anne Marie Scott

Date Signed Off

Business Analyst (Business Lead)

Stephannie Hay

12/07/16

Add other signatories here