Validation test execution is a fundamental part of the validation lifecycle. Executors challenge user requirements and functional requirements using pre-approved test scripts. Using the Validation Management Test Execution Interface, Executors can easily perform procedures defined by test authors, understand expected results, reference requirements being challenged, describe their observed results, and upload attachments to provide objective evidence. Discrepancies encountered during execution can be created directly from the test step where the issue was encountered. Discrepancies are also known as exceptions, nonconformances, deviations, or defects, depending on the organization.
Using the Test Review Interface, Independent Reviewers, Approvers, and Quality Unit Approvers can easily use a review-by-exception approach and ensure that all steps were completed in a compliant manner. Review-by-exception helps reviewers, approvers, and Quality Unit Approvers to focus their efforts on higher risk areas to streamline the review process.
About the Test Execution Interface
When you perform the Execute Test action on a test which is in the In Execution lifecycle state, Vault takes you to the Test Execution Interface page.
Test Header
This section includes the Name, Title, and Run Number (if any) of the Test Script being executed.
Navigation Panel
The navigation panel on the left side of the interface has several useful functions. At the top of this panel is a progress bar, which shows your percentage of assigned steps completed. This percentage is specific to each Executor, so if two or more Executors are working in the same Test Script, they may see different values.
Clicking on a step or section in this panel navigates your view directly to it in the content panel. You can collapse and expand sections to efficiently navigate through large numbers of steps.
The step navigation panel displays an icon (
) when you have viewed a step or section, but have not yet completed it. The panel displays a checkmark once you have completed the step or section.
You can limit your view to only your assigned steps by selecting the Show my steps only checkbox in the navigation panel. Steps that are not assigned to you will show as gray in the navigation panel.
Content Panel
The content panel in the lower right portion of the interface contains the Test Steps which you will execute.
Action Bar
The top right of the interface includes a next step locator icon (
) which takes you to the next incomplete step in the Test Script.
The Next button in the top right navigates to the next section of steps. If you have not yet completed all steps in the current section, Vault asks you to confirm the navigation. You can click Previous to navigate back to a previous section.
You must complete all your assigned steps before you can view the Review & Sign section.
Executing Test Steps
You can update and complete any step that is assigned to you, in any order. To execute a test step:
- Scroll to the step in the content panel or click the step in the navigation panel on the left.
- Perform the test as instructed in the step.
- If required, add an attachment by clicking Upload and selecting one or more files.
- If you are performing an execution step, select a Pass, Fail, or N/A verdict.
- If necessary, add comments or discrepancies.
- Click Complete to finish the step.
Adding Comments
Click + Comment to add a comment in a pop-up dialog, then click Save. Once saved, a comment icon (
) appears in the Test Step. You can click the comment icon to edit your comment. You can make edits as long as you have not yet completed the step.
Adding Discrepancies
If a discrepancy is required for a step, click + Discrepancy to create a Discrepancy record. In the pop-up dialog, add the Title, Description, and Date, upload attachments if necessary, then click Save. Once saved, a discrepancy warning icon (
) appears on the test step card. You can click the discrepancy warning icon to view the Discrepancy records associated with the step in a dialog. From the dialog, you can navigate to record data and view attachments.
Reassigning a Test Step
Every step has a Reassign Step action available in its Actions menu to assign a different Executor.
Executor Review
The Review & Sign section becomes available once all Test Steps are completed. This section is a summary of the Test Script, including any discrepancies, failed steps, and changes made. Click on the numbers at the top of the Test Execution Interface to filter and review discrepancies, failed steps, and revisions pertaining to your assigned steps. This allows you to review by exception, clicking through each filter to review and decide if any changes are necessary.
After finishing your review, click Complete and provide an eSignature.
Making Changes in Completed Test Steps
Once a step is complete, a timestamp is applied to the step and it receives a green checkmark in the left navigation panel. Any additional changes are tracked as though you are re-executing the step, and Executors are required to provide an eSignature for every change to a completed step. Changes can be made to completed steps for Actual Results, Comments, Attachments, Verdict, and Executor (initiated by the Reassign action). To make changes to the actual results for an execution step:
- Click on the pencil icon next to the Actual Results field.
- Add a New Value.
- Add a Change Reason. Select from the following options: Calculation Error, Entry Error, Late Entry, Other, or Spelling Error.
- Add a Justification for the change to the completed step.
- Click Save. Provide your eSignature if prompted.
After successfully providing the eSignature for the edits, Vault updates the completion date/time to reflect the time the change was made by the logged in Executor.
Steps with changed results are marked with a delta icon (
). Clicking this icon displays all Test Step Changes for the step.
The Reassign Step, Edit Comment, Edit Verdict, and Add Discrepancy actions become available after a step is complete. These actions require additional information similar to changing the actual results for a step and require eSignatures for the change to take effect.
About the Test Review Interface
Once the Lead Executor has provided an overall Test Script verdict, the Test Script then moves into a series of review phases before final Quality Unit approval. Vault provides a special Test Review Interface to facilitate this process. This process is performed by Independent Reviewers, Approvers, and finally, Quality Unit Approvers.
When you perform the Review Test action on a Test Script record in the In Independent Review, In Approval, or In QA Approval state, Vault takes you to the Test Review Interface.
Test Header
This section includes the Name, Title, and Run Number, if any, of the Test Script being executed.
Navigation Panel
The navigation panel on the left side of the interface has several useful functions.
Clicking on a step or section in this panel navigates your view directly to it. You can collapse and expand sections to efficiently navigate through large numbers of steps.
Main Section
The main section in the lower right portion of the interface contains the filters and fully executed Test Steps. Click on the numbers at the top of the main section to filter and review discrepancies, failed steps, and revisions. This allows you to perform a review by exception, clicking through each filter to review and decide if any changes are necessary and whether you will approve or reject the test script.
The top right of the interface includes a Review button to complete your assigned review task and provide your verdict and eSignature.
Related Permissions
To use the Test Execution Interface or the Test Review Interface, users require a security profile which grants the following object access:
- Test Script: Read
- Test Step: Read, Edit
- Discrepancy: Read, Create, Edit, Delete
- Requirements: Read