Configuring On-the-Job Training (Vault Training)

Training Admins can track qualification, certification and other skill- or task-based assignments where an Evaluator must verify the Learner’s ability in an area using Vault Training’s on-the-job training capability. For example, in a lab or manufacturing environment, before a Learner is allowed to perform hands-on tasks, the Learner must first be qualified. This may include training on tasks such as how to use different types of machinery for batch manufacturing, how to perform a visual inspection, and other training. These skills and tasks require hands-on training under the supervision of a designated trainer (Evaluator).

You can configure your Vault Training matrix to include on-the-job training via the Evaluation object type for the Training Requirement object, referred to in this article as Evaluation Training Requirements.

A typical on-the-job training process may include the following steps:

• The Learner observes the trainer (Evaluator) performing a task.
• The Learner performs the task under the guidance and training of the Evaluator.
• The Learner independently performs the task without any guidance from the Evaluator. During this step, the Evaluator observes, assesses, and records the Learner’s performance.

If the Learner performs with the required proficiency, the evaluator confirms that the Learner has demonstrated competency and the Learner is then considered qualified for that skill or task.

How Evaluation Training Works

Evaluation assignments assign a task to an Evaluator. The Evaluator is responsible for evaluating the Learner. During the evaluation process, the Evaluator completes a checklist. Once all evaluation activities are complete, the Evaluator selects a verdict. The Learner then has a task assigned for completion of the training assignment.

Evaluator Experience

Many aspects of the Evaluator’s role and task process are determined by your Complete Evaluation Training Assignment workflow configuration. A typical configuration can result in the following experience for Evaluators performing an evaluation:

1. Evaluation Training Assignment tasks are typically assigned to a group of potential Evaluators. When an Evaluator accepts and clicks into the task, they are presented with the Training Assignment details page.
2. The Evaluator and Learner schedule a time for the evaluation outside of Vault.
3. When the time for the evaluation comes, the Evaluator may either have an evaluation form waiting for them on the Training Assignment record details page, or they may need to create one by using an action.
4. While evaluating, the Evaluator completes this checklist or uploads attachments.
5. The Evaluator provides a workflow task verdict, signifying whether the Learner passes, fails, or needs to repeat the training
6. The Evaluator provides a workflow task verdict on the evaluation form which finalizes the results of the Training Assignment.
7. The checklist is stored as part of the Learner’s Training Assignment.

Learner Experience

When a Learner clicks into an Evaluation Training Assignment task, they can view Learning Objectives and Checklists. Often, Evaluation Training Assignments have prerequisites like SOPs, which the Learner will need to complete prior to viewing the evaluation training record. Once ready for the evaluation, the Evaluator and Learner schedule a time outside of Vault to conduct the evaluation.

Configuration Overview

Complete the following Vault components before creating Evaluation Training Requirements:

• Activate the Evaluation Training Requirement, Evaluation Training Assignment, and ETA Checklist Design object types, and create appropriate object type page layouts.
• Create a Checklist Design of the ETA Checklist Design object type.
• Configure a lifecycle and workflow for your evaluation TA Checklist.
• Add the Create Evaluation Checklist user or entry actions to either the In Evaluation Preparation state or In Evaluation state in the Training Assignment lifecycle.
• Configure a workflow for Evaluation Training Assignments.

Enabling Evaluation Training

To use the evaluation training type, you must activate the following object types:

• The Evaluation Training Requirement object type for the Training Requirement object
• The Evaluation Training Assignment object type for the Training Assignment object.
• The ETA Checklist Design object type for the Checklist Design object.

How to Create an Evaluation Training Requirement

To create an evaluation Training Requirement:

1. Create a new Training Requirement record from Admin > Business Admin, a custom object tab, or from the details page of the relevant Curriculum.
2. Select the Evaluation Training Requirement type from the drop-down. Note that once you create a training requirement, you cannot change its type.
3. Enter required details.
4. Enter the goals of the evaluation in the Learning Objectives field. Your description in this field should list any information the Learner should know prior to starting the evaluation. The Learner sees this field content when they view the Evaluation Training Assignment.
5. Optional: Select an Evaluation Design. This checklist form is created by the Create Evaluation Checklist action to make it available to the Evaluator while performing and evaluating the training along with a Learner. The selected Checklist Design record must be of type ETA Checklist Design, and must be in an Approved state when the Training Requirement is in the Ready For Use state.
6. Optional: Select recurrence options.
7. Optional: Select a document to provide the Learner Homepage Card Image. If your Vault has the Learner homepage enabled, the first page of the document selected in this field will be shown as the card image in the card view.
8. Optional: Select the Allow Self-Enrollment? checkbox to allow Learners to enroll in the course via the Explore tab on the Learner Homepage. See details about self-enrollment.
9. Optional: In the Completion Credit Given if Completed Via field, select creation sources which can satisfy this requirement. See details about completion credit.
10. Click Save.

After creating the Evaluation Training Requirement, add it to a Curriculum.

Configuring Evaluator Task Availability

To assign tasks to the appropriate Evaluators, configure Custom Sharing Rules or Matching Sharing Rules on the Training Assignment object, for either the Evaluator application role or a custom application role.

You can also configure Vault Training to copy custom field values from Training Requirement to Training Assignment and use those values to refine the list of potential Evaluators via Custom Sharing Rules or Matching Sharing Rules. When the Complete Evaluation Training Assignment workflow starts, a task is assigned to the appropriate participant group, either the Evaluator application role or a custom application role.

Creating Evaluation Checklist Design

Create an evaluation checklist design using the same process as other Vault checklists, selecting the ETA Checklist Design object type of the Checklist Design object. The specific Checklist Design that you create for this purpose is referenced on the Training Requirement.

Configuring Evaluation Checklist Workflow

Evaluation checklists use either the Pending Acceptance workflow or the Accepted workflow for the TA Checklist lifecycle. We recommend starting either of the checklist workflows with an entry action on the checklist object lifecycle.

We recommend the pictured workflow steps as a baseline, with the following details:

• Select the Allow auto-start from entry action and event action checkbox. This is required to start the checklist workflow with an entry action.
• The Start step must have a participant control for the Checklist Respondent role. Vault Training copies users to the Checklist Respondent role.
• The Workflow Task step must assign the task to the Checklist Respondent participant.
• The Validate Task Complete step ensures that all required questions have a respondent.
• The Set Respondent Field sets the value of the Respondent user field on the TA Checklist to the user who completed the task.
• Ensure that the workflow includes a State Change step to change the state of the ETA Checklist to Completed.

Additionally, you may choose to configure verdicts, such as Pass or Fail, or additional workflow steps for the Checklist Workflow.

Configuring Evaluation Checklist Lifecycle

When the Create Evaluation Checklist action creates a TA Checklist of type ETA Checklist, Vault Training changes its state to In Progress. Therefore, any Start Workflow user or entry actions should be configured on the In Progress state. We recommend using an entry action to auto-start the workflow.

Add a Start Workflow entry action or user action for either the Accepted workflow or the Pending Acceptance workflow on the In Progress state of the TA Checklist lifecycle, using the Perform with Conditions option to add the following condition: Object Type > equals > ETA Checklist. This condition ensures that the action is only executed for evaluation checklists, as the TA Checklist object is also used by Vault Training quiz functionality.

Configuring the Training Assignment Object Lifecycle

The Create Evaluation Checklist user and entry actions are available to configure on the Training Assignment object lifecycle. These actions create the TA Checklist record. We recommend configuring the user action, as it gives the Evaluator the flexibility to create the TA Checklist record when appropriate.

To accomplish this, add Create Evaluation Checklist as a user action or entry action to the standard In Evaluation or In Evaluation Preparation state. When the action is triggered, it creates a TA Checklist record of type ETA Checklist based on the checklist design selected in the Evaluation Design field of the Training Requirement.

Create Evaluation Checklist User Action

The user action version of Create Evaluation Checklist copies the User that executed the action to the Checklist Respondent role on the TA Checklist and TA Response records. If Vault encounters an error while creating the checklist, the system notifies this user by email.

Create Evaluation Checklist Entry Action

While configuring the entry action version of Create Evaluation Checklist, you must select appropriate participant groups in the Assign as Available Respondents and Notification Recipients on Failure drop-downs. When the entry action runs, the users mapped to the role in Assign as Available Respondents are copied to the Checklist Respondent role on TA Checklist and TA Response records. If Vault encounters an error while creating the checklist, the system notifies the user mapped to the role in Notification Recipients on Failure by email.

For example, you can map Assign as Available Respondents to a role that has users via Custom Sharing Rules or Matching Sharing Rules. When the entry action executes on the Training Assignment record, Vault Training copies users from this role and adds the users to the Checklist Respondent role on TA Checklist and TA Response records. This ensures that these users are able to view TA Checklist records and participate in a workflow on the TA Checklist.

Configuring the Complete Evaluation Training Assignment Workflow

The Complete Evaluation Training Assignment workflow is automatically started when a Training Assignment of type Evaluation Training Assignment enters the Assigned state.

The steps in the Complete Evaluation Training Assignment workflow may vary depending on your organization’s needs. For evaluation Training Assignments to function as intended, you must configure workflows that accomplish the necessary steps and move the assignment towards completion.

Example Complete Evaluation Training Assignment Workflow

The following is an example workflow which includes several verdict options for Evaluators. This workflow performs the following actions:

• The workflow first changes the assignment state to In Evaluation Preparation and assigns a task to the Evaluator participant group.
• The workflow makes a task available for an Evaluator to verify any prerequisite training has been completed, notify the Learner’s manager, and coordinate outside of Vault to schedule the evaluation. The Evaluator can access the Create Evaluation Checklist action in either this state or the In Evaluation state.
• Once the task completes, the workflow moves the assignment into the In Evaluation state and starts a workflow task, during which the Evaluator and Learner perform the training outside of Vault while the Evaluator fills out the checklist inside of Vault.
• The Evaluator provides a verdict for the workflow task, which the workflow uses in a Decision step to determine the direction to proceed. In this example workflow, the Evaluator can choose between On Hold, Fail, or Pass verdicts.
• If the Evaluator chooses On Hold, the workflow changes the training assignment’s state to Training On Hold and assigns a task to the Evaluator to restart the evaluation process.
• If the Evaluator chooses Fail, the workflow changes the training assignment’s state to Completed - Not Qualified and ends the workflow.
• If the Evaluator chooses Pass, the workflow changes the training assignment’s state to In Learner Review and assigns a task to the Learner to complete their training assignment in Vault. Once the Learner completes the assignment, the workflow ends.

Note that an Admin must configure the Complete Evaluation Training Assignment workflow appropriately, so that Evaluators and Learners can successfully complete any issued evaluation Training Assignments.

About the Completed - Not Qualified State

The Completed - Not Qualified state in the Training Assignment object lifecycle is treated as a “closed” state by Vault Training. This means that if a Training Assignment is in the Completed - Not Qualified state, Vault Training considers it closed.

The Next Training Date (Recurrence) field value will not be set for Training Assignments in the Completed - Not Qualified state, even if recurrence has been configured on the source Training Requirement.

About Evaluation Training Assignment Checklist Cancellation Behavior

The following special lifecycle behaviors apply to TA Checklists of object type ETA Checklist:

• When an Evaluation Training Assignment enters the Cancelled state, the associated ETA Checklist is only changed to the Cancelled state if it was in the Not Started or In Progress states.
• Unlike Vault Training quizzes, when a new ETA Checklist is created, any previously open ETA Checklist records are not cancelled. This allows the Evaluator user to decide whether to manually cancel older checklists or keep them open.

Limitations

The following limitations apply to Evaluation Training Requirements:

• You cannot add documents to Evaluation Training Requirements.
• You cannot configure Quality Teams on the Training Requirement or Training Assignment objects.
• Evaluation Training Assignment tasks are not optimized for mobile browsers. Tapping on an evaluation assignment will take the Learner to the desktop version of its task page.

Related Permissions

Training Admin users require the following object permissions to create and manage Evaluation Training Requirements:

• Create, Read, Edit, and Delete for Training Requirements of object type Evaluation Training Requirement
• Create, Read, Edit, and Delete for Checklist Designs of object type ETA Checklist Design
• Read for TA Response object and TA Checklist object type ETA Checklist

Learners users require the following permissions to complete Evaluation Training Assignment tasks:

• Read for Training Assignment objects of object type Evaluation Training Assignment
• Read for TA Checklist objects of object type ETA Checklist
• Read for the In Evaluation Preparation, In Evaluation, and Training On Hold states in the Training Assignment Lifecycle

The Evaluator application role, or the custom application role you have chosen to manage Evaluators, requires the following permissions to perform evaluations:

• Read, Edit, and Delete for TA Checklist objects of object type ETA Checklist and for TA Response objects
• Read and Edit for Training Assignment objects of object type Evaluation Training Assignment
• In the TA Checklist Lifecycle, Evaluators require Read access to the Completed state and Edit access to the In Progress and other states.
• Read and Edit access to the Assigned, In Evaluation, In Evaluation, and Training On Hold states in the Training Assignment LIfecycle

The Checklist Respondent role requires the following permissions in the TA Checklist Lifecycle:

• Edit access to the In Progress state and any other custom states
• Create and Delete access to In Progress and any other custom states. If the Ad Hoc Questions Allowed field value is Yes, this permission is required for the user to create or delete ad-hoc questions.
• Read access to the Completed state