|Release date: 14 February 2024
Updates to Aptem Assess
Aptem Assess Quality Score and Report
The Aptem Assess Cognitive Assessment now features a quality score, with a breakdown report, to identify potential learner engagement issues and optimize assessment results. This enhancement enables administrators to detect problems that can negatively impact assessment outcomes and indicate unnecessary additional learning resources. The feature is accessible via the Cognitive Assessment Report on the Learning Support page. The overall quality score is also available via the AptemCognitiveAssessments OData feed to assist with reporting needs.
The overall quality score provides a single score from 0% to 100%. Higher scores indicate better engagement/answering quality. The overall quality score is calculated using the results of the measures for each testlet. Each testlet's quality score is based on five measurements:
- Response has consistent alternating pattern: Checks for consistent alternating response patterns
- Percentage of completed items: Verifies if very few responses were provided
- Response is the same: Ensures responses are not consistently the same
- Response click speed: Verifies if response times are below 1.5 seconds per item
- Instruction time is low: Checks if instruction viewing times are below 2.5 seconds per item.
Number Recall, Missing Numbers and Objects contain multiple choice questions and are therefore excluded from Alternate Responses and Same Response scoring. Administrators can access the summary report by clicking the small dropdown icon alongside the quality score percentage. This report provides insights into issues related to several test components. Here is a sample report:
This will inform the admin user in providing feedback to the learner and aid in getting a high-quality response cognitive assessment and reduce false positive results indicating support is required. The breakdown report will not be displayed if the Learner has a quality score of 100%.
Guidance on score calculations is available on the Help Centre, accessible via a link next to the Quality Score in the Aptem Assess Cognitive Assessment Report. For the Help Centre article, see: Aptem Assess Quality Score Calculations.
Minor updates and fixes
At Aptem, we aim to offer our users an accessible product that meets the latest WCAG AA Standards. We are committed to improving accessibility, including updating styles for interactive elements like buttons and links.
For more information, see: Accessibility Improvements - February 2024.
Added Active Learning Break as Reason on BiL tracker
A new option ‘Active learning break’ has been added in the ‘Reason for break’ dropdown while creating a Break in Learning tracker. The reason will also be reportable via OData.
Changed the name of the Trackers tab in Tenant Settings
In Tenant settings, the Trackers tab has been renamed to ‘Process Automation’.
Added 'Help' content to the relevant Quality PowerBI Reporting Dashboard
Help information has been added to more pages of the Quality dashboard. Some of the information has also been updated and where applicable, links to the Help Centre have been added to allow the users to navigate easily to more detailed information.
A new field ‘UserILRSummary_RequiresSupport’ has been added to the OData User feed that shows if a learner has indicated that they do/do not require additional support.
Two new fields have been added to LearningPlanComponents OData feed: MinimumNumberOfEvidence and NumberOfEvidenceAccepted.
The MinimumNumberOfEvidence shows the count of minimum evidence a learner needs to provide.
The NumberOfEvidenceAccepted shows the count of the number of accepted evidence.
To know more about the specific business logic, please refer to the OData dictionary.
Implemented API Versioning: We have now upgraded to the new API Version (v1) for Cognassist. Customers can continue to use the Cognassist API without interruption. Admins will see an update to status terminology (for both new and existing Cognassist results) from “Matched” and “Unmatched” to “Identified” and “Not Identified” respectively. There is also a new status “Insufficient Data”. “Insufficient Data” is an indicator used by Cognassist that the user was not able to provide enough answers to questions in the assessment.
EPA Pro - Display learners' final result from the Queue: For learners, the overall result from EPAPro side can be fetched and displayed in Aptem through EPAPro queue job.
Apprenticeship Agreement version 4: Users can pre-populate, Sign, Reset and download a new version of Apprenticeship Agreement. Customers with the version 3 enabled will be able to select this without needing to request it.
Administrators can now update the maximum Planned off-the-job hours from any combination of main programmes and sub-programmes.
- In some cases, duplicate Checkpoints were being created when completing a learning plan component. The issue is now fixed, and automatic Checkpoints are functional as expected.
We have fixed an issue with the processing of the New RPL calculation tracker where the calculated practical period end date did not include the start date which resulted in the end date being 1 day later than expected. The calculation has been adjusted to count the first day. On creating a New RPL Calculator tracker the Practical period planned end date matches exactly with the planned end date in ILR of Program aim.
Criteria sets (a.k.a. learning items trees) and related components' mappings (of both delivery programme based and ad-hoc ones) of currently enrolled learners will now be retained correctly on toggling the Learning Plan token off when editing and saving a delivery programme via the Programme Builder. Additionally, when removing a Sub Programme, the warning message in both Console and Classic has been updated, to make it clearer to users that removing the sub-programme, will results in the removal of criteria mappings and evidence for any applicable Learning Plan Component.
Upcoming features - within the next three releases
Based on the work we have completed in the past feature sprint(s), we have the following features lined up for release in the near future:
Surfacing Review Responses sections via OData
In order to give customers greater reporting and forecasting abilities with regards to the Reviews functionality, we will surface the following sections, including their responses via a new OData feed:
- Custom sections in reviews
- Core Topics
- EPA Gateway
- Individual Support Needs/ Requirements
- Short and Long Term Goals
This will ensure parity with the Classic review export functionality. The General availability for this feature will be in April 2024.
Aptem Assess enhancements
We are further developing Aptem Assess, to:
- Provide richer depth of reporting against near-threshold learners who may need further review to determine exact ALS needs.
- Allow all data associated with this assessment to be extracted via OData.
- Provide additional learning support resources, accessible via the resource centre, which can be used to modify a learner’s learning plan.
Communications Connector with Teams
We are working on implementing a Communications Connector with Teams. This will allow users to schedule / join Online Events in Teams directly from Aptem.