KSU aims to take full advantage of data gathered through the LMS, D2L, for a faculty audience. Our online learning unit, Digital Learning Innovations, has revised their mission to support faculty in using the LMS to manage learning in all modalities and using the data to identify problems, diagnose root causes, and take targeted actions during the semester to impact student success within the semester. The learning analytics solution, uHoo Analytics, is available to all faculty. Additionally, faculty are provided professional development in tool use and data interpretation.
This project is aligned with one of our “Top 5 Strategies,” which is to encourage faculty to utilize student course data to improve student performance.
Evaluation Plan and measures as of Fall 2024:
- Micro-learning completion rates by badges awarded
Introduction to uHoo Analytics: 303 issued
Learning Analytics 101: 89 issued
Course Optimization: 65 issued
Student Support: 66 issued - Increase number of programs using D2L data for program assessment reporting (3 programs are piloting uHoo for program assessment)
- Use of analytics for instructional optimization
- Measure frequency of faculty access of learning analytics system.
- Measure number of faculty engaged with learning analytics system.
484 faculty have requested access to uHoo Analytics
181 unique users in October 2024
In October users opened reports 701 times and viewed 1,518 pages within the platform.
uHoo access by faculty across campus continues to grow and frequency of engagement is rising rapidly; however, some original users have discontinued regular engagement. The reasons for this are unclear but could include faculty value perceptions, ease of use, or simply lack of an instructional assignment for the Fall 2024 semester. Users have submitted dozens of feature requests indicating interest in the tools. KSU has had excellent uptake of the introductory professional development course with 303 completers earning badges. Moving forward, an instructor survey may help provide guidance on system or professional development aligned to learning analytics.
In the next year, the uHoo development team will take the list of faculty feature requests to the Digital Learning Advisory Council for prioritization. The development team will then aim to complete 3 new features within the year. The professional development delivery will continue including custom college-specific support events and training. Additional development on the program coordinator dashboards will also be advanced and the planning and feasibility of advisor dashboards will also be reviewed. Refinements to enhance reliability and accuracy will continue as new opportunities become apparent with the growing user base.
Human resources in our Digital Learning Innovations team are limited. Ensuring we have the time and human resources to be successful is important. We are reviewing the team’s summer vacation schedules to be sure the resources will be available. Additionally, as instructor traffic continues to grow on the platform, stress on the system is beginning to show. The development team will need to advance the cloud platform employed to maintain reliability for such heavy use.
We have been able to work with the USG UIT team as well as the D2L developers. Their engagement continues to be valuable to troubleshoot and advance the uHoo Analytics. We do not require additional support beyond this continuance.
