Georgia Virtual’s Joe Cozart discusses data analytics in K-12 online learning

Assorted Electronics on table

Dr. Joe Cozart is guest blogging today. Joe is the Associate Director of Strategic Planning at Georgia Virtual School. Here he discusses learning analytics.

Using Data to Improve the Management and Operations of an Online School

Administrators of online and blended schools have access to more data than ever before, but the time and expertise required to use this data is not as easy to come by. However, using readily available tools, there are questions administrators can easily use data to answer. Georgia Virtual School is a supplemental program of the Georgia Department of Education offering online courses to students in grades 6-12. The school provides an example that may apply to other schools as well in the areas of learning analytics, course survey analysis, budget analysis, and course enrollment forecasting.

Learning analytics

Learning analytics have helped Georgia Virtual School better understand what how successful students utilize the learning management system compared to underperforming students. Students who utilize the discussion tool more than 20 times per semester have a statistically significant higher final average than those who do not. This was interesting to our administrative team because discussions only count five percent of the course grade, yet there is more than a five-point change in mean final grade when using the discussion large amounts. It provides data to support the belief that students who actively engage with the content and with classmates do better in their courses. Thus, our school continues to place emphasis on teachers fostering rich discussions even though it is a relatively small part of the overall course grade.

A second benefit to our school from learning analytics is increased efficiency. When staff communicates with stakeholders on student progress, it is key to have information on each student readily available. While reports in the learning management system and student information system show info for students one at a time, our analytics allow for data on entire classes to be seen in a single simple visual like the one below. A teacher can call parents in an entire class while viewing information on how active each student has been in each area of the course, all with a single graphic.

The third focus in analytics is on course design. The grade book heat map shows all student grades for all students in a course, though this image is zoomed to a portion of that report. The grade items are auto-sorted so the lowest overall scores are to the left. Administrators can analyze images like this to see if certain units tend to always show up at the low end. For problem areas, the pacing of the course can give more time to it or more focused content can be developed. There is also the potential here for cost-savings by targeting course development only in weak areas instead of the entire course. In terms of the assignment, it is noteworthy which assignments have a variety of grades given and discriminate which students know the content from those who do not. If the heat map shows only 100s and zeros, the assignment may primarily be a participation grade and not particularly valuable to the learning process.

Course surveys

While many institutions use course surveys, not all schools administer the surveys in a way that makes the data easily aggregated and broken down for teachers. Georgia Virtual School recently began using a new survey tool that automatically generates reports for teachers on their student survey data. It also lets administrators see data for the area they oversee, whether it is a department or two, or the entire school. The initial analysis is showing that the student reports on teacher quality have a much better correlation with our own evaluations of staff than other measures like pass rates. Teachers get a report, and it is easy to compare the mean on each question for the teacher to an overall department and school averages.

Budget analysis

Simple excel spreadsheets break down teacher quality spending to determine the amount spent per teacher per year. This data showed the rate was higher than expected and not sustainable for future growth. To address the issue, Georgia Virtual School developed a new teacher training course and moved it to a pre-hire process. The course is free and open to the public at The training course breaks down the basics of online and blended teaching into five skills. Users complete quests in each skill to earn a badge in the respective areas shown below.

Enrollment forecasting

Georgia Virtual School is a part-time, supplemental program used by hundreds of high schools across the state of Georgia and beyond. Each semester, thousands of students take hundreds of courses, but the enrollments in individual courses vary greatly and are difficult to predict. This makes it tough to ensure an adequate number of teachers is available in each course. Specifically, Georgia Virtual School uses IBM’s statistical program SPSS with the forecasting package that includes time series analysis. In addition to providing a forecast, the program also reports the confidence level of the forecast. The data is able to forecast for courses to show the upper confidence level (UCL) and lower confidence level (LCL). For more information, contact Joe Cozart at [email protected].

Michigan Virtual Learning Research Institute

Michigan Virtual Learning Research Institute

The Michigan Virtual Learning Research Institute (MVLRI) is a non-biased organization that exists to expand Michigan’s ability to support new learning models, engage in active research to inform new policies in online and blended learning, and strengthen the state’s infrastructures for sharing best practices. MVLRI works with all online learning environments to develop the best practices for the industry as a whole.

The Digital Backpack

Get our latest articles sent straight to your inbox every Thursday!

  • This field is for validation purposes and should be left unchanged.

Limited Course Capacity

We’re sorry to inform you that we have reached capacity for several of our Semester 1 and Trimester 1 courses. You’ll notice when attempting to enroll students in our Student Learning Portal that some courses are unavailable. While we are no longer accepting new enrollments for these courses at this time, many courses continue to remain open for enrollment.

With many students across the state 100% remote, demand for our online courses is greater than ever before. Because every course we offer is taught by a Michigan-certified teacher, this high volume of enrollments has created capacity issues for our teachers who provide each and every student with individual feedback.

While the Michigan Virtual team anticipated and planned for significant increases in student enrollments this Fall, the increased demand we’ve experienced has been unprecedented. As a result, we are taking steps to hire even more part-and full-time teachers to support larger numbers of student enrollments for Semester 2 as well as for Trimester 2 and 3. 

For schools that still need online learning options this year, please fill out the form at the bottom of our virtual pathways page to meet with someone to discuss other solutions. While some of our teacher-led courses are full, we may still have the capacity to help you in upcoming terms or can discuss timing to implement a whole-school or collaborative program in which local teachers from your school/district use our online course content to teach students. We also have free course content and resources available for you to use.

We know this is an incredibly stressful time for all, and we’re sorry if the courses you’re looking for are unavailable. We never want to turn away a student who wants to learn from us. Our top concern, however, is student success, and we have a policy to not take on additional enrollments if we cannot guarantee that all students will have a quality online learning experience. 

We appreciate your patience and understanding as we navigate the unusually high volume of enrollments we are receiving.