The Weighted Engagement score shown in the Student Analytic data is a calculation of engagement based on metric weighting that YOU customize to make that figure meaningful to YOU. The Weighting tab on the Analytics page for a course allows you to specify how important each metric is relative to the other metrics. This creates YOUR definition of "engagement".
All metrics are evenly weighted by default, as shown in the below figure. Drag the slider handles left and right to change the percentage weighting for each metric. Notice that the percentages change for all the sliders, to accommodate more or less weight given to the changing metric.
The Weighting tab also provides a small set of presets you can use outright, or select and use as a base for your own settings. See Understanding engagement presets below.
Weighting, if changed, must be done for EACH COURSE/SECTION; your preferences do not carry over to other sections.
Below is a brief definition of each metric you can weight. See Definitions of Analytics Data Metrics for a detailed description of each of the metrics.
Analytics for LIVE classes - Viewing data for Live Streamed Classes is only gathered from Universal Capture devices and is a little different than for VOD classes in some areas. See the following sections of the Definitions of Analytics Data Metrics page for more details: Attendance Percentage, Video View, and Video View %.
Keep in mind: As mentioned in the above note, analytics data is only gathered from Live Streamed Classes performed on Universal Capture devices (Pro, Pod, or UC software installations). No analytics data is gathered from Live Streamed Classes done on legacy SCHDs or legacy CCAP.
- Attendance - This is a binary metric; either the student attended a class or did not. 100% for yes, 0% for no. "Attended a class" means the student entered the online classroom during class time, OR if the class does not have a date/time, the student interacted with the class in some way (viewed the video or slides, posted a question or response, took notes).
- Video Views - This refers to Video View percentage, and is the percent of the total video in a class, or across classes, that a student has viewed.
- Presentation Views - This refers to Slide View percentage, and is the percent of the total slide deck in a class, or across classes, that a student has viewed.
NOTE: Some instructors want to isolate and export viewing percentage information from Echo360 into their LMS gradebook. This is most easily done by changing one or both of these Views sliders to their maximum weight, and changing all the others to 0. This recalculates the Weighted Engagement score for students to rely solely on view percentages, providing an easy way to determine and export viewing data. See Using Engagement Sliders to Target Views for Export.
- Q&A - Similar to Attendance, this is a rather binary metric; did the student participate in class discussion or not. Students get credit for Q&A if they post a question or a response to a question, either in the classroom or in the Q&A tab.
- Notes - Similar to Q&A, this is a binary metric; did the student take notes or not. Students get credit for the "Notes" metric if they entered text into the Notes panel in the classroom, or added notes into their Study Guide.
- Activities - This uses the Activity Participation scoring and is whether or not a student is answering the polling questions posted in classrooms. It does not take into consideration whether their answers are correct or not; simply that they are providing responses.
You can change your definition of engagement at any time by dragging the slider handles left and right and then applying your changes. Weighted Engagement percentages change as soon as you click Apply. This allows you to apply weighting changes, go to the Students tab and see the difference (sorting the list as necessary), export the data to a CSV file or to your LMS gradebook, then make other Weighting changes and apply those.
To define engagement scores
- Access the Course you need from the Echo360 Home page to open the Class List.
Alternately, if you enter Echo360 through an LMS, enter the course the way you normally do.
- Click the Analytics page.
- Select Weighting from the left side of the page, as shown in the figure at the top of the page.
- By default, all of the metrics are evenly weighted. You have the following options:
- Manually slide the "handle" of each bar left and right to increase or decrease the weight that metric has in student engagement scoring. All weighting is relative - see note below.
- Click one of the Presets provided. See Understanding engagement presets below.
- Do both! Select a Preset, then customize it by moving the slider to the right or left as appropriate.
All metrics add up to 100%: The "weight" of each metric is a portion of 100% - meaning if you increase one metric, the rest of the metrics must decrease by a corresponding amount. This is reflected in the percentages shown to the right of each slider.
- Click APPLY to apply these settings to this course.
- Click RESET to return the metrics to their original (or last saved) settings.
You must do this before clicking Apply if you want to return to the settings as they were when you entered the page.
Understanding Engagement Presets
The Engagement Presets are designed to weight the metrics in a way that reflects the importance of that preset. The three presets provided reflect the most common engagement types used by instructors to determine whether a student is properly participating in the class or not.
These can be used as they are defined in the preset, or they can be used as a base from which you may customize your definition of "what's important".
For example: The In Class Learning preset weighs Attendance and Activities participation very highly, but Video Views (performed outside of class) very low. The idea is that the video in most classes is a capture (recording) of the lecture. If the student is to be IN class during the lecture, they don't necessarily need to watch it again outside of class.
Click each preset to see what settings are used there, and feel free to adjust them for your own needs. NO CHANGES ARE APPLIED until you click Apply.