Chimple's North Star Metric is 60 minutes of student engagement per week. This metric had already been validated through a randomized controlled trial of the app before I joined the organization, so it was the metric the product was expected to optimize toward.
The problem was that the Teacher's App dashboard wasn't aligned with it.
Teachers were shown red, yellow, and green bands for each student based on lesson scores out of 100. The weekly summary beside it had the same problem — it surfaced information, but it wasn't connected to the engagement metric the organization had already established as important.
More importantly, teachers told me they didn't understand what the bands meant or what they were supposed to do with them.
