Pensée critiqueAdvanced

Investigate a sharp rise in a customer satisfaction score

Scenario

Context: You are a customer insight analyst at a regional energy supplier. In March, the company replaced its email satisfaction survey with a short text message sent right after a call to customer service ends. Problem: The average satisfaction score rose from 6.8 to 8.1 out of 10 between the first and second quarter. The response rate rose from 4% to 19%. Formal complaints to the energy ombudsman stayed at the same level. The customer service director wants to announce the improvement in the annual report and credit her team's new training programme, which started in February. Constraints: The annual report text must be submitted in three weeks. You cannot run a parallel email survey before then. The board is sensitive to claims that could later be challenged by the regulator. Expected deliverable: Answer in 4 points: 1) the possible explanations for the rise in the score; 2) the evidence in the scenario that supports or weakens each; 3) the checks you can carry out within three weeks; 4) the wording you would recommend for the annual report.

Targeted skills

surveyscustomer experiencemeasurementdata analysis

Context & stakes

A satisfaction score that jumps by more than a point in one quarter is welcome news for any service director. At this energy supplier, the rise comes after several changes in customer service, and the director wants to credit her team in the annual report. The board does not want a claim the regulator could later question.

Assessors look at the range and plausibility of the explanations offered, how carefully each is tested against the facts given, and whether the checks proposed can be done in the time available. A good answer weighs each explanation against the facts before choosing, and ends with wording for the report that is both accurate and fair to the team.

Listing every change that happened between the two quarters before drawing any conclusion keeps the analysis honest. Drafting the report sentence last, once the reasoning is complete, avoids overstatement. Customer insight analysts, service managers, communications staff and anyone who reports on customer metrics will find the case useful.

More Pensée critique case studies

See all Pensée critique case studies

Original questions designed by CodeDuel. CodeDuel is not affiliated with any publisher or certification body mentioned; certification names and trademarks belong to their respective owners and are used only to indicate the area covered. Report content