Should Customer Experience and NPS Surveys be Anonymous?

CX and NPS feedback – should it be anonymous?

Should Customer Experience and NPS Surveys be Anonymous? The simple answer is NO – anonymity is not required for a B2B CX or NPS programme.

But the answer is not that simple. Let’s start by defining what Confidential and Anonymous mean in the context of surveys. This may sound obvious, but I have been amazed at the number of times I have needed to discuss this:

ANONYMOUS: No person or application can associate the answers you give with any identifiable information about you
CONFIDENTIAL: Any identifiable information about you will be held confidentially, and stored in an appropriately secure manner
OPTIONAL CONFIDENTIALITY: Any identifiable information about you will be held confidentially, and stored in an appropriately secure manner unless you specify that you would like to be identified (in other words, you decide to waive your right to confidentiality)

So for the rest of this blog, I am not longer going to dwell on anonymity. It’s simply not needed.

Confidentiality – now that’s a different matter

In any setting, when a third party asks for your opinion about someone, confidentiality is important to ensure a really open and honest response. In personal relationships this goes without saying but in the B2B world this is also true. It’s especially true if your staff are doing what you need them to be doing – building strong and personal relationships with clients.

Of course, many of your customers will indeed give you an honest response regardless of whether it is confidential or not. But many won’t. Cultural differences will mean this statement is truer in some parts of the world than others. However, regardless of where your customers live, there will always be those who will not respond, or who may not be as open as you would like them to be, unless their responses remain confidential.

Example 1

This example is an actual Deep-Insight client.

Company A ran a Customer Relationship Quality (CRQ) assessment (Survey 1) and told respondents that they had the option for their responses to remain confidential. Six months later Company A ran the survey again, but this time told respondents the option to remain confidential was removed.

The impact on their average Net Promoter Scores (remember NPS is a measure of advocacy on a 0 to 10 scale) was as follows:

Individuals’ responses in Survey 1 Completion Rate (Survey 2) Average NPS (Survey 1) Average NPS (Survey 2)
Chose confidentiality (did not share details) 55% 6.3 7.5
Waived confidentiality (shared details) 70% 7.1 7.2

 

For respondents who had shared their names with their responses in Survey 1, there was no significant impact. When asked to complete Survey 2, 70% did complete and only a small uptick in scores was noted (7.1 to 7.2).

However, where respondents chose to keep their feedback confidential in Survey 1, there was a much bigger impact. For starters, only 55% of these individuals chose to complete Survey 2. For those who completed Survey 2, there was also a significant increase in scores (from 6.3 to 7.5). In fact, ‘Confidential’ respondents went from scoring more poorly than average to scoring more positively than average when forced to share their details with the response.

Example 2

Here’s another client of ours. Having received very high scores for several consecutive surveys, Company B decided to introduce the option of confidentiality to ensure the integrity of what it was measuring. The findings were interesting, especially for newly-included respondents:

  • 26% of respondents opted to remain confidential overall but for newly-included respondents the figure was 38%
  • ‘Confidential’ respondents scored more poorly than those who agreed to share their responses – but not significantly so
  • Newly-included respondents who opted for confidentiality scored significantly more poorly than other respondents

 

“…but my teams are frustrated by these unactionable ‘Confidential’ responses”

In both examples above, the organisations had good business reasons when they chose not to include confidentiality in their CX process:

  • Improved usefulness as an account management tool as ALL feedback is provided to account management teams
  • All raw data can be fully integrated with internal systems, allowing ongoing re-segmentation of responses (this is limited when responses are confidential)

But the argument that your CX or NPS programme should include ‘Optional Confidentiality’ is far stronger. If you don’t include optional confidentiality, your most unhappy customers will either not respond or will not give you a completely honest response.

This puts your entire CX or NPS programme at risk. You will end up making decisions based on inaccurate or incomplete data.

So should NPS Surveys be Anonymous? No. Should they include ‘Optional Confidentiality’? Absolutely!

“Is there any way to convince ‘Confidential’ respondents to share their details but still give an honest response?”

Maybe, but this will take time; people are people after all.

If a customer is at a point in their journey with you that they do not want to share their details, but they are willing to give feedback, that’s OK. Of course, you can explain the benefits of what you can do if they agree to share their details with you (you can address their issues more easily) but don’t push too hard. There is a trust issue here. Pushing won’t help.

You have a much better chance of convincing this customer by including them in your ‘Close the Loop’ process even though you don’t have a response from them. Over time you will gain their trust, both in the CX or NPS programme as well as in your organisation. You’ll eventually win that shared response.

Quality is Free (so Invest in Service Excellence)

Customer centricity is all about doing the right thing for the customer. Doing the right thing also means doing things right. That means service needs to be excellent. All of the time.

Sounds expensive?

Actually, it’s not. The main message in my last blog about the Service Recovery Paradox was that quality is free so make sure to build quality in from the start so you do things right first time.

The Service Recovery Paradox

By the way, the Service Recovery Paradox is a well-known management concept. It states that a service failure followed by a good service recovery can lead to more loyal customers.

Service Recovery Paradox

The only problem is that there is no compelling evidence to show that the paradox is true. In fact, the opposite is the case.

Loyalty and Repurchase Intentions do not return to a higher level after recovering well from a service failure. There is evidence to show that Satisfaction levels can end up higher than ever before if the service recovery is managed well, but customers are less likely to repurchase.

Our own experience is that this is particularly true where there are repeated service failures. Quite often, repeated failures are symptomatic of underlying issues that have never been adequately addressed. That’s why the service fails, and fails again and again.

The implications are profound. If you want to retain clients and increase revenues and profitability, you simply cannot afford repeated service failures. The good news is that service excellence is achievable for all companies. The even better news is it doesn’t cost anything but it does mean that you need to have a good quality system in place to identify, eliminate and prevent further service failures.

Quality is Really Free?

‘Quality is Free’ and ‘Right First Time’ are references to a 1979 book by Philip Crosby. Crosby was one of the founding fathers of the Total Quality Management (TQM) movement in the 1960s and 1970s. He had previously been a senior executive and Quality Director with the US manufacturing company ITT. In the early chapters of Quality Is Free he outlines the impact of the quality programme at ITT which at the time employed 350,000 people across the globe.

Quality is Free

Crosby’s philosophy was a simple one. Rework is very expensive. It is less expensive to do it right the first time than it is to pay for rework and repairs. So focus on doing it right first time.

Much of Crosby’s work was for manufacturing companies but the principles are exactly the same for services firms. And probably more relevant. Crosby believed that manufacturing companies wasted about 20% of revenues fixing things that had been done wrong in the first place. According to Crosby, this figure could be as high as 35% in services firms.

Crosby’s Fourteen Steps

Crosby summarised his approach to quality in 14 steps. Even though they are over 40 years old, the steps are worth repeating here. They are as critical today to retaining customers as they were in 1979 when Crosby wrote ‘Quality is Free’:

# STEP COMMENTS
1 Management Commitment Get senior management buy-in from the beginning. Leaders – particularly the CEO – must be personally committed to the quality programme. Without this, nothing will happen.
2 Quality Improvement Team It’s senior management’s job to assemble a team and equip them with the right tools to make the programme work.
3 Quality Measurement What gets measured gets managed. The corollary is also true. If you don’t have a measurement system, little is achieved.
4 Cost of Quality Evaluation Calculate the cost of poor quality. That provides the business case for investing in quality. Remember that quality is free if the investment is lower that the cost of rework.
5 Quality Awareness It’s all very well for senior management to know the cost of quality. Everybody in the company must understand it as well. Make sure they do.
6 Corrective Action This is where we start identifying and fixing problems – with products, processes, service levels.
7 Zero Defects Programme Set ambitious targets for 100% quality. They may not always be achievable, but the ambition must be visible.
8 Supervisor Training The concept of supervisors may be old but investment in training for management is not. And it’s critical.
9 Zero Defects Day This is related to Point 7 and makes a statement that one day each year must be dedicated to ensuring that a Zero Defects ethos pervades the company.
10 Goal Setting Crosby recommends 30-day, 60-day and 90-day goals. The emphasis is on teamwork to achieve those goals.
11 Error Cause Removal Ask individuals to describe any problem that prevents them from performing error-free work. Fix those problems.
12 Recognition Recognise and reward excellent performance. Crosby recommends that rewards for outstanding work should NOT be financial.
13 Quality Councils The purpose of these councils is to bring professionals together on a regular basis so that can share stories and best practices.
14 Do it Over Again Most programmes last about 18 months before they need to be refreshed. Senior management must sustain the focus on quality so that it becomes part of the company’s DNA.

 

Customer Centricity = Service Excellence

At Deep-Insight, we help B2B companies become more customer-centric. By doing so, they will improve retention rates, revenues and profitability. Customer centricity is all about doing the right thing for the customer. A lot of Deep-Insight’s clients think that a core part of being customer-centric is being able to bring Innovation to the table for their customers. Service excellence is far more important.

Don’t get me wrong, I’m not saying that innovation should be ignored. It’s a hot topic in boardrooms these days. Even so, all of our experience suggests that if companies are failing to deliver the basics well, their customers have little interest in discussions about innovation.

You need to earn the right to talk about innovation. That’s why Service Excellence is critical. Consistently good service eliminates the day-to-day ‘noise’ that gets in the way of working with clients on exciting new and innovative ideas. Service excellence also helps improve customer retention rates. That’s the core message from the Service Delivery Paradox blog.

Invest in Service Excellence

Remember: service excellence first, innovation second. So do the right things, do them right and get them right first time.

Remember also that quality is free so there is no reason NOT to invest in a Service Excellence programme for your organisation. You know it makes sense.

Do contact us today if this blog sparks any ideas and you want to have a chat about improving retention rates, revenues, and profitability.

Service Recovery Paradox – Fact or Myth?

This blog is about a well-known business concept called the Service Recovery Paradox (SRP).

What’s SRP? It’s a pretty simple theory. A good recovery following a service failure can turn angry, frustrated customers into loyal ones. Service managers have known about this paradox for years.

The concept was first discussed in a popular Harvard Business Review article as far back as 1990. The authors – Christopher Hart, James Heskett and Earl Sasser – are all extremely well-respected academics and business practitioners.

But are they right? Let’s take a closer look.

The Profitable Art of Service Recovery

Service Recovery at Slack

Why don’t we start with an example.

Ever heard of the American tech company Slack? Several years ago, Slack had a major service failure:

Tuesday, November 23, 2015 started out like any other day at work for James Crenson. Coffee, check email, prep documents for weekly meeting, solicit input from co-workers on slack. Um, Slack?

Outage

At 8:50am, popular workplace messaging service Slack suffered a massive outage, leaving over a million users around the world unable to send or receive messages and files for almost three hours in the middle of the workday. Angry users took to twitter and other social messaging sites to complain about the inconvenience. The situation had the potential to explode, but Slack was ready.

The team messaging tool had a solid plan in place for mass outages. A well-coordinated group effort handled support issues including a comprehensive social media blitz to contain the negative customer experience (CX). Over the few hours that the service was down, the official @SlackHQ account tweeted over 2,300 times with humorous, thoughtful, and most importantly, personalized – responses to customers complaining about the service outage.

Response

Not only did the all-out response wow users, but @SlackHQ gained over 3,300 followers – 7x more than average – on a day that could have gone down as the worst in company history. Slack was able to quickly contain the damage, took complete responsibility, kept its customers well informed and handled a stressful situation with humor and efficiency.

Throughout this process, Slack deepened the trust of existing customers by demonstrating that the company was prepared in times of crisis. Its expert handling of a negative situation enhanced its relationships with existing customers, boosted the brand’s reputation and even served as a springboard for an expanded customer base.

This is an exceptional demonstration of the value of the phenomena known as the “service recovery paradox.”

The graphic below explains the Service Recovery Paradox.

Loyalty generally increases over time when service is delivered consistently well. It falls rapidly if there is a service failure but loyalty increases again when service is restored and the service recovery is handled well. In fact, loyalty becomes greater than if no failure had occurred in the first place. That’s the paradox.
Service Recovery Paradox

Fact or Myth?

The Service Recovery Paradox is generally accepted as fact. But where is the evidence for it?

Some years ago, Celso Matos decided to find out. He and a couple of colleagues from the Federal University of Rio Grande do Sul in Brazil conducted a ‘meta-analysis’ of all academic articles that discussed SRP. In total, they found 24 documented examples of recoveries following service failures. 19 of the 24 examined the impact of service recovery on satisfaction; 12 examined the impact on repurchase intentions; six looked at word of mouth (advocacy).

Their results were very interesting and not encouraging for companies with a poor service ethos.

Matos concluded that “satisfaction increases after a high service-recovery effort” but that “repurchase intentions are not increased by a high service-recovery performance.”

Service Recovery does NOT lead to greater loyalty

Matos and his colleagues explain that “customers are willing to make a positive evaluation of a firm providing a high recovery effort, but they are not likely to repatronize this firm”. They go on try to explain why this might be the case.

One explanation is that satisfied customers are not necessarily loyal. We know this from our own analysis at Deep-Insight. Another explanation is that people will give you a lot of credit for pulling out all the stops to recover a bad situation after a bad service failure. However, they will still doubt your ability to ensure no similar service failures occurs again. That’s pretty important when your 12-month or 10-year contract is coming up for renewal. They might give you good customer satisfaction (CSat) scores, but will they sign up for another contract?

In general, satisfaction levels do recover if a Service Improvement Plan (SIP) is put in place but loyalty does not. This does not mean the Slack example discussed above is not true. It just means that you need to go to extraordinary lengths to win back the trust and loyalty of clients when they experience a service failure.

The Relationship between Service and Trust

Some years ago I wrote a blog called Trusted Relationships = Consistently Good Service. It was based on our analysis of tens of thousands of customer feedback results from Deep-Insight’s database gathered over a period of 15 years. The analysis showed that of all the elements in our Customer Relationship Quality (CRQ™) methodology, Service Performance was most strongly correlated with Trust.

It stands to reason, if you think about it. What happens when you deliver a consistently good service to a client? Their levels of trust in you and commitment to your company increase. Fail to deliver the service consistently, and their trust erodes quickly. Consistently fail to deliver, and both trust and commitment levels can disappear completely. Trust and commitment also take a very long time to rebuild.

‘Quality is Free’ so make sure to get it ‘Right First Time’

There’s a really important lesson here. Service failures are the sworn enemies of long-term profitable relationships. That’s why it’s worth investing time and effort to minimise the chances of a service failure ever happening in the first place. You may never succeed completely but it will be worth the investment. In fact, it won’t cost you anything.

This is where the old Total Quality Management (TQM) principles come into play. In 1979, Philip Crosby wrote a seminar book called Quality Is Free. His basis message was that it costs absolutely nothing to build quality into products and services. If anything, you’ll make money by reducing the cost of re-work and failed business relationships.

Quality really is free, so if you’re in the service business, make sure to get it right first time.

If you operate in the B2B world, ask yourself the question: “Is CSat the right thing to be measuring in the first place?” Maybe you should be measuring something different.

UPDATE: 27 APRIL 2023

We have just written a follow-on article on the Service Recovery Paradox in B2B companies. Click here to read.

If Trust is so important, why do so few companies measure it?

Most people understand implicitly that good Business to Business (B2B) relationships are built on a strong foundation of trust. But if Trust is so important, why do so few companies measure it? It’s a question that has always intrigued me. I must admit that I’m still struggling to find the answer.

The fact is that CEOs keep tabs on all sorts of KPIs. For operational performance, there are lots of service level agreements (SLAs) and other three letter acronyms (TLAs). Logistics companies even have five letter acronyms like DIFOT – Delivery In Full On Time. For financial performance, the CFO has an eye-watering array of metrics. For customer performance, there is customer satisfaction (CSat) and Net Promoter Score (NPS).

But rarely, if ever, is there a metric for Trust that is discussed by the leadership team or reported to shareholders.
 

How Important is Trust?

A couple of weeks ago, I ran a short poll on LinkedIn, asking people what they thought was the most important element of a strong B2B relationship. It wasn’t a trick question as we believe at Deep-Insight (based on pretty good academic research) that the three key pillars of a great B2B relationship are Trust, Commitment and Satisfaction.

I wasn’t surprised by the winner but I was intrigued by the margin. It appears that Trust really is seen as the cornerstone of a strong B2B relationship.

Trust Commitment Satisfaction
 

Trust, Commitment and Satisfaction

How are they all related? Here’s how we explain it.

If you take a purely commercial view of any business relationship – and you shouldn’t – it’s all about the revenues you can generate from that relationship over the long term. I know that’s a bit mercenary but that’s how some people view things. The greatest predictor of a long-term relationship is Commitment and it’s important that you measure your clients’ commitment to you. We ask that question quite bluntly to our clients’ customers: “Are you committed to a long-term relationship with [Name of Client]?”

It turns out that the answer to this question has the highest correlation with the likelihood of the company buying from our client again in the future. The opposite is also true. A poor score is the best predictor that the customer will defect to the competition.

But remember: commitment to a long-term relationship is only the outcome of other factors. Two of the most important factors are Trust and Satisfaction. Trust is all about fairness, honesty and acting with integrity. It’s a reflection on what clients think of your brand but, more important, it’s their perception of how trustworthy your people are as well.

Satisfaction, on the other hand, is a measure of how well you meet (or exceed) a client’s expectations. It’s more transactional than Trust, and also more volatile. For example, you can be satisfied with your IT service provider today, but deeply unhappy tomorrow when the network crashes and your factories or stores can’t operate. When the IT service provider pulls out all the stops and fixes the problem in double-quick time, you’re both relieved and satisfied again. Satisfaction scores can fluctuate wildly. Trust scores? Not so much.

 

Trust at Serco

One of our clients that takes Trust seriously is Serco. It’s one of Serco’s four stated values: Trust, Care, Innovation and Pride.

Trust at Serco

Serco is quite clear about both what Trust is, and what it is not. Here are the behaviours it expects from its people:

  • Do what they say they will, try their best and see things through
  • Consistently provide the highest standards of customer service
  • Have a can-do, will-do attitude
  • Are open and honest
  • Communicate truthfully, clearly and concisely
  • Aim to always do the right thing and never compromise our values
  • Think through the consequences of their decisions
  • Speak out when they see something wrong
  • Understand who our customers are, listen to them and act upon their feedback
  • Challenge assumptions in an appropriate way
  • Acknowledge when they make mistakes and take responsibility for correcting them
  •  

    Similarly, Serco believes Trust is not demonstrated if employees or the leadership:

  • Make promises that we cannot keep
  • Rush to provide solutions before listening to others’ needs and opinions
  • Fail to keep customers and colleagues informed
  • Are not straightforward and transparent
  • Allow disrespectful or discriminatory behaviour
  • Knowingly use Serco’s resources for personal gain
  • Break our Code of Conduct or the law
  • Falsify or misrepresent information
  • Ignore and don’t speak up when we see something wrong
  • Choose to ignore adverse criticism
  • Blame others for mistakes we have made or things we have missed
  • Shift our responsibilities to others
  •  

    Why do so few companies measure Trust?

    How many companies measure have identified Trust as a core company value and measure it in a systematic way? The short answer is that very few B2B companies measure Trust at all. Serco is one of the few that even identifies it publicly as a core value. Isn’t that strange? Business magazines and articles are full of ideas and tips for becoming trusted advisors. A lot of CEOs and company boards talk about “trusted relationships” with clients in their annual reports to shareholders.

    Trusted Relationships

    Interestingly, the same CEOs and boards talk about trusted relationships but then quote the company’s Net Promoter Score (NPS). Now don’t get me wrong. There’s nothing wrong with NPS but it’s not a measure of Trust. It’s a measure of Advocacy. Yes, the two are related but it you’re going to talk to shareholders and clients about “Trusted Relationships” or “Acting as Trusted Advisors” then you really should go and measure your performance directly.

    Sometimes NPS isn’t enough. It’s a good metric – simple and easy to understand. But it’s one-dimensional. If you really want to understand how trusted a relationship you have with your clients, you need to measure Trust as well as NPS of CSat (Customer Satisfaction). As a CEO or Sales Director, you need to understand if your key clients are Ambassadors who trust you implicitly, or Stalkers and Opponents who want to get out of the relationship because levels of Trust (and Commitment and Satisfaction) are so low.

    If you want to know more about measuring Trust, have a read of this blog.

    Alternatively, get in touch with us today.