Preference measurement: Maximum Difference Scaling

Appinio Research · 20.10.2022 · 6min read

Game Pieces

As a marketer or decision-maker, you may often wonder which product features or services are most important to your customers or target audience.

 

However, not all features or services can make the final cut in your product offerings. This is why prioritizing these features is crucial.

 

One effective method for this is Maximum Difference Scaling (MaxDiff), also known as "Best Worst Scaling." MaxDiff involves presenting respondents with sets of product attributes and asking them to select the best and worst alternative in their view.

 

By analyzing the results, you can derive concrete preference or importance rankings, helping you to make informed decisions that align with your customers' needs and wants.

 

How does a MaxDiff scaling work?

To conduct a MaxDiff scaling, you first create a list of items (such as product features) whose importance you want to determine from the customer's point of view.

 

These items are then randomly divided into sets of 4-6 alternatives each, with each item appearing equally often with every other item.

 

Respondents are presented with each set and asked to select the best and worst alternative from their perspective. The difference between the best and worst alternative is the "maximum difference," which gives the technique its name.

 

Based on the respondents' MaxDiff scores, you can create a preference or importance ranking. The ranking is calculated from the overall score, which is the difference between the proportion of positive and negative evaluations and can range from -100% to +100%.

 

This process allows you to identify which product features or services are most important to your customers, enabling you to make informed decisions about your offerings.

 

 

Sign up to the Appinio platform for free and browse among templates and case studies for the MaxDiff scaling method.

 

 

Advantages and disadvantages of MaxDiff scaling

 MaxDiff scaling is a versatile research method that can be applied in a wide range of areas, from product features to services, claims or associations.

 

Its main advantage is that it avoids claim inflation, where all attributes are considered important and their relative importance cannot be determined.

This is particularly helpful in situations where respondents are given a simple list of attributes, as they may assign equal importance to each one.

 

In contrast, MaxDiff scaling requires respondents to prioritize attributes very precisely, making it easier to determine their true importance.

 

Further Advantages

  • Surveys for MaxDiff Scaling are very simple and therefore very efficient. Each respondent is presented only four items per question, from which they must choose the best or the worst.

  • This makes surveys seem less overwhelming for respondents, particularly when compared to long lists, therefore results are higher quality.

     

  • The different attributes can be directly contrasted and compared based on their importance, and the simple presentation of results facilitates analysis.

Disadvantages

  • It only provides information about the relevance of a particular attribute, not about different variations of it. To determine preferences among different variations, a systematic testing of those variations is recommended.

  • It may not be suitable for certain aspects such as pricing models, where respondents may always prefer the smallest price.

  • While MaxDiff scaling can indicate how important an attribute is compared to others, it does not provide detailed information on how attributes are rated in relation to one another.

Conclusion

In conclusion, MaxDiff scaling is a highly versatile and efficient method for measuring customer preferences in various areas, including product features, services, claims, and associations.

 

By prioritizing different attributes in comparison to each other, this method helps to avoid claim inflation and provides a precise and intuitive ranking of the most important and least important attributes according to the respondent's perspective.

 

With the results presented in easily interpretable percentage values, businesses can use MaxDiff scaling data to make informed decisions about their products or services and gain a better understanding of their target group's needs and preferences.

 

MaxDiff Scaling explained

  • A MaxDiff analysis helps identify the attributes that are particularly important to potential customers for services, products, or even advertising materials, logos, designs, and claims, and how they are prioritized.
  • A general rule of thumb is to collect a minimum total sample size of 300. To ensure that segments of interest gets factored into the number of collected responses, we recommend that each segment has a n > 150.
  • To find out about the best sample size for your market research the target audience needs to be clearly defined. This can be done via target group analysis. Sample sizes can also be calculated with the Appinio sample size calculator.
  • Too large a sample may amplify the detection of differences, emphasizing statistical differences that are not clinically relevant.
  • MaxDiff scaling is available in Excel using the XLSTAT statistical software but the Appinio platform is offering this service to you in a quick and easy way.

Interested in running your own study?

In our dashboard, you will find questionnaire templates that you can customize and get the insights you need to bring your brand to the next level.

 

Join the loop 💌

Be the first to hear about new updates, product news, and data insights. We'll send it all straight to your inbox.

You can call this via showToast(message, { variant: 'normal' | 'error' }) function