Taste Test Quick Start Guide

May 28, 2023

Flavor Studio’s Taste Test framework is available to Premium- and  Admin-level users. 

Flavor Studio’s Taste Test tools make online survey authoring easy: recruit and manage your panel, create user-friendly, customized questionnaires, collect data, and run analyses on your sensory and consumer tests. Results are displayed graphically with simple-to-interpret images.

This Quick Start will guide you through the steps to create a complete Taste Test. If at any point you want to do more than the basics, links will be provided to comprehensive knowledge base articles. If you find yourself stuck with an issue, the Taste Test FAQs will probably have the answer.

Here’s the scenario: we have one product, some delicious sourdough bread, and we want to conduct a taste test with an invited group of tasters. When the test is closed, we’ll look at the results.

Creating a new survey requires six steps:

  1. Create the new Taste Test with some basic information
  2. Add the Product for Evaluation
  3. Create the Questionnaire
  4. Invite Tasters
  5. Conduct the Test
  6. Analyze the Results

But first... the Taste Test UI

Working with a Taste Test involves one page with four tabs. We’ll start with the leftmost tab: Manage, then create the survey with the Questionnaire tab, then back to the Tasters tab to add the test participants. When you want to start or stop the test, go back to the Manage tab. After the first Taster submits their questionnaire, the Results tab will be displayed to the right of the Questionnaire tab.

 

Create a new Taste Test 

TT FAQ, There actually isn't an FAQ for this topic

Article: Publish Content 

 

 To create a new Taste Test

  1. Click on the New Taste Test button in the top right corner of the TASTE TESTS page. The New Taste Test dialog box will open.
  2. The only required field when creating a new test is Name. If your product has more than one version, add the version number to the name of the test.
  3. Information in the remaining four fields is optional and can be done later.
  4. After you click SAVE, the newly created Taste Test page will open.

At this point, you can change any of the information in the above fields, as well as configure some additional properties, such as whether the survey will be anonymous. Since we will be inviting the Tasters via email, this test will not be anonymous.

A note about saving: There is no SAVE button for the Taste Test  page. All of your changes are automatically saved. However, as you add questions to the survey, they will need to be saved..

 TOP

 

Add the Product

TT FAQ, There actually isn't an FAQ for this topic

Article: Publish Content 

 The Manage tab provides space on the right side of the page to add one or more products. Products are any of the Recipes that have not been moved to Production. We’ll just add one product, our delicious Sourdough Bread.

 To add a Product: 

  1. Click the large + symbol inside the circle beneath the PRODUCT SECTION label. A search dialog will open, allowing you to search for products.
  2. Click OK
  3. Once a product has been added, Flavor Studio will add it to the list of products, along with a random number that will be used when referring to the product in the survey. This code should be used when presenting the sample to the tasters. 
  4. If the product has an associated image, it will appear beside the product. 

At any point, you can edit the products and change the associated product image. Details on all these operations are described in the TBD article link.

 TOP

 

Create the Questionnaire

TT FAQ, There actually isn't an FAQ for this topic

Article: Publish Content 

 The Questionnaire section allows you to design easy-to-use sensory survey instruments, for anonymous or identified respondents. Flavor Studio provides the ability to create every kind of sensory survey question. These capabilities are fully described in the Taste Test Questionnaire article.

Surveys are ordered into three sections:

  • Screener Questions
  • Product Questions
  • Follow-Up Questions

Each of the sections is initially empty as you add new questions they will be added to the chosen section. Within each section, you are free to order the questions as you prefer. 

We’ll add a question for each section that demonstrates the range of questions Flavor Studio can create. Let’s create a Screener question. 

 

Screener Question Types

Screening questions let a survey creator target questions to a specific audience by filtering respondents.  The current Screener dropdown list includes the following:

  • Always - Never
  • Race/Ethnicity
  • Income
  • Age
  • Frequency
  • Recent experience
  • Gender

We’ll add a question about Income.

 To Add the First Screener Question

  1. Click the Questionnaire tab.
  2. The Question Designer will open displaying two tabs: Info (default) and Options.
  3. On the Info tab, click the Section dropdown and choose Screener. The form will change to show the fields needed for a Screener question.
  4. On the right side of the dialog, click the Select screener dropdown, and choose Income. This will generate a set of seven options for typical income brackets. Select screener dropdown.
  5. Just below the Section dropdown is the Question Name field.
  6. Enter Income. The Name will be used in a label test form and in the Results of the test.
  7. Underneath the Question Name field is the Question Prompt. This field contains the actual question presented to the tasters. 
  8. Enter: Which of the following best describes your personal income last year?
  9.  At this point you can add, delete or change any of the response options generated by Flavor Studio. 
  10. In the bottom right corner of the Question Designer you will find two buttons to ADD IMG save or ADD IMG cancel adding or modifying a question. Questions that have not been saved will be lost and cannot be recovered if the web page is changed to a new URL.
  11. When you click   ADD IMG  save, the Question Designer will display the Question Name, Prompt, and Response Options. Under the list of options, you’ll see the following text:  Required Question. Let’s change this.
  12.  If you place your mouse over the bottom right corner of the Question Designer you will now find four buttons: Edit (pencil) Preview (eye) Duplicate (2 documents) Delete (trashcan). Click Edit. The Question Designer will display the edit fields.
  13. This time, click the Options tab, just to the right of the Info tab. For this type of Screener question, there is only one option: whether this question is required or not. Since this survey is not anonymous and personal income can be a sensitive subject, let’s make this question optional: uncheck the Response Required checkbox.
  14. Click  ADD IMG  save. 

That’s basically the process for each Questionnaire section and for every type of question. If you like, add a second screener question, otherwise let’s move on to a Product question.

 TOP

To Add a Product Question

  1. Click the New Question button (blue circle and PLUS symbol) in the upper right of the list of questions.
  2. Under the Info tab, click the Section dropdown and choose Product. There are seven predefined Product questions:
  3. Multiple Choice
  4. Scales
  5. A/B
  6. Liking
  7. JAR - Just About Right
  8. Attribute Intensity
  9. Text Input
  10. To get a better sense of each option, click them to see the predefined options.
  11. For this example, let’s choose Multiple Choice, as it gives you complete freedom to craft the best questions for your product.
  12. In the Question Name field, enter Favorite way to consume.
  13. In the Question Prompt field, enter: Of the following choices, which is your favorite way to consume sourdough bread? 
  14. When you chose the Multiple Choice question, Flavor Studio added three empty options, and beside each option, the Next Step dialog, which allows you to create a branch in the Questionnaire.
  15. In the Option 1 field, enter: Warm, with butter.
  16. Click on the Next Step dialog to the right of Option 1, and choose Continue to next question.
  17. In the Option 2 field, enter: As a sandwich. 
  18. Set the Next Step dialog to the right of Option 2 to Continue to next question. 
  19. In the Option 3 field, enter: Toasted. 
  20. Set the Next Step dialog to the right of Option 3 to End questionnaire. In this example, we believe that people who like their Sourdough toasted don’t really appreciate the finer points of this bread. So we will end the survey for these people.
  21. Click  ADD IMG  save.

Let’s finish the last type of Question, a Follow-Up. 

To Add a Follow-Up Question

  1. Click the New Question button (blue circle and PLUS symbol) in the upper right of the list of questions.
  2. Under the Info tab, click the Section dropdown and choose Follow-Up. Follow-Up questions have just one option: a free-form Text Input question.
  3. In the Question Name field, enter Final thoughts.
  4. In the Question Prompt field, enter, Please tell us what you thought about our Sourdough bread.
  5. Click on the Options tab of the Question Designer. 
  6. Check the checkbox labeled, Load image associated with each Recipe, and the checkbox labeled Response Required.
  7. Click  ADD IMG  save.

 TOP

To Preview the Questionnaire

At any point in the process of creating or running a taste test, you can see exactly what the tasters will see when they take the survey.  

  1. Click the Preview button, (eye in a large blue circle) located in the upper right area of the page. 
  2. Flavor Studio will start the preview by displaying the general Taste Test information you added (or skipped) at the beginning of the Quick Start. 
  3. Click Next. Flavor Studio will display the first question.
  4. Click any option and the preview will change to the next question.
  5. You can choose Close or Next or, when all questions have been answered, Submit. Your responses are not recorded during the Preview.
  6. If you want to allow the tasters to go back to a previous question
    1. Click Close.
    2. Click the Manage tab.
    3. Scroll to the bottom of the page and change the Back Button dropdown from Disabled to Enabled. 
    4. Click the Questionnaire Preview button again.
    5. After you have responded to the first question, note that the Back button is now displayed.
    6. Click Close or Submit.

 TOP

 

Invite the Tasters 

TT FAQ, There actually isn't an FAQ for this topic

Article: Publish Content 

 Flavor Studio provides three ways to collect responses from tasters:

Invite people via email, including bulk import of email addresses.

Distribute the QR code image (does not require an invitation) 

Something akin to a central location test (CLT) where people are not invited but happen to be in the same place. 

 

We’ll use the first method.

Invite Tasters

 There are three ways you can invite tasters to participate in the survey, all explained below:

  • Click ADD TASTERS from the TASTERS section of the Manage tab.
  • Use the Send Individual Invite button (email icon), 
  • Use the Send Mass Invite button (multiple emails icon). Both are found on each tab, located in the upper right of the test page.

 

 Send Individual Invite

To send an Individual Invitation 

  1. Click the Send Individual Invite button (email icon) in the upper right, or click the ADD TASTER + icon under the TASTERS section of the Manage tab.
  2. Enter the taster's name and email address and click OK. Flavor Studio will immediately send an invitation by email.

The email invitation will give the taster the opportunity to accept or decline the invitation, which will then be shown in the Confirmations section of the page.

Flavor Studio’s invitation email also makes it easy for tasters to add the survey invitation to several popular calendars (Yahoo, Google Outlook, or Apple).

 TOP

 

Conduct the Test

TT FAQ, There actually isn't an FAQ for this topic

Article: Publish Content 

 Start Test

 A test has not been started if the status in the Progress section is set to Pending.

If a test has not been started, tasters are unable to use any of the QR Codes, Test Codes, or web page links to the survey. 

To start the test, Click the Start Test button to the right of the Progress section

An information dialog will appear:

You will be given the participation link and code on the next page.

The Progress status of the Manage tab will change to Running.

 

 Close Test

 To Close the test, which will stop tasters from responding to the QR Code, Test Codes, or web page links, click the Close Test button, to the left of the Progress section on the Manage tab. The Progress status will change to Completed.

Anyone attempting to use a web page link when the test is closed will be provided with the following notice:

 

Resume Testing 

To resume testing, and allow tasters to respond to the surveys, click the Resume Testing button, to the left of the Progress section. The Progress section status will change to Running.

 

Preview

At any point in the process of creating or running a taste test, you can see exactly what the tasters will see when they take the survey by clicking the Preview button, located in the upper right area of the page. 

 TOP

 

Analyze the Results 

TT FAQ, There actually isn't an FAQ for this topic

Article: Publish Content 

 Results

 Once you have started a survey, you have access to the results. The number of results will be shown just to the right of the Results tab label. 

Example

Results (24)

 You can refresh the results by clicking on the Results tab label. There’s no need to refresh the page. The results will be displayed in the order in which they appear in the survey.

Note: You can download the results in a variety of formats by using the Publish Taste Test feature.

There are three versions of the Results that can be published:

  • Summary Report
  • Comprehensive Report
  • Shelf Life Report

Summary Report

The Summary Report PDF will present:

  • each Question Name, (not the Question Prompt)
  • the question type (A/B, Liking, Demographic, etc.)
  • the available options 
  • the number of tasters that chose each option
  • The percentage of tasters that chose each option
  • a graphical representation of the chosen option distribution

Examples 

Coffee importance Scales Not at all important     ⬜⬜⬜⬜     0 ( 0%)
Somewhat important                                                  ⬛⬜⬜⬜ 10 (25%)
Extremely important                                                   ⬛⬜⬜⬜ 10 (25%)
Very important                                                             ⬛⬛⬜⬜ 20 (50%)

 

Preference: Coffee A or B     A/B

5152-B Classic Peanut Butter Cookie            22 (100%)

 TOP

Comprehensive Report

The Comprehensive Report CSV file will contain:

  • Participant ID            - Respondent # (System-generated)
  • Email            - email or empty if anonymous
  • Participant Name            - if provided
  • Question Name            - ex: Prefer A or B
  • Question Category        - Screener, Product or Follow-Up
  • Question Type           - Liking, Scales, Frequency, A/B etc
  • Product Name           - ex: 5152-A Classic Peanut Butter Cookie (V2)
  • Product Number           - ex:241
  • Anchors                   - No idea what this field is
  • Response                 - The option chosen by the Participant
  • Response Value          - The numeric value associated with the chosen option

 

Shelf Life Report

The Publish Shelf Life feature combines the results from two or more Taste Tests, for different versions of the same product. The results show the change in the Taster responses over time. 

The results of all the selected tests will be combined and ordered according to the Date entered in the Manage tab of the test. If no date was entered, then the results will be ordered as shown in the Publish Shelf Life dialog.

The results are presented, for each question, as a time-series line-chart showing the number of tasters that chose each option and the change over time for two or more Taste Tests.

Shelf Life Reports are available as downloadable PDF files.

Note: To change the image that is included with reports to one that represents your organization, ask your Admin to upload an appropriate image. Please see the section on Organization Logos in FS_KB_Admin_GeneralSetttings for details.

 TOP