loading

Experience Training| Hitchhikers Platform

What You’ll Learn

In this section, you will learn:

  • Experience Training Overview
  • Experience Training for Featured Snippets
  • Experience Training for Spell Checking
  • Experience Training for NLP Filters

light bulb
New Release Feature
This unit references the new modifying predictions in Experience Training feature from our November ‘21 Monthly release. Test out the new feature in Hitchhikers and Playground Accounts. To turn on this beta feature (“Winter ‘21: Experience Training Updates (early access)” in your Production account, you can fill out this form here.

Overview

Experience Training is a great way to improve the quality of search results. It allows admins to train the Answers Algorithm by providing it feedback on its predictions. With your input on a specific search term, you can fix that query instantly and help Answers improve the relevancy of results over time. It is a critical tool for debugging backend issues and optimizing results for all search experiences. The more feedback that you provide or corrections that you apply here, the better the algorithm can perform in the future.

Experience Training can be found within the Answers > Experiences tab of your Yext account, or via Configuration as Code (CaC). To learn more about the Config resource schema, you can find the documentation here.

Experience training allows you to train the Answers algorithm in three areas:

  • Featured Snippets
  • Spell Checking
  • NLP Filters

As you learned about in the Core Configuration - Direct Answers unit, Featured Snippets extract direct answers to users’ questions from unstructured data. The experience training tab contains the full, unique set of all Featured Snippets produced with Document Search.

Within the UI, you have the ability to accept, reject, or modify the Featured Snippets in the experience. With any action you take on featured snippets, you are providing feedback so the algorithm can get smarter over time. In addition, it also corrects queries:

  • If you reject a Featured Snippet, it will suppress it from the results set and never return that snippet back to the end user.
  • If you accept a Featured Snippet, that result will then display on search results if you have snippets set to APPROVE_ONLY.
  • If you modify a Featured Snippet, the modified snippet will show in future search results.

experience training featured snippets

Below we walk through several key features of the Featured Snippets Experience Training table:

  1. Deduplication: The Featured Snippets table dedupes on both search term and featured snippet to show one row per featured snippet per search term. There can be multiple Featured Snippets for the same search term for two reasons:

    • The results set can change (through changes in the Knowledge Graph or in the configuration)
    • The algorithm gets retrained as it gets more feedback.

    Users can see all the different predictions the algorithm has made for a particular search term.

  2. Entity Information: See the entity (hyperlinked) and field that the featured snippet came from, which is crucial context to determine whether or not a featured snippet is correct.

  3. New vs. Completed: Toggle to see the featured snippets that have already been approved, rejected, or modified. This makes it easier for users to find completed training examples.

    experience training featured snippets completed

  4. Number of Searches: See the number of searches for this search term in the past 30 days (not the number of times this particular snippet was displayed) to prioritize search terms that have been searched more often.

  5. Last Searched: See the most recent search time for each search term. The table is sorted by this column by default, and now you’ll be able to see it explicitly.

  6. Training Actions: Here you have the ability to accept (checkmark button), reject (x button), or modify (wand button) featured snippets suggested by the algorithm.

When you click on the modify wand button, you will see a pop-up modal that will allow you to accept, reject, or modify featured snippets. If the AI algorithm identifies the incorrect portion of text from your entity, you can select a different portion of text to be used as the featured snippet for the query going forward.

The modal will automatically expand the highlighted section to only include full words. The right side of the modal shows the original versus updated answers.

featured snippet modal demonstrating how to edit the snippet

You can access the Featured Snippet modal from three parts of the platform by clicking the wand icon to edit.

  1. Test Search (both sidebar and full screen)

    experience preview screen with wand button highlighted

  2. Search Logs

    search log screen with wand button highlighted

  3. Featured Snippets Experience Training Table - this is where we were above!

    experience training screen with wand button highlighted

Spell Checking

Here you can review any suggested spell checks and accept or reject the corrections. If you reject a correction, the algorithm will no longer surface that correction when that search term is run for that experience. You can also toggle to see spell check suggestions that have been accepted or rejected.

experience training spell check

NLP Filters

Here you can review the NLP filters that were applied to any queries run and accept or reject. If you accept one, you are helping to train the algorithm to better understand your brand and preferences. If you reject one, the algorithm will no longer apply that NLP filter for that search term for that experience.

experience training nlp

unit Quiz
+20 points
Daily Quiz Streak Daily Quiz Streak: 0
Quiz Accuracy Streak Quiz Accuracy Streak: 0
    Error Success Question 1 of 3

    What featured snippets will show if you set it to APPROVE_ONLY?

    Error Success Question 2 of 3

    What happens when you reject a spell check suggestion in Experience Training? Select all that apply.

    Error Success Question 3 of 3

    How is the Featured Snippets Experience Training table deduped and organized?

    You're out of this world! 🌎

    You've already completed this quiz, so you can't earn more points.You completed this quiz in 1 attempt and earned 0 points! Feel free to review your answers and move on when you're ready.
1st attempt
0 incorrect
Splash Loading