Summary: Knowledge Check in AI Settings is a tool inside AI Settings that lets you type a guest-style question and instantly see whether your AI Assistant can answer it. You'll get the same synthesized answer a guest would receive, along with every source used to build it.
This makes it easy to spot gaps in your knowledge base before a real guest runs into them. It also lets you self-serve investigate incorrect answers: if a team member spots that Allin gave a guest the wrong information, an admin can replicate the same question in Knowledge Check to see exactly which document or piece of learned knowledge caused the mistake, or where the knowledge base is missing information.
Permissions Required: Brand Admin or Location Admin with access to AI Settings.
🗒️ Before you start
Knowledge Check is currently behind a feature flag, meaning it needs to be turned on for your account before it will appear. If you don't see it in your AI Settings, contact your Alliants Customer Success Manager to have it enabled (or disabled, if you'd like to turn it off).
Steps to follow
To check at brand level:
Go to Settings.
Click Brands.
Go to AI Settings.
To check at location level:
Go to Settings.
Click Locations.
Find the location you want to check, then click into it.
Go to AI Settings.
Then, for both:
Find the Knowledge Check section on the page.
Type a question into the box, the same way a guest might ask it (for example, "What time is check-out?").
Click Check (or press Enter) to run the search.
Review the results:
If the knowledge base can answer, you'll see the synthesized answer plus a list of supporting sources, grouped by type (Documents and Learned Knowledge).
If it can't, you'll see a clear "no answer found" message instead of a guess.
ℹ️ Important:
At location level, Knowledge Check only searches that location's own knowledge sources.
At brand level, it searches across the brand.
Investigating an incorrect answer
If a team member notices that Allin gave a guest the wrong answer, Knowledge Check lets an admin self-serve the investigation instead of raising a support ticket.
Ask the team member for the exact question the guest asked (or the closest match) and which location it happened at.
Go to Knowledge Check at that location (or brand level, if the issue isn't location-specific).
Type the same question in to replicate the guest's experience.
Compare the answer and sources returned to what the guest was actually told.
Check the sources listed:
If a Document is outdated or wrong, update or replace that document.
If a piece of Learned Knowledge is incorrect, correct or remove it.
If no source is shown, or the result is "not found," the knowledge base is missing that information and a new document or learned knowledge entry should be added.
This turns most "why did the AI say that?" questions into something you can diagnose yourself in a couple of minutes.
Common Questions
Q: I don't see Knowledge Check in my AI Settings. Why not?
A: Knowledge Check is rolled out behind a feature flag, so it isn't switched on for every account by default. Reach out to your Alliants Customer Success Manager and ask them to turn it on for your brand or location.
Q: Can I turn Knowledge Check off again?
A: Yes. Since it's controlled by a feature flag, your Customer Success Manager can switch it off for you at any time.
Q: What's the difference between running a check at brand level versus location level?
A: A location-level check only searches that location's knowledge sources, so you're testing exactly what a guest at that property would get. A brand-level check searches across the whole brand, which is useful for spotting gaps that affect every location.
Q: What do "Documents" and "Learned Knowledge" mean in the results?
A: Documents are answers pulled from your uploaded knowledge base files. Learned Knowledge are answers built from information your team has previously taught the AI Assistant directly. Both are shown separately so you can see exactly where an answer came from.
Q: Can guests use Knowledge Check?
A: No. It's a staff-only tool inside AI Settings, designed to help your team test and improve knowledge base coverage — guests never see this screen.
Q: What happens if the AI Assistant can't answer my test question?
A: You'll see an honest "not found" message with no sources listed, rather than a made-up answer. This is a signal that you may want to add a document or teach the AI Assistant that piece of knowledge.
Q: A guest told us Allin gave them the wrong answer. How do I find out why?
A: Ask what question the guest asked and where, then run that same question through Knowledge Check at the relevant location.
The sources returned will show you exactly which document or piece of learned knowledge produced the answer, so you can correct or remove it. If no source appears, the knowledge base simply doesn't have that information yet and needs a new entry.