⏱️ The Essentials in 3 Minutes |
🧠 Understand the Pedagogical Value of Response Reliability
An AI-based learning tool raises a legitimate question: how does the learner know whether they can trust the response they receive? Without a transparency mechanism, the risk is twofold: either the learner blindly believes an incorrect response, or they become systematically skeptical and stop using the coach altogether.
The reliability index addresses this challenge. By explicitly displaying the origin and solidity of each response, the coach develops a critical thinking reflex in the learner: they know when to act directly on the response received, and when to verify with an expert or a source document.
ℹ️ Need help activating the Coach? See our practical guide: Coach Activation.
🔍 Discover the Four Reliability Levels
The reliability index is displayed only when the coach responds to a question asked by the learner. It can take four values, depending on what the coach finds in your knowledge base.
When the coach finds information in the knowledge base:
Information available: the knowledge base explicitly contains the answer to the question asked. The response is direct and documented.
Partial information: the response is obtained through deduction, by cross-referencing multiple sources or extrapolating. For example, if a learner asks "how to better sell this product" and the product sheet contains a description without a sales pitch, the coach builds a pitch from the description but signals to the learner that it is worth verifying the result.
When the coach does not find information in the knowledge base:
Information unavailable: the question is specific to your organization (internal process, technical documentation). The coach indicates to the learner that the topic is not documented and suggests they reach out to the relevant people.
General knowledge: the question is general (sales tips, programming language, etc.). The coach elaborates a response specifying that it draws on its general knowledge, and therefore that verification is recommended.
💡 Know When the Index Does Not Appear
The reliability index is only displayed on responses to questions asked by the learner. It does not appear in other contexts, such as during a practice session: in that case, the questions were generated solely from available knowledge, so the reliability is by definition "Information available".
❓ Frequently Asked Questions for Your Learners
Does "Partial information" mean the response is unreliable?
Does "Partial information" mean the response is unreliable?
No. It means the coach exercised creativity by cross-referencing sources or deducing a response from elements not explicitly stated in your documents. For example, if a learner asks for a sales pitch based on a product sheet and the coach has a descriptive sheet and a source on "how to formulate a relevant pitch", it cross-references the two to respond. The learner is then invited to consult the sources to ensure the cross-referencing is relevant in their specific context.
Keywords: reliability, confidence index, AI Coach, knowledge base, transparency, critical thinking.