Ask HN: What would make you trust an AI's assessment of your understanding?

Creating an AI tutor that won't let you progress without having learned anything — not just completing a test. You train, are diagnosed for any problems in understanding, and there is now a live voice challenge where you need to verbally explain your response to an AI, and then it drills down with additional questions.

The voice feature was created by me under the suspicion that it is way more difficult to pretend to have understood something while talking to someone rather than choosing a proper multiple choice answer. But to be honest, I don't know if that is a valuable idea or just another sign of my attachment to the most complicated thing I created.

So, the question I want to ask seriously is: What would help you to trust an AI's diagnosis of your understanding? And is it even worthwhile, or should I stick to the solution of doing spaced repetition and trusting myself?

4 points | by Aditya_0315 1 day ago

5 comments

  • mfalcon 22 hours ago
    I'd like to get the reasoning trace by stage in order to verify the AI work. I'd like the AI to explain me why it thinks I'm lacking knowledge on some specific topic or sub-topic.

    To finally trust the AI I'd like for it to find (if the content has already some human created exercises) or generate some question/exercise that confirms their diagnosis.

    [-]
  • nitwit005 1 hour ago
    You're saying "not just completing a test", but this will inevitably be a test, just in conversation form.
    [-]
  • rajeasy 16 hours ago
    Trust yourself ,issue come when ai understood context differently than you and even after long discussion - you create well documented instruction - it can infer differently. and never use gemini for this.
    [-]
  • Inozem 1 day ago
    [flagged]
  • calcpave 13 hours ago
    [flagged]