High school project idea · Technology & AI

Teach an AI When to Call a Human

Design an AI system smart enough to recognize when the safest answer is to stop and ask a person.

Build a low-risk human-in-the-loop workflow where AI handles routine cases, detects uncertainty or higher stakes, and routes the right moments for review.

Original Compass project by Davisville LabsReviewed August 2026Goal real work, evidence, and reflectionEditorial standards →

Why this project matters

Learn by doing something real.

Build a low-risk human-in-the-loop workflow where AI handles routine cases, detects uncertainty or higher stakes, and routes the right moments for review. This project feels different from a school assignment because the student serves a team using AI for a defined information, classification, or support task, creates something visible, tests it honestly, responds to feedback, and explains the decisions behind the final result.

What you will create

Your project plan

Use these deliverables as milestones for Teach an AI When to Call a Human. Adapt the details to your interests, available time, and real-world opportunities.

  1. 01

    User, data, and risk requirements

    Research use-case boundary, routine versus high-stakes cases, uncertainty, escalation signals, reviewer workload, override, audit trail, privacy, and feedback loop. Document the needs, constraints, credible sources, and perspectives of a team using AI for a defined information, classification, or support task.

  2. 02

    Technical architecture and test plan

    Turn the evidence into a focused plan for the human-in-the-loop AI workflow prototype, including success criteria, ethical boundaries, scope, and a realistic path to completion.

  3. 03

    Working product or prototype

    Create the first complete version of the human-in-the-loop AI workflow prototype. Include a task taxonomy, risk matrix, AI component, escalation rules, working workflow, human review interface, decision log, evaluation set, and operating guide.

  4. 04

    Reliability and usability test log

    run realistic routine and edge-case scenarios, measure missed escalations and unnecessary escalations, and observe reviewer speed, trust, and override behavior Record what happened, what failed, what users or reviewers said, and which changes you made.

  5. 05

    Final technology case study

    Publish the final human-in-the-loop AI workflow prototype with a portfolio-ready case study showing the challenge, evidence, process, revisions, results, limits, and next version.

Make the work stronger

What separates a finished project from a meaningful one?

For Teach an AI When to Call a Human, use these checkpoints to protect the quality of the work without turning the project into a performance for admissions.

Avoid this

  • Starting the human-in-the-loop ai workflow prototype before understanding a team using AI for a defined information, classification, or support task
  • Treating assumptions or internet opinions as real evidence
  • Choosing a scope too large to test and finish with care

Evidence that it is working

  • The audience and real problem are clearly defined
  • Research and evidence are documented
  • A working human-in-the-loop AI workflow prototype was created

If you want to go further

  • Test the work with at least five additional people from a team using AI for a defined information, classification, or support task
  • Interview a professional connected to AI Product Management and compare their advice with your approach

Skills you can build

Capabilities that travel beyond this project.

AI Workflow DesignDecision ThresholdsError AnalysisTechnical Problem SolvingResponsible Technology

College application value

Use the project as evidence, not decoration.

Can demonstrate initiative, curiosity, reflection, and growth through the student’s choices, response to setbacks, work with a team using AI for a defined information, classification, or support task, and development of AI Workflow Design, Decision Thresholds, and Error Analysis.

Technical CuriosityProblem SolvingCreativityIterationResponsible Innovation

The goal of Teach an AI When to Call a Human is not to manufacture an impressive activity. Do real work, keep evidence of the process, and reflect honestly on what changed.

How this guide was made

Teach an AI When to Call a Human is an original Compass educational starting point designed around real work, visible evidence, feedback, and reflection. It is not an admissions guarantee.

Read editorial standards →
Ready to build it?

Turn this idea into a step-by-step Compass project.

Try this project in Compass