High school project idea · Technology & AI
Put competing AI systems through the same real tasks and discover why “best” depends on what you measure.
Design a fair comparative evaluation of several AI models or configurations for a narrow, benign use case using transparent criteria and repeatable tests.
Why this project matters
Design a fair comparative evaluation of several AI models or configurations for a narrow, benign use case using transparent criteria and repeatable tests. This project feels different from a school assignment because the student serves a team choosing an AI tool for a defined low-risk workflow, creates something visible, tests it honestly, responds to feedback, and explains the decisions behind the final result.
What you will create
Use these deliverables as milestones for Run an AI Model Bake-Off. Adapt the details to your interests, available time, and real-world opportunities.
Research use case, test set, scoring rubric, blind review, latency, cost, consistency, hallucination, privacy, accessibility, and model updates. Document the needs, constraints, credible sources, and perspectives of a team choosing an AI tool for a defined low-risk workflow.
Turn the evidence into a focused plan for the comparative AI benchmark and recommendation, including success criteria, ethical boundaries, scope, and a realistic path to completion.
Create the first complete version of the comparative AI benchmark and recommendation. Include a use-case specification, representative test set, scoring guide, model run log, blinded outputs, quantitative results, qualitative error analysis, and recommendation.
repeat a sample across days or settings, use multiple reviewers for subjective scores, and report whether small changes reverse the ranking Record what happened, what failed, what users or reviewers said, and which changes you made.
Publish the final comparative AI benchmark and recommendation with a portfolio-ready case study showing the challenge, evidence, process, revisions, results, limits, and next version.
Make the work stronger
For Run an AI Model Bake-Off, use these checkpoints to protect the quality of the work without turning the project into a performance for admissions.
Skills you can build
College application value
Can demonstrate initiative, curiosity, reflection, and growth through the student’s choices, response to setbacks, work with a team choosing an AI tool for a defined low-risk workflow, and development of Benchmark Design, Quantitative Evaluation, and AI Product Analysis.
The goal of Run an AI Model Bake-Off is not to manufacture an impressive activity. Do real work, keep evidence of the process, and reflect honestly on what changed.
Related college majors
Use Run an AI Model Bake-Off as a clue, then open a related major guide to compare coursework, career directions, reality checks, and other ways to test the field.
Learn how intelligent systems learn, reason, generate, perceive, and interact with people, then decide where human judgment still matters most.
Study how increasingly capable AI systems should be evaluated, governed, audited, and integrated into institutions people can trust.
Build machines that can perceive, decide, and act with less direct human control.
Run an AI Model Bake-Off is an original Compass educational starting point designed around real work, visible evidence, feedback, and reflection. It is not an admissions guarantee.