Hire engineers for how they work with AI
Your engineers use AI assistants and coding agents every day. SetBenchmark tests that skill directly: candidates get a real task and an AI pair, and you see how they plan, prompt, check suggestions and catch the AI's mistakes.

What you get with ai fluency assessments
AI-allowed tasks
Candidates use a built-in AI assistant the way they would at work. You assess the whole process, not only whether the final code passes.
Agentic development environment
A full repository, terminal, browser and coding agent. The agent proposes steps; the candidate decides what to approve, edit or reject.
Everything recorded
Prompts, suggestions, accepted and edited changes, test runs and commits are captured for review.
Published rubrics
Reviewers score planning, prompting, verification and judgement with a published rubric, so AI fluency is measured consistently.
Catch over-reliance
Tasks include traps where the AI is wrong, such as changing a business rule to make a test pass. Strong candidates notice and push back.
Mix with AI-free tasks
Combine AI-allowed tasks with AI-not-allowed fundamentals in one assessment for a complete picture.
See judgement, not just output
Anyone can paste AI-generated code. The engineers you want know when the AI is wrong. SetBenchmark shows every decision a candidate made while working with the assistant.
- Timeline of prompts, suggestions and edits
- Which AI suggestions were kept, changed or rejected
- Test runs before and after each change

A fair, rubric-based score for AI skills
Reviewers see the session as a story and score it against a rubric your team agrees on. Results roll up into an AI fluency score on the candidate report.

See SetBenchmark with your own roles
Start a 14-day free trial with 10 assessment attempts, or book a 30-minute demo with our team.
Everything you need to know about AI Fluency Assessments
Need Help Choosing the Right Assessment Solution?
Build smarter with AI-powered hiring, anti-cheat proctoring, and enterprise workflows tailored to your business.
What is an AI fluency assessment?
An AI fluency assessment measures how well a person works with AI tools: breaking down a problem, writing clear prompts, reviewing AI output critically, testing it and correcting mistakes. It complements traditional coding tests.
Doesn't allowing AI make the test too easy?
No. Tasks are designed so that accepting AI suggestions blindly leads to wrong answers. Scores reflect judgement and verification, not just the final output.
Which AI assistant do candidates use?
A built-in assistant and coding agent inside SetBenchmark, so every candidate has the same tools and everything is recorded. Personal AI tools stay blocked unless you allow them.
Who scores AI fluency tasks?
Your reviewers, using a published rubric. SetBenchmark summarises the session and suggests where to look, but people make the final assessment.