AI Workbench · Level 3 of 15
Choose the metric and the threshold
Level 3 of 15 in the AI Workbench: a free AI exercise at Intermediate level, which takes about 25 minutes. Pick the right headline metric for fraud flags and set a threshold that fits what the review team can handle.
Free · no download · about 25 minutes. Your work is saved on this device. Updated 18 Oct 2026.
The brief
- Client
- Tidewater Bank (fictional, hosted by OFORO)
- Site
- OFORO data desk
- Work order
- OFR-WO-103
- Data set
- Card transactions
- Task code
- AIW-03
- Difficulty
- Intermediate
- Type of work
- Modelling
Pick the right headline metric for fraud flags and set a threshold that fits what the review team can handle.
Skills you practise
- Precision and recall
- Threshold
- Imbalanced data
- Time split
What the test checks
The acceptance test marks the skills this level practises.
- Precision and recall
- Threshold
- Imbalanced data
- Time split
In this lab
- Train models in your browser
- Vision inspection, prompts, RAG and safe agents
- Check the AI's work before you trust it
Levels in the AI Workbench
Previous: Train and evaluate without leakageNext: Overfitting: tune the tree
- Data health check
- Train and evaluate without leakage
- Choose the metric and the threshold
- Overfitting: tune the tree
- Vision inspection on the conveyor
- Prompt to spec
- Answers with sources
- A safe agent
- Fairness check
- Privacy first
- Check the AI's work: finance
- Check the AI's work: HR
- Check the AI's work: marketing
- Check the AI's work: healthcare
- Check the AI's work: project management
Part of the AI Workbench
Prepare data, train a model and check the AI's work against a brief.
Feeds these internships: AI and Machine Learning, Data Science and Analytics, Generative AI and Prompt Engineering, AI Agents and Automation, Computer Vision, AI for Finance and Accounting, AI for HR and Recruitment, AI for Digital Marketing and Content, AI in Healthcare and Pharma, AI for Project Management.