Job search

As an AI Evaluation Scientist, you will play a critical role in evaluating and improving our AI-enhanced capabilities. Your expertise in statistical analysis and AI evaluation will ensure that our next-generation assessment solutions meet the highest validity, fairness, and regulatory standards. This role is central to maintaining Cambridge's reputation as a global leader in AI-enhanced education and assessment., As part of our Applied AI team, you will be responsible for helping drive the evaluation of our AI-enhanced assessment technologies to ensure their accuracy, fairness, and explainability. You will work closely with validation specialists and machine learning engineers to implement robust statistical analyses and help develop innovative evaluation methods to help shape the future of AI-powered second language learning., * Conducting statistical evaluations to robustly assess the fairness, accuracy, and transparency of our AI-enhanced assessment technologies, ensuring they align with Cambridge's educational assessment principles.
* Contributing to the development and design of validation frameworks and wider quality assurance processes to ensure AI models meet regulatory requirements and industry best practices.
* Identifying and applying cutting-edge AI evaluation methods, helping advance both our AI capabilities and the science of AI evaluation.
* Working with validation specialists and machine learning engineers to help develop next generation AI-driven educational technologies.
* Publishing findings in academic and industry contexts, presenting insights to both technical and non-technical stakeholders, and representing Cambridge as an expert in AI evaluation.
We will support you to be at your best in work and to live well outside of it. In addition to competitive salaries, we offer a world-class, flexible rewards package, featuring family-friendly and planet-friendly benefits including: * 28 days annual leave plus bank holidays * Private medical and Permanent Health Insurance * Discretionary annual bonus * Group personal pension scheme * Life assurance up to 4 x annual salary * Green travel schemes
We are looking for an analytical thinker with practical and theoretical knowledge of inferential statistics and AI evaluation methods who enjoys working as part of a diverse team of specialists. You will excel in this role if you have: * A degree in a quantitative field (e.g., Statistics, Data Science, AI, Mathematics) or equivalent work experience, ideally with a focus on AI model evaluation. * Strong theoretical and practical knowledge of inferential statistics and multivariate analysis. * Practical experience of evaluating AI models using a range of methods, including methods relating to the domain of explainable AI. * Proficiency in either Python or R for conducting complex statistical analyses (Python preferred). * An ability and willingness to learn and apply new statistical approaches for addressing particular evaluation challenges. * An ability to manage projects in a structured, deadline-driven environment, ensuring timely delivery of evaluation results. * An ability to translate technical findings into actionable insights for cross-functional teams, influencing decision-making at senior levels. * A strong commitment to ethical AI principles and educational fairness, aligned with Cambridge's mission to expand learning opportunities for all. Desirable: * Experience of evaluating AI-enhanced assessment and learning technologies. * Experience of collaborating with ML engineers in the development and evaluation of AI models. * Experience of assessment principles and evaluation methods. * Experience of embedding standardized AI evaluation processes in an industry setting.