Human Judgement in an AI World
AI Evaluation • Content Quality • Customer & Student Experience • Digital Operations
I bring human judgement, careful communication and real-world experience to AI, content and digital experiences – helping businesses make sure what they create is accurate, useful and works for the people it’s designed to serve.
What I Do
AI EVALUATION & CONTENT QUALITY
I evaluate AI-generated and digital content for accuracy, relevance, usefulness, tone and context, combining careful analysis with a human-centred perspective.
AI output evaluation • Agent testing • Content review • Fact-checking • Quality assurance
CUSTOMER & STUDENT EXPERIENCE
I help businesses create thoughtful, supportive experiences for the people using their products, services and learning environments.
Customer success • Student support • Onboarding • Communication • Customer journeys
DIGITAL OPERATIONS & ONLINE LEARNING
I build and improve the systems behind online businesses, from courses and funnels to websites, email automations and digital customer journeys.
Course builds • Funnels • Websites • Automations • Digital systems
About Me
Hi, I’m Katy.
My career hasn’t followed a conventional path, and that’s become one of its biggest strengths.
I’ve worked across healthcare, hospitality, customer and student experience, online education, digital operations and charity leadership. I’ve conducted structured assessments in hospital settings, supported people in crisis, built online learning experiences, founded a charity and presented evidence to government and healthcare audiences.
More recently, my work has moved increasingly into AI and content quality. I’ve tested custom AI agents, evaluated responses for accuracy, relevance, usefulness and tone, and independently fact-checked AI-assisted content before publication.
Different environments, but the same thread has followed me through all of them:
Understanding people, assessing information carefully and making systems work better for the humans using them.
That’s the perspective I now bring to AI evaluation, content quality, customer experience and digital operations.
WHY HUMAN JUDGEMENT MATTERS
AI can generate an answer in seconds. The harder question is whether it’s the right answer for the person and situation.
My background has taught me to look beyond whether something simply “works”. I look at context, evidence, language, assumptions, risk and the experience of the person on the receiving end.
Is it accurate and supported by evidence?
Is it relevant to the person and situation?
What assumptions might be influencing the answer?
Is it clear, appropriate, useful and safe?
EXPERIENCE THAT SHAPES HOW I WORK
Structured Assessment & Decision-Making
Hospital-based assessments, evidence gathering, mental-capacity assessments, risk assessment and documented decision-making.
Crisis Support & Safeguarding
Crisis communication, risk protocols, escalation, safeguarding and maintaining professional boundaries in sensitive situations.
Customer & Student Experience
Years of customer success, coaching, student support, online education and creating thoughtful customer journeys.
Charity Leadership & Advocacy
Founding and leading Endo Buddies CIO, including research, safeguarding, partnerships, public speaking and healthcare advocacy.
Digital Operations & Online Learning
Building courses, websites, funnels, automations and the systems that sit behind effective online experiences.
AI Evaluation & Content Quality
Testing AI agents, evaluating responses for accuracy, relevance, usefulness and tone, alongside content review, QA and fact-checking.
INTERESTED IN WORKING TOGETHER?
I’m open to remote opportunities and project-based work across AI evaluation, content quality, customer and student experience, digital learning and digital operations.
If you think my experience could be useful to your team or project, I’d love to hear from you.