LLM Monitoring & Evaluation

AI & AnalyticsCharlotte J. Lloyd

PhD

Download C.V.

About

Charlotte Lloyd is a data engineer and social science researcher.

My research in the social and environmental sciences spans a wide range of topics from mapping access to childcare services to predicting vessel traffic delays on inland waterways to evaluating career pathway programs. I use qualitative, quantitative, and spatial methods including web-scraping and machine learning to collect data and generate insights. Certifications in Human-Centered Design and User Experience reflect my commitment to building research products and digital tools that are responsive to user needs.
LLM Monitoring & Evaluationworkflow analytics from design to deployment with trace data
ResearchOpscollect, govern, analyze, circulate, and preserve data for evidence-based decision-making

Skills

Research

Study Design, Qualitative Methods, Quantitative Methods, Ethics, Data Governance

Design & UX

Design Thinking, Human-centered Design, Participatory Design, UX Research

Analytics

GenAI & LLMs, Data Engineering & Analytics, Machine Learning, Natural Language Processing

Education

PhD in SociologyHarvard University

2015-2019

After spending over 15 months conducting fieldwork in Australia, I finished my dissertation as a Graduate Fellow at the Radcliffe Institute for Advanced Study.

Certificate in Computational Science & Eng. | Harvard University

2014-2017

One of the few social scientists to pursue the secondary field option in Computational Science & Engineering, I received my certificate in 2017 after completing 4 courses and a final project at the School of Engineering & Applied Sciences. 

A.M. in Sociology | Harvard University

2012-2015

After completing the Harvard Sociology program requirements—including 16 required substantive and methods courses, a general written examination, qualifying paper and a teaching fellowship—I received my Master's degree in 2015.

B.A. in Comp. Literature & Political Science | UNC Chapel Hill

2006-2011

I attended the University of North Carolina at Chapel Hill as a Morehead-Cain Scholar and graduated summa cum laude with a B.A. in Comparative Literature and Political Science.