Beth Cozzolino Santiago

Profile

Research scientist focused on improving technology products through experimentation and data analysis

Statistics, A/B test design and analysis, coding, data visualization, querying, technical communication, machine learning, survey design

Lead experimentation for the backend of Indeed’s shift to a new pricing model. Queries and reports shared with highest levels of leadership. Worked with product leadership to make critical business decisions
Built optimization that reduced Indeed’s delivery cost by more than 15%

Improved pricing models through randomization and experimentation, resulting in two consecutive +11% revenue wins
Managed team of 10+ data scientists and software engineers building user-facing machine learning models. Ensured on-time delivery of new models and components. Ran sprint planning, standups, and retrospectives to improve team processes

Deeply involved with ongoing pricing model experiments; conducting power analysis, identifying gaps in our data analysis pipeline, test planning, providing in-depth analyses and documentation with leadership that help drive roll-out decisions
Support team of back-end data scientists and engineers pushing models to production by simulating the impact of new models on user-facing recommendations

Used quantitative methods to evaluate user behavior at scale and identify product improvement opportunities. Including: analyzing user flows through the job post funnel, teaching workshops and providing 1:1 instruction on survey design and analysis

Conducted user experience research as part of an agile team of researchers, designers, and project managers working to improve the usability of technology products

Creative and inventive project management skills demonstrated by a research design that combined advanced statistical analyses in Stata (fixed effects models, logistic regression, event history analysis) with original qualitative data collection (ethnographic observation of 250 cases, 30 in-depth interviews) resulting in two peer-reviewed publications
Skilled communicator with experience presenting findings at twelve professional conferences, including three invited talks
Innovative mixed methods research design was awarded more than $50,000 in grant funding, including $35,000 from national competitions

Excellent teamwork and collaboration skills demonstrated by working on a team of researchers to code, clean, manage, and merge nationally representative datasets federally funded research projects, resulting in three peer-reviewed publications
Technical expertise demonstrated through selecting appropriate statistical techniques and methods to analyze data, including regression modeling (two-stage propensity score weighted logistic regression, cross-lagged structural equation modeling, etc.)
Strong leadership skills and experience supervising, teaching, and managing junior co-authors

Conducted evaluation of policy initiatives using quantitative (logistic regression analysis in SAS) and qualitative methods (interviews with program participants) resulting in government reports that influenced state-level policies and programs
Comfort with industry-scale data from coding and analyzing administrative records

2018. PhD, Sociology & Demography, The University of Texas at Austin
2012. BA, Sociology & Political Science, Temple University. Summa cum laude, Phi Beta Kappa

You can download a copy of my resume here.

If you’re interested in more about my academic work, click here.