Beth Cozzolino Santiago

Profile

Research scientist focused on improving technology products through experimentation and data analysis

Technical Skills & Knowledge

Skills
  • Statistics, A/B test design and analysis, coding, data visualization, querying, technical communication, machine learning, survey design
Programming Languages
  • Python (numpy, pandas, networkx), SQL, Stata, R

Experience

Indeed.com — Senior Product Scientist | December 2021 – Present
  • Lead experimentation for the backend of Indeed’s shift to a new pricing model. Queries and reports shared with highest levels of leadership. Worked with product leadership to make critical business decisions
  • Built optimization that reduced Indeed’s delivery cost by more than 15%
Indeed.com — Product Manager (Acting) | Q3 2021
  • Improved pricing models through randomization and experimentation, resulting in two consecutive +11% revenue wins
  • Managed team of 10+ data scientists and software engineers building user-facing machine learning models. Ensured on-time delivery of new models and components. Ran sprint planning, standups, and retrospectives to improve team processes
Indeed.com — Product Scientist | December 2020 – April 2021
  • Deeply involved with ongoing pricing model experiments; conducting power analysis, identifying gaps in our data analysis pipeline, test planning, providing in-depth analyses and documentation with leadership that help drive roll-out decisions
  • Support team of back-end data scientists and engineers pushing models to production by simulating the impact of new models on user-facing recommendations
Indeed.com — Quantitative UX Researcher | June 2018 – December 2020
  • Used quantitative methods to evaluate user behavior at scale and identify product improvement opportunities. Including: analyzing user flows through the job post funnel, teaching workshops and providing 1:1 instruction on survey design and analysis
Cubic | Intific — Graduate UX Research Intern | April – June 2018
  • Conducted user experience research as part of an agile team of researchers, designers, and project managers working to improve the usability of technology products
Population Research Center, The University of Texas at Austin — Researcher | 2015-2018
  • Creative and inventive project management skills demonstrated by a research design that combined advanced statistical analyses in Stata (fixed effects models, logistic regression, event history analysis) with original qualitative data collection (ethnographic observation of 250 cases, 30 in-depth interviews) resulting in two peer-reviewed publications
  • Skilled communicator with experience presenting findings at twelve professional conferences, including three invited talks
  • Innovative mixed methods research design was awarded more than $50,000 in grant funding, including $35,000 from national competitions
Population Research Center, The University of Texas at Austin — Research Assistant |  2014-15
  • Excellent teamwork and collaboration skills demonstrated by working on a team of researchers to code, clean, manage, and merge nationally representative datasets federally funded research projects, resulting in three peer-reviewed publications
  • Technical expertise demonstrated through selecting appropriate statistical techniques and methods to analyze data, including regression modeling (two-stage propensity score weighted logistic regression, cross-lagged structural equation modeling, etc.)
  • Strong leadership skills and experience supervising, teaching, and managing junior co-authors
Office of Family Initiatives, Texas Attorney General — Research Specialist | 2013-14
  • Conducted evaluation of policy initiatives using quantitative (logistic regression analysis in SAS) and qualitative methods (interviews with program participants) resulting in government reports that influenced state-level policies and programs
  • Comfort with industry-scale data from coding and analyzing administrative records

Education

  • 2018. PhD, Sociology & Demography, The University of Texas at Austin
  • 2012. BA, Sociology & Political Science, Temple University. Summa cum laude, Phi Beta Kappa

 

You can download a copy of my resume here.

If you’re interested in more about my academic work, click here.