Summary

Responsible AI Researcher focusing on fairness, but with skills across machine learning, micro-economics, and finance.

Employment

MetaResearch Scientist
2018–present
  • Enabled release of llama3 through red teaming to measure and fine-tune against adversarial risks [github.com/meta-llama/llama3]
  • Pioneered applying high dimensional Bayesian optimization towards finding system level adversarial prompts for SOTA models
  • Designed and developed key metrics for hyper-spherical point diversity, which were used to understand relative coverage of prompts and unsafe responses for model evaluation
  • Developed and analyzed diffusion models for systemic bias, including bridging between policy and product to ensure successful model launch
  • Developed SOTA calibration-based recommendation based fairness metrics, and applied them to internal systems.
  • Researched, created, and deployed state-of-the-art large-scale sparse user-author-content models across Instagram, Integrity, Content-Understanding, and more.
  • Developed transformer-based two-tower user-content models for cold-start unconnected content discovery that achieved half of our topline goals.
  • Regularly conducted offline and online model analysis using SQL, python, and other necessary tools.
  • Led project to learn hierarchical structure on top of existing user-content modeling.
  • Mentored two PhD interns to successful project completion and return offers.
University of MichiganGraduate Student Research Assistant
2012–2018
  • Studied auction settings where having access to public information is bad for all agents (AAMAS 2014)
  • Demonstrated surprising efficiency of continuous double auctions in the presence of strategic agents (Submitted TEAC)
  • Investigated how to design a modern frequent call market using empirical mechanism design (EC)
  • Analyzing "Flash Crash", metrics that indicate susceptibility, and policies that mitigate risk in the presence of strategic traders
Summer 2017
  • Trained content embedding model of job openings using caffe2
  • Doubled click-through rate for suggested jobs surface
YelpIntern
Summer 2015
  • Modified auto-bidder to increase advertiser return on investiment
  • Ran live experiments to determine modification effects and optimal parameters
Summer 2014
  • Developed search ranking optimization based on click-through data
  • Built profile photo categorizer for demographics and search ranking
University of MichiganGraduate Student Instructor
Fall 2013
  • TA'd introductory Algorithms and Data Structures course
2010–2012
  • Implemented an efficient topic modeling algorithm (PLSA) in MapReduce
  • Prototyped real time entity resolving and disambiguation system for news corpora
  • Designed a database that supports general queries on geographic descriptions
  • Adapted aggregate movement model between data modalities
  • Studied the Cramér-Rao Lower Bound (CRLB), and it's implications on polar coordinate tracking with both continuous and discrete noise
  • Built a Matlab simulation to investigate the relation between Extended Kalman Filter tracking error and CRLB for important target trajectories

Education

PhD in Computer Science and Engineering
Magna cum Laude · 3.81

Thesis: Understanding Financial Market Behavior through Empirical Game-Theoretic Analysis

Honors: STIET Summer Research Grant Recipient · Eta Kappa Nu · Microsoft College Puzzle Challenge Finalist (2015)

Selected Courses: Machine Learning · Online Learning · Reinforcement Learning · Social Networks

BS in Systems Science
Magna cum Laude · 3.88

Honors: Gregory Sullivan Award for Professional Achievement · Tau Beta Pi · Theta Xi · Dean's List

Selected Courses: Algorithms for Nonlinear Optimization · Nonlinear Dynamic Systems

Publications

M. Pavlova, E. Brinkman, K. Iyer, V. Albiero, J. Bitton, H. Nguyen, J. Li, C. Ferrer, I. Evtimov, A. Grattafiori
J. Rando, H. Korevaar, E. Brinkman, I. Evtimov, F. Tramèr
H. Korevaar, C. McConnell, E. Tong, E. Brinkman, A. Shine, M. Abbas, B. Metevier, S. Corbett-Davies, K. El-Arini
B. Wiedenbeck, E. Brinkman
AAMAS 2023
E. Brinkman, M. P. Wellman, S. E. Page
AAMAS 2014

Skills

Proficient
python · pytorch · sql
Competent
jax · scikit-learn · rust · java · c++11 · typescript
Novice
lua · hack · haskell · cuda