Data Scientist - Inference, Experimentation

Job Description

Airbnb has become a global platform that connects travelers and hosts from over 81,000 cities. Our mission is to enable a world where anyone can belong anywhere. Expanding our community to new types of hosts is critical to our mission.

Airbnb’s mission is to make people around the world feel like they can belong anywhere. We want our guests to be able to find any type of place that they need, wherever they are — from private rooms for the social traveler to entire homes for the large family, from event spaces for an offsite to the perfect venue for that rustic wedding.

About Experimentation

Controlled Experiments are the fundamental building block for product decision-making at Airbnb. Our A/B testing platform, the Experiment Reporting Framework , automates experiment setup, assignment, delivery, and analysis, making experimentation easy and fast. Our platform is used by over 60% of all engineers, data scientists, and product managers every week, across every major product area at the company, with more than 1,000 experiments in flight at any given time.

We are looking for a Data Scientist who can work with our Experimentation team to uplevel the experiment tools and methodologies used across the company, and also tackle key experimentation questions from individual product teams.

Recent blog posts about experimentation at Airbnb:

• Selection Bias in Online Experimentation
• Scaling Airbnb’s Experimentation Platform
• 4 Principles for Making Experimentation Count

Responsibilities:

• Work closely with engineering and product team members on the Experimentation team to design and implement new features and methodologies. For example incorporating multiple testing and sequential testing, and implementing variance reduction techniques.
• Research challenging experimentation questions to inform our approach to experimentation. Example projects include how to design experiments in a marketplace system with cannibalization (e.g. market level tests, clustering), how to extrapolate from short-term proxy metrics to long-term impact, and how to measure impact of large-scale changes (e.g. the impact of changing our webpage design system).
• Mentor and partner with embedded data scientists on individual teams to share best practices and address their key experimentation problems.

Qualifications:

• Strong interest and expertise in experimentation
• 5+ years of industry experience
• Advanced degree in computer science, statistics, applied mathematics, or related field
• Expert in R or Python
• Understanding of engineering systems and tools needed to apply statistical methods at scale

Benefits

• Stock
• $2000 yearly employee travel coupon
• Competitive salary
• Paid time off
• Medical, dental, & vision insurance
• Life & disability coverage
• 401K match
• Flexible Spending Accounts
• Apple equipment
• Daily breakfast, lunch, and dinner