Data Engineer

Job Description

OfferUp is dedicated to building the simplest and most trustworthy way for people to buy and sell in their communities. Every year, millions of people use OfferUp to buy and sell locally, resulting in billions of dollars of local commerce. As the largest mobile marketplace for local buyers and sellers in the U.S., our iOS and Android app has been in the top five most popular shopping apps lists for more than three years. Join us as we build the marketplace of the future and reinvent local commerce by helping consumers uncover value through simplicity and trust.

At a Glance

• 85M+ Downloads
• Geekwire App of Year
• 15+ percent of adults in key markets like Los Angeles, Seattle, Miami and Las Vegas use OfferUp every month

About the role:

Here at OfferUp, data is at the core of our business, providing insights into the effectiveness of our products, and enabling technology that powers them. On the Data Warehouse and Business Intelligence team, we build and operate OfferUp’s data lake, data warehouse, data streaming processes, and business intelligence tools, for data analysis and BI, and to train ML models. If you’re passionate about storing, transforming and building intelligence around massive volumes of data, and you are motivated to make an impact with data used by every team, come join us. You will be part of a team that builds the data ingestion, transformation, storage, and orchestration processes, including the models used for Analytics, and Data Science for AI/ML. You will help shape the vision and architecture of OfferUp’s next-generation data processing, storage, and interface layers, making it possible to develop data-oriented application features.

Building the largest and most responsive mobile marketplace poses unique data challenges that require leveraging the latest developments in data infrastructure and just in time transformations. We leverage open-source infrastructure where we can, but are ready to build and share solutions if they don’t exist yet. You will be working with data in AWS Kinesis and S3 and data in Google’s Cloud - from Cloud Storage to BigQuery - a cutting-edge set of processes on an emerging technology backbone - DBT, and Airflow.

We regard culture and trust highly, and are looking forward to welcoming your contribution to the team!

Here’s more of what you will get to do:

• Build and operate large scale data processing systems in production
• Build and operate big data lakes, warehouses and stores
• Participate in discussions on long-term impacts of key design decisions and handling failure scenarios
• Building self-service platforms to power all other OfferUp teams
• Mentor other engineers and help them with their growth
• Drive data engineering best practices, set standards and propose larger projects which may require cross-team collaboration
• Contribute to the data warehouse, lake and store design including data preparation; implement robust and extensible data models and transformation processes
• Design and develop applications to process large amounts of critical information in batch, near real-time, and real-time to power user-facing features
• Influence technical direction for the company, leveraging your prior experiences and helping evaluate emerging technologies and approaches

You’ll thrive in this role if you have:

• 2+ years of professional software/data development experience
• Strong experience with large scale data processing across distributed systems
• Ability to communicate technical information effectively to technical and non-technical audiences
• Proficiency in SQL, Data Modeling, and Python
• Experience leveraging open-source data infrastructure projects, such as Apache Spark, Airflow, DBT, Kafka, Avro, Parquet, Firebase, REST API
• Experience building data pipelines and real-time data streams
• Experience building software in GCP is highly desirable, with a preference for experience with Cloud Storage, BIgQuery, DataFlow, DataFusion, Pub/Sub
• Computer Science or Engineering degree required, Masters degree preferred
• Must be eligible to work in the United States

Helpful, but not required:

• Experience with AWS services like EMR, Kinesis, Firehose, Lambda, Sagemaker is a plus.

OfferUp is changing the way people buy and sell locally and we’ve built a dynamic team to do it. To learn more about what it’s like to work at OfferUp, check out our blog: https://blog.offerup.com/tagged/culture

OfferUp provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, OfferUp complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, transfer, leaves of absence, compensation, and training.

OfferUp expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of OfferUp’s employees to perform their job duties may result in discipline up to and including discharge.