DataOps Engineer

Job Description

About FanDuel

FanDuel Group is a world-class team of brands and products all built with one goal in mind — to give fans new and innovative ways to interact with their favourite games, sports, teams, and leagues. That’s no easy task, which is why we’re so dedicated to building a winning team. And make no mistake, we are here to win, but we believe in winning right. That means we’ll never compromise when it comes to looking out for our teammates. From our many opportunities for professional development to our generous insurance and paid leave policies, we’re committed to making sure our employees get as much out of FanDuel as we ask them to give.

FanDuel Group is based in New York, with offices in Georgia, California, New Jersey, Florida, Oregon, and Scotland. Our brands include:

• FanDuel — A game-changing real-money fantasy sports app
• FanDuel Sportsbook — America’s #1 sports betting app
• TVG — The best-in-class horse racing TV/media network and betting platform
• FanDuel Racing — A horse racing app built for the average sports fan
• FanDuel Casino & Stardust Casino — Fan-favorite online casino apps
• FOXBet — A world-class betting platform and an affiliate of FanDuel Group
• PokerStars US — The premier online poker product and an affiliate of FanDuel Group

THE POSITION

Our roster has an opening with your name on it

Data drives our organization. As a DataOps Engineer at FanDuel, you will help us unlock the full potential of vast amounts of real-time and relational data, provide our business with insight, and delight our customers with a world-class personalized experience. You will help us turn every click our users make, every bet, every goal, every corner, and every tackle into a real-time stream of knowledge allowing us to make better and faster decisions – outplaying our competition.

In this role, you will primarily partner with the engineering teams building our data platform, and other data engineering teams who create ELT pipelines to move data in an accurate, reliable and timely manner for the rest of the organisation to make use of. You will help us build automated tools that will organize, model, and present our data as a coherent product and offer it to our stakeholders, providing a common information framework that allows FanDuel to intelligently react to what is happening on the field and in the marketplace.

We are looking for Data Platform or DataOps Engineers of all skill levels or experienced engineers from other disciplines who may be looking to make the move to a big data environment. If this describes you, read on – we want to hear from you!

Skills you have now or will quickly develop a deep understanding for

• Passion for building and maintain highly scalable and available systems used by Data Engineers, capable of efficiently running hundreds of data pipelines at the same
• Configuring to best performance orchestration tools such as Astronomer Airflow
• Processing large workloads using distributed data systems such as Redshift, Snowflake, Athena, Spectrum, Spark and Hadoop
• Processing real-time streaming workloads with distributed event systems such as Kafka and Kinesis
• Designing and maintaining production systems leveraging your knowledge and experience based on different business use cases, trade-offs, performance, and limitations
• Implementing data lake, warehouse, and lakehouse architectures leveraging your knowledge of data archiving and retrieval solutions and their relationship to access vs. cost

Things you will get exposure to

• Experimenting with new technologies, solving problems in the most efficient way
• Building, running and maintaining enterprise production platforms
• Data security and privacy (e.g. GDPR, CPP)
• Data governance and data testing frameworks (e.g., Alation, Great Expectations)
• Data monitoring and observability tools
• Continuous integration and delivery of production data products (GIT,Jenkins, Buildkite, Puppet)
• An inclusive culture that expects excellence and priorities your growth as an engineer and your well-being as a person

The next team member we’re looking for should understand both software and data engineering concepts, with experience in some of the following

• Configuring and maintaining a data warehouse to the best use of both compute and storage resources
• Experience in setting up roles and permissions using cloud technologies, such as AWS, Azure or GCP
• Understanding of data ingestion via batch or streaming processes tools and technologies (SNS & SQS, Kafka or Kinesis, Spark and/or Flink)
• Experience with container systems (Docker), container orchestration (e.g. EKS, Kubernetes, Swarm) and creating helm charts, understanding/defining namespaces.
• Confident provisioning infrastructure via their preferred IaC technology (Terraform), and setting up monitoring (DataDog, Cloudwatch) and alerting for said infrastructure

A mindset of automate everything, with experience demonstrating this.

Our Technology:

• 2-3 years Linux experience with Python, Perl or Shell scripting
• 1-2 years of AWS (IAM, S3, Kinesis, KMS, DynamoDB, Cloud Formation, VPC, Lambda, Security Groups, SNS, RDS, Redshift, EMR)
• 2-3 years of GitHub, CI/CD - Buildkite, Jenkins
• 1-2 years of Configuration Management tools - Puppet or similar (Ansible, Chef)
• 1-2 years of Infrastructure as Code (Terraform, CloudFormation) experience.
• Nice to have Apache Airflow, Databricks, Apache Spark knowledge
• 1-2 years of Messaging – SQS, Kafka, RabbitMQ or similar technologies
• 1-2 years of Docker, Container Orchestration (Kubernetes, EKS, ECS), Helm package manager.
• 1-2 years of DataDog, Cloudwatch monitoring solutions experience.

As you grow at FanDuel, you will

• Advance your career within well-defined, skill-based tracks, either as an individual contributor or as a manager – both providing equal opportunities for compensation and advancement
• Apply your experience and intellect as part of an autonomous team with end-to-end ownership of key components of our data architecture
• Serve as a mentor to more junior engineers not only in cultivating craftsmanship but also in achieving operational excellence – system reliability, automation, data quality, and cost-efficiency

Data platform engineering is a rapidly changing field – most of all, we’re looking for someone who enjoys experimenting, keeping their finger on the pulse of current data engineering tools, and always thinking about how to do something better.

FanDuel Group is an equal opportunities employer. Diversity and inclusion in FanDuel means that we respect and value everyone as individuals. We don't tolerate bias, judgement or harassment. Our focus is on developing employees so that they reach their full potential.

#LI-Hybrid