Big Data Engineer

Job Description

WHO WE ARE Basis Technologies delivers software and services to automate digital media operations for more than 1,000 leading agencies and brands. Our comprehensive ad tech platform, Basis, supports the planning, reporting, and financial reconciliation of direct, programmatic, search, and social media, all in one place. We are deeply committed to building software that will change the ad tech industry for the better and are equally dedicated to building an inclusive culture of highly motivated individuals who create a positive and supportive environment together. We invest in our culture and support our employees so they can do their best work. Basis Technologies is headquartered in Chicago, and our employees have the flexibility to work in an office location, completely remote, or a hybrid of the two. Please note, we are hiring on a remote working basis only in the U.S. and Canada. ABOUT THE TEAM Technology is at the core of what we do. Basis’s innovative Engineering team designs and develops new features and integrations for Basis, our industry-leading, comprehensive software solution. Our platform processes over 300 billion events per day and uses AI and machine learning to automate and simplify the entire digital campaign process. WAYS YOU'LL CONTRIBUTE This team is all about data. Data engineering team is responsible for ingesting data from various sources and transforming it into structures and layers catered for various reporting needs. We are starting the migration process from Hadoop stack on-prem to the in-cloud implementation on Snowflake. This is a large initiative and transitioning will happen gradually. As a result, we have a mix of technologies that you will need to work with as a data engineer, including but not limited to the Hadoop+Spark and Snowflake.

OTHER WAYS YOU'LL CONTRIBUTE TO THE TEAM ARE BY:

• Implementing scalable, fault tolerant and accurate ETL pipelines that work in a distributed data processing environment.
• Gathering and processing raw data at scale from diversified sources into Hadoop and Snowflake.
• Contributing to building enterprise business analytics and reporting applications on Hadoop and Snowflake

WHAT YOU BRING TO THE TABLE

• Proven experience working with Snowflake and/or proven experience working with various components of Hadoop ecosystem.
• We are looking for experience with Spark, HDFS, Hive, Impala, Oozie on Hadoop stack.
• We are looking for experience developing streams, tasks, procedures on Snowflake.
• Experience with Kafka and Kafka connectors
• Knowledge of Airflow
• Strong understanding of computer science fundamentals
• Proficiency with relational databases and SQL queries (MySQL, Oracle or similar)
• Understanding of how to handle high velocity, high volume data events.
• Understanding of factors affecting performance of ETL processes and SQL queries, ability to work on performance tuning.
• Experience implementing data pipelines moving large volumes of data a day.
• Experience coding in Python and/or Scala

BONUS POINTS

• Bachelor’s degree or an advanced degree in Computer Science or Engineering
• Experience with BI tools such as Power BI, Looker, etc
• Excited by a fast-paced product development environment.
• Having a passion and knowledge of AdTech industry.

OUR TECH STACK

• Kubernetes, Docker, Harness
• Jenkins, GitHub
• AWS

$95,000 - $166,000 a year Our salary ranges are determined by role, level, and location. Individual salary is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your location during the hiring process. The total compensation package for this position may also include commission or bonus, company equity, and competitive benefits. #BI-Remote #LI-Remote #LI-Hybrid #LI-NC1 ANYTHING ELSE? Don't think you have all the skills required for this role? That's okay, we recognize that experience can be built in many ways. If you have relevant skills that are not reflected in your resume, we welcome your candidacy and encourage you to share more in an optional cover letter, even if your experience doesn’t match our exact requirements. LIFE WITH BASIS TECHNOLOGIES We take care of our people and believe that our success depends on the growth and well-being of each one of our team members. We've been proudly recognized as: Ad Age, Best Places to Work 2023, 2022, 2013 Built In, Best Workplaces 2023, 2022, 2021 Crain's Best Companies to Work for in Chicago 2022, 2021, 2020, 2014, 2013, 2012, 2011 Crain's Best Companies to Work for in New York 2022, 2021, 2014 Dallas Morning News, Top Workplaces 2021, 2019, 2015 Denver Post, Top Workplaces 2022, 2021, 2020 Denver Business Journal's Largest Employers 2022, 2021, 2020 Fortune Magazine, Best Workplaces 2022, 2021, 2020, 2015, 2014 We provide a thoughtful perks and benefits package including competitive 401k/RRSP matching, mental health support, a funded health savings account, paid sabbatical, generous parental leave, a flexible work environment and time off policy, and more. We are proud to be an equal opportunity employer and are committed to building teams that are diverse in thought, perspective, and culture. We celebrate all team members regardless of gender identity, sexual orientation, race or cultural background, religion, disability, and age. Basis is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application processes. If you need assistance or an accommodation due to a disability, you may contact us at [email protected]. Information collected and processed as part of any job applications you choose to submit is subject to Basis' privacy policy that you can view here . Apply for this job