Software Engineer - Tools and Infrastructure

Job Description

At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions.

Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform.

We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

Our philosophy at Databricks is that we grow and win not by building the best software artifact at a given point in time, but by enabling our engineering teams to iterate rapidly from ideation to production. Consequently, we invest heavily in areas that improve engineering productivity and operational efficiency in order to ensure that we continuously deliver the highest quality products to our customers.

As a Software Engineer, you will design, implement, and manage the entire infrastructure stack used for building, testing, and releasing our software artifacts, with the goal to improve engineering velocity and minimize the time it takes to get new products and features out to production.

As a Software Engineer, you will:

• Optimize software development workflows for engineering and operational efficiency.
• Use our own data and AI platform (yes!) to analyze build and test logs and metrics to identify key areas for improvement.
• Design and implement automated build, test, and release infrastructures.
• Set and uphold the standard for engineering processes to support high quality engineering, including style and code checking, test harnesses, and release packaging.

Competencies

• BS/MS/PhD in Computer Science, or a related field
• Passion for automation and improving engineering productivity.
• Proficient in Java/Scala, C/C++, or Python.
• Experience with modern build systems, e.g. Bazel, Maven, Gradle.
• Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes.
• Experience with CI/CD frameworks.
• Optional: Data engineering and data science experience with Apache Spark.

Benefits

• Awesome coworkers
• Top of market compensation
• 25 days of vacation
• Catered lunch (everyday), snacks, and drinks
• Gym reimbursement
• Employee referral bonus program
• Maternity and paternity plans