Principal Data Engineer - QuantumBlack

Job Description

Who You'll Work With

You will be based in Cambridge, Boston and will join QuantumBlack, a highly collaborative team of exceptionally talented Data Scientists, Data Architects, and Machine Learning Engineers.

QuantumBlack helps companies use data to drive decisions. We combine business experience, expertise in large-scale data analysis and visualization, and advanced software engineering know- how to deliver results. From aerospace to finance to Formula One, we help companies prototype, develop, and deploy bespoke data science and data visualisation solutions to make better decisions.

What You'll Do

As a Principal Data Engineer at QuantumBlack in Boston...

You'll work closely with senior client stakeholders to understand their data, design the ingestion process to store the data locally and prepare it for Data Analytics.

As someone passionate about data and the opportunity it provides to organisations, you'll have the opportunity to play a critical role in database design and development, data integration and ingestion, as well as designing ETL architectures using a variety of ETL tools and techniques.

You are someone with a drive to implement the best possible solutions for clients in close collaboration with a highly skilled Data Science team. As such, you will partner with clients to model their data landscape, obtain data extracts and define secure data exchange approaches. You'll also plan and execute secure, good practice data integration strategies and approaches. This is a fantastic opportunity to be involved in end-to-end data management for cutting edge Advanced Analytics and Data Science.

You’ll lead workstreams in acquiring, ingesting, and processing data from multiple sources and systems into Big Data platforms. You’ll help create and manage data environments in the Cloud. You will collaborate with our data scientists to map data fields to hypotheses and curate, wrangle, and prepare data for use in their advanced analytical models. You will have a strong understanding of Information Security principles to ensure compliant handling and management of client data.

Please submit your CV in English

Visit our Careers site to watch our video and read about our interview processes and benefits

Qualifications

• Proven experience working in a hands on technical role role delivering impact through analytics
• Strong experience with at least two of the following technologies: Python, Scala, SQL, Java
• Commercial client-facing project experience is beneficial, including working in multi-disciplinary teams of engineers, data scientists
• Good experience in multiple database technologies such as: distributed processing (Spark, Hadoop, EMR), traditional RDBMS (MS SQL Server, Oracle, MySQL, PostgreSQL) MPP (AWS Redshift, Teradata) NoSQL (MongoDB, DynamoDB, Cassandra, Neo4J, Titan)
• Experience in software engineering best practices such as code reviews, testing frameworks, maintainability and readability
• Experience deploying applications into production environments e.g. code packaging, integration testing, monitoring, release management
• The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets
• Proven ability in clearly communicating complex solutions
• Strong understanding of Information Security principles to ensure compliant handling and management of client data
• Experience and interest in cloud platforms such as: AWS, Azure, Goole Platform or Databricks
• Flexibility to travel regional or internationally up to 80% depending on client and base location
• Strong experience in traditional data warehousing / ETL tools (Informatica, Talend, Pentaho, DataStage)