Senior Data Engineer

Job Description

Company Description

Wood Mackenzie is the global leader in data, analysis and consulting across the energy, chemicals, metals, mining, power and renewables sectors.

Founded in 1973, our success has always been underpinned by the simple principle of providing trusted research and advice that makes a difference to our customers. Today we have over 2,000 customers ranging from the largest global energy companies and financial institutions to governments as well as smaller market specialists.

Our teams are located around the world. This enables us to stay closely connected with customers and the markets and sectors we cover. Collectively this allows us to offer a compelling combination of global commodity analysis with detailed local market knowledge.

We are committed to supporting our people to grow and thrive. We value different perspectives and aspire to create an inclusive environment that encourages diversity and fosters a sense of belonging. We are committed to creating a workplace that works for you and encourage everyone to get involved in our Wellness, Diversity and Inclusion, and Community Engagement initiatives. We actively support flexible working and are happy to consider alternative work patterns, taking into account your needs and the needs of the team or division that you are looking to join.

Hear what our team has to say about working with us:

https://www.woodmac.com/careers/our-people/

We are proud to be a part of the Verisk family of companies!

At the heart of what we do is help clients manage risk. Verisk (Nasdaq: VRSK) provides data and insights to our customers in insurance, energy and the financial services markets so they can make faster and more informed decisions.

Our global team uses AI, machine learning, automation, and other emerging technologies to collect and analyze billions of records. We provide advanced decision-support to prevent credit, lending, and cyber risks. In addition, we monitor and advise companies on complex global matters such as climate change, catastrophes, and geopolitical issues.

But why we do our work is what sets us apart. It stems from a commitment to making the world better, safer and stronger.

It’s the reason Verisk is part of the UN Global Compact sustainability initiative. It’s why we made a commitment to balancing 100 percent of our carbon emissions. It’s the aim of our “returnship” program for experienced professionals rejoining the workforce after time away. And, it’s what drives our annual Innovation Day, where we identify our next first-to-market innovations to solve our customers’ problems.

At its core, Verisk uses data to minimize risk and maximize value. But far bigger, is why we do what we do.

At Verisk you can build an exciting career with meaningful work; create positive and lasting impact on business; and find the support, coaching, and training you need to advance your career. We’ve been recognized by Forbes as a World’s Best Employer and a Best Employer for Women, testaments to our culture of engagement and the value we place on an inclusive and diverse workforce.

Job Description

Wood Mackenzie is looking for a future focused Senior Data Engineer with excellent problem solving, teamwork, and communication skills to join our industry-leading data analytics company. We are headquartered in Edinburgh where our team is working on a next generation, data analysis & visualization platform utilized by our customer to drive billion-dollar decisions.

Role Purpose

This role will be responsible for the implementation of our Data Pipeline that delivers unique natural resource data and analytics and driving innovation across the entire spectrum of energy sectors (Oil, Gas, Metals, Mining, Chemical, Renewables). You will have the opportunity to influence technical direction, architecture of the data services that are critical to this platform.

The successful applicant will have informed opinions on technologies, frameworks and approaches to delivery, and be able to articulate ideas effectively and strive to constantly improve deliverables.

About the Day to Day Responsibilities of the Role

Responsibilities

· Assist with the building and deployment of a data orchestration solution to provide advanced scheduling functionality.

· Integrate the data orchestration solution with existing data platforms at Wood Mackenzie.

· Develop processes and code to automate and migrate the existing ETL jobs from the current scheduling tool to the new solution.

· Analyse and interpret requirements from project stakeholders, providing feedback as necessary

· Research, document and propose optimal technology choices to fit the business requirements

· Assist in developing an architecture that addresses functional and non-functional requirements

· Work with other data platform teams to build out a solution applicable to the entire platform

· Design, implement and validate all components of the solution, ensuring adherence to existing technical and operational standards

· Define short-term and longer term strategies for building out the system, including deployment and assessment of production readiness

· Assist in building strategy for go-live of new system, including adapting existing systems and migration of existing data

Quality

· Review and manage the technical quality of deliverables ensuring it meets best practices

· Actively promote and set coding best practices including code reuse and readability

· Manage escalations from project teams and work towards resolutions in a collaborative manner balancing customer value and technical debt

· Promote a culture of code quality and continuous improvement

Leadership

· Act as, and be seen as a technical authority within engineering teams

· Actively participate in the recruitment process

· Identify emerging technologies or applications and the opportunities to integrate them into our operations and activities

· Encourage a collective code ownership and learning culture

Qualifications

About You and How You Can Excel in This Role

The person that fills this role must be a self-starter who is energized by a challenge, passionate about bringing great products to market and love the thrill of creating a new standard for what’s possible.

Skillset

· Proven experience of implementing Apache Airflow or similar technology.

· Expert knowledge and experience with container orchestration technologies such as: AWS ECS, EKS, Fargate, or similar.

· Strong understanding of cloud-first architectures (AWS/Azure/GCP)

· Highly proficient in more than one modern language, e.g. Python/Java/C#/NodeJS

· Experience of automated continuous deployment pipelines within a cloud environment

· Proven experience of agile working practices including continuous delivery

#LI-DK2

Additional Information

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability.

http://www.verisk.com/careers.html

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

Consumer Privacy Notice