DataOps Engineer

·
Full time
Location: London
·
Job offered by: CHEP
·
Category: IT & Technology
CHEP helps move more goods to more people, in more places than any other organization on earth via our 300 million pallets, crates and containers. We employ 11,000 people and operate in more than 55 countries. Through our pioneering and sustainable share-and-reuse business model, the world’s biggest brands trust us to help them transport their goods more efficiently, safely and with less environmental impact.

What does that mean for you? You’ll join an international organization big enough to take you anywhere, and small enough to get you there sooner. You’ll help change how goods get to market and contribute to global sustainability. You’ll be empowered to bring your authentic self to work and be surrounded by diverse and driven professionals. And you can maximize your work-life balance and flexibility through our Hybrid Work Model. Job Description Position Purpose Our ambition is to support the growth of Brambles Digital by laying the foundations for DataOps, to support the provision of high performing, cost-effective and reliable data pipelines in our Data & Analytics ecosystem. As a DataOps Engineer, you will undertake packages of work (Jira Align epics) which address our use of Infrastructure as Code tools and processes, particularly assisting in the management and availability of the Databricks platform and resources to internal analytics teams (Data Science, Data Engineering, Data Analytics). In the role, you will act as direct support for our Databricks Admin team as they develop and implement the user, cluster and unity catalog governance scheme and processes. The DataOps Engineer will implement the various environment management CI/CD and IaC processes on behalf of the Databricks Admin team. This includes, but is not limited to, supporting user adoption of Databricks, implementing and maintaining security and resource provisioning best practices, disaster recovery processes, CI/CD processes and code repos, under the direction of the Databricks Admin team. As a DataOps Engineer, you will be expected to apply best practices for IaC, Enforcing Policies as Code, and Injecting Secrets into Terraform. The role will collaborate closely with our Cloud Engineering team to ensure a joined-up approach to our environment management. Some of this work may be performed under the direction of the Cloud Engineering team. Key Accountabilities Provide 2nd and 3rd line support for users of the Databricks Platform. Collaborate with our Data Science, Cloud Engineering & Data Engineering teams to align the Databricks environment with application requirements via IaC. Work with Data Scientists & Machine Learning Engineers to ensure optimal performance of data models and pipelines following restoration of Databricks environment via IaC. Implement and maintain infrastructure as code (IaC) using Terraform for our Databricks environment and associated systems. Collaborate with data security teams to ensure our recovery strategies adhere to Brambles’ security standards. Support the implementation of a cluster policy governance framework for Databricks compute via Terraform in collaboration with the Databricks Admin team. Support & maintain implementation of a comprehensive application tagging process for workloads in Databricks via Terraform, under the direction of the Databricks Admin team. Qualifications Bachelor’s degree in computer science, Engineering, or a related field; or equivalent work experience in Data Engineering, MLOps, or platform administration. Experience At least three years’ experience in Data Engineering, IaC or MLOps. Experience of Databricks Administration and Terraform. Using Databricks as a Data Scientist or Data Engineer is useful experience but we’re really looking for Databricks Administration experience. Proven experience building applications and programming using Python. Experience of using IaC, disaster recovery techniques and processes, or Databricks. Familiarity with cloud-based services and engineering. Remote Type Hybrid Remote We are an Equal Opportunity Employer, and we are committed to developing a diverse workforce in which everyone is treated fairly, with respect, and has the opportunity to contribute to business success while realizing his or her potential. This means harnessing the unique skills and experience that each individual brings and we do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state, or local protected class. Individuals fraudulently misrepresenting themselves as Brambles or CHEP representatives have scheduled interviews and offered fraudulent employment opportunities with the intent to commit identity theft or solicit money. Brambles and CHEP never conduct interviews via online chat or request money as a term of employment. If you have a question as to the legitimacy of an interview or job offer, please contact us at recruitment@brambles.com.

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details