Data Engineer – Remote + O/IR35

·
Full time
Location: London
·
Job offered by: Xcede
·
Category: IT & Technology
UK Remote + O/IR35

Join our dynamic team as a Data Engineer, where you will have the opportunity to engage in a broad range of impactful responsibilities:

Developing the Core Data Platform : Build and enhance our data platform using AWS and Databricks, including writing Terraform and deploying robust infrastructure.

Collaborating Across Teams : Work closely with Product, Marketing, and other departments to enable data-driven decision-making and deliver insights and tools that drive innovation.

Designing and Implementing Pipelines : Create real-time data pipelines, batch ETL processes, and uphold high standards for data integrity, quality, and governance.

Managing the Data Warehouse : Maintain and optimize our data warehouse, focusing on best practices for performance, scalability, and disaster recovery.

Desired Technical Skills :

Proficiency in

Python

and

Spark .

Hands-on experience with

AWS Cloud

(preferred).

Familiarity with

Infrastructure as Code (IaC)

tools such as Terraform.

Strong knowledge of

SQL

and

NoSQL

databases.

Proven experience in building data warehouses and pipelines.

Expertise in data platform solutions such as

Databricks

and/or

Snowflake .

Experience with

containerization tools

like Docker (ECS/Kubernetes - EKS) and orchestration tools (e.g., AWS Step Functions, Airflow, Dagster).

Nice to have:

Exposure to

Change Data Capture (CDC) pipelines, preferably

AWS DMS.

Understanding of

event streaming architectures .

This role offers an exciting opportunity to shape the future of our data landscape while working with cutting-edge technologies.

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details