Senior Data Engineer

·
Full time
Location: Manchester
·
Job offered by: InterQuest Solutions
·
Category: IT & Technology
X4 Contract Senior Data Engineers 3 Month Duration Location: London, Manchester, Midlands Inside IR35 - £475 - £525 per day January start Our client is seeking multiple Senior Data Engineers to join their client for 3 months starting in January. You'll need strong experience in Databricks, Python, Pyspark, Deltalake, SQL and ADF skills and familiar with working within a Data Engineering framework and have been involved in the creation, configuration of the framework, metadata configuration and use of Unity Catalogue within Databricks including CI/CD. Ideally as a Senior Data Engineer you'll have delivered the following: Data pipelines following Data Engineering best practice and standards. This includes meta driven parameterised and automated Azure Data Factory and Databricks as appropriate. Data pipelines deployment was undertaken through ADO (Repos, GIT, Pull Requests, Pipeline Running), Python, Pyspark, SQL and Databricks Medallion and Deltalake. Outputs of data pipelines were assured and evaluation of comparison between as-is and to-be was presented to users for acceptance. Data pipelines were built with appropriate quality checks and reporting in place as agreed with primary users and Data Operations data leads. Operational handover documents such as runbooks were created and revised through engagement with end users. All artefacts were created, and documents saved on SharePoint. The data asset was successfully deployed after testing and signed off by the Service Owner and Engineering leads. Key skills: 5+ years of data engineering experience Built data products in Microsoft Azure using Azure Data Factory and Databricks Sound experience of data management & data quality management Azure SQL This role requires you to be security cleared. You will need to be in the UK, able to work at one of the above listed locations and not require any sponsorship. Please apply to be considered for the opportunity. InterQuest Group is acting as an employment agency for this vacancy. InterQuest Group is an equal opportunities employer and we welcome applications from all suitably qualified persons regardless of age, disability, gender, religion/belief, race, marriage, civil partnership, pregnancy, maternity, sex or sexual orientation. Please make us aware if you require any reasonable adjustments throughout the recruitment process.

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details