Azure Data Engineer

·
Part time
Location: London
· ·
Category: IT & Technology
We are looking for an experienced Azure Database Engineer to lead our cloud migration projects and support with the API projects, preferably within a healthcare data environment. The ideal candidate will have a deep understanding of Microsoft Azure and a proven track record in designing and implementing database solutions. This role involves working closely with stakeholders to ensure a smooth transition from existing On-premises platforms to Azure. You will be responsible for designing and implementing efficient, scalable, cost-effective and secure cloud solutions using Microsoft Azure. The candidate will possess a deep understanding of Azure services including but not limited to Azure Blob, Azure App Services, Azure Functions, Azure Synapse Database, Azure Storage, and Azure Networking. Understanding of Snowflake, Power Automate, Pandas, NLP and Power BI would be desirable.

Your expertise will be crucial in guiding our cancer projects to success, ensuring alignment with requirements, best practices, and security standards. You will collaborate with cross-functional teams to understand data requirements and translate them into robust architectural solutions while orchestrating and ingesting data from multiple sources (EPR, Cancer database, Imaging, Histopathology, Endoscopy, Chemotherapy, Radiotherapy etc).

Main duties of the job

Lead the migration from Onprem to Cloud based solution. Manage the existing and new APIs. Create and maintain data pipelines, data storage solutions, and data processing systems on the Azure platform. Develop and implement processes to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. Work with Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, and other storage solutions to design scalable and efficient data storage systems. Utilise big data technologies like Azure Databricks and Apache Spark to handle and analyze large volumes of data. Design, implement, and optimize data models to support business requirements and performance needs. Work with data scientists, analysts, and other stakeholders to ensure data solutions meet business needs. Identify and implement internal process improvements, such as automating manual processes and optimising data delivery. Maintain data quality, integrity, and security across all data solution.

About us

At Imperial College Healthcare you can achieve extraordinary things with extraordinary people, working with leading clinicians pushing boundaries in patient care.

Become part of a vibrant team living our values - expert, kind, collaborative and aspirational. You'll get an experience like no other and will fast forward your career.

Benefits include career development, flexible working and wellbeing, staff recognition scheme. Make use of optional benefits including Cycle to Work, car lease schemes, season ticket loan or membership options for onsite leisure facilities.

We are committed to equal opportunities and improving the working lives of our staff and will consider applications to work flexibly, part time or job share. Please talk to us at interview.

Job description

Job responsibilities

The full job description provides an overview of the key tasks and responsibilities of the role and the person specification outlines the qualifications, skills, experience and knowledge required.

Person Specification

Education/ Qualifications

Essential

Professional qualification at master's level in an IT related discipline Evidence of continued professional development as an Azure Solutions Architect Associate or Azure DevOps Engineer Associate Certification or higher.

Desirable

Azure IoT Developer Specialty Certification Degree in mathematics or health related discipline.

Experience

Essential

Proven experience as an Azure Engineer or Architect, with a strong portfolio of successful cloud solutions and projects. Experience with cloud migration and modernisation projects. Extensive proven experience of clinical or administrative and/or operational workflows and processes working with multiple systems. Experience of communicating complex issues and data concepts to large stakeholders. Experience in data integration role with the ability to apply logical thinking using a wide range of data processing tools and techniques to build and integrate solutions in a highly complex environment. Experience of working with multiple data types both structured and unstructured. Experience of metadata documentation and development. Significant experience working in Data Warehousing including DBA roles.

Desirable

Good understanding of software development lifecycle, methodologies/platforms such as Agile and GitHub. Experience of NHS cancer systems and knowledge of cancer patient pathways. Understanding of Snowflake environment. Experience of PowerBI.

Skills/Knowledge/Abilities

Essential

Expertise in Azure Databricks and Azure Synapse. Strong understanding of data modelling, ETL / ELT processes, and data warehousing concepts. Demonstrable knowledge and skills to identify and elaborate user and business needs to enable effective design, development and testing of services and business change. Advanced modelling skills. Advanced knowledge of Python and SQL (e.g. NumPy, Pandas, Scikit-Learn, NLP) and familiarity with a deep-learning framework. Highly advanced SQL server, SSIS DBT or Snowflake. Knowledge of APIs and XML/JSON.

Desirable

Although your programming language of choice (e.g. R, MATLAB or C) is not important, we do require the ability to become a fluent Python programmer in a short timeframe. Proficiency with automation tools and scripting languages such as PowerShell, CLI, or Python, XML, and JSON.

Employer details

Employer name

Imperial College Healthcare NHS Trust

Address

St Mary's Hospital

Praed Street, Paddington

London

W2 1NY

Any attachments will be accessible after you click to apply.

290-SCCS-1819 #J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details