A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning/ AI and governance. Alongside this my client is going to be going through a cloud migration to Azure.
Responsibilities :
Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines.
Develop and maintain scalable data models and databases.
Design and implement data integration and ETL/ELT processes.
Optimise and tune data storage and retrieval processes.
Collaborate with the Data Science team to implement machine learning algorithms and AI models.
Ensure data quality and integrity throughout the data lifecycle.
Monitor and troubleshoot data pipelines to ensure optimal performance.
Stay up-to-date with the latest trends and technologies in data engineering.
Requirements :
Strong hands-on experience with Azure, Synapse, and Databricks
Excellent programming skills in SQL and Python
Proficiency in building and optimising data pipelines, architectures, and datasets
Familiarity with Medallion architecture and data lakes.
Experience with data integration and ETL/ELT processes.
Knowledge of DataOps principles and experience with CI/CD tools
Strong problem-solving and troubleshooting skills.
Excellent communication and collaboration skills.
Ideally we would be looking for 2-5 years' experience in a similar role of data engineer or analytics engineer.
#J-18808-Ljbffr
#J-18808-Ljbffr
