Senior Lead Data Engineer

·
Full time
Location: Exeter
·
Job offered by: Karkidi
·
Category: IT & Technology
Are you ready to make a significant impact on the future of data and engineering? We have an exciting Senior Lead position in our Data Engineering team, perfect for experienced, hands-on professionals in leading and innovating. As a 100% data-driven company, we pride ourselves on employing the best engineering practices across our products and solutions. As direct report to the Head of Data Engineering, you will play a crucial role in driving the team’s vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is an exciting opportunity for highly skilled and motivated Senior Lead Data Engineers with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions who are looking to keep crafting their technical leadership responsibilities and shape the future of data engineering within our organisation. In this role, you will: Technical Leadership:

Assist the Head of Data Engineering in overseeing the design, development, and optimisation of data software, data infrastructure and pipelines. Team Technical Leadership:

Guide a team of talented data engineers to deliver cutting-edge solutions, mentor and coach them, ensuring that best practices in data engineering and software development are followed. Lead by example. Be hands-on. Lead by Example:

We value leaders with exceptional technical expertise and hands-on coding skills. As a Senior Lead, you’ll set the standard by being directly involved and actively contributing to technical challenges. Be ready to roll up your sleeves when necessary and engage in real, impactful work alongside the team. Data Strategy & Solutions:

Own the technical roadmap, aligning engineering efforts with broader business goals and ensuring timely delivery, quality control, and that architectural decisions are forward-thinking and scalable. Inspire the team by providing a clear vision for technical excellence and innovation in the data engineering strategy. Cloud:

Optimise cloud-based data solutions, storage and processing systems, with hands-on experience in AWS or Azure. Technical Excellence:

Lead the pursuit of technical excellence by championing best practices in coding, architecture, and performance. Foster a team culture focused on continuous improvement, where learning is encouraged. Leverage Big Data Technologies:

Utilise tools such as Hadoop, Spark, and Kafka to design and manage large-scale on-prem data processing systems. Collaboration:

Collaborate with cross-functional teams and stakeholders to deliver high-impact solutions that align with business objectives. Assemble Large, Complex Data Sets:

Craft and manage data sets that meet both functional and non-functional business requirements. Monitoring & Troubleshooting:

Ensure data quality, integrity, and availability by developing systems and solutions to monitor performance, quality and troubleshoot issues as they arise. Build Advanced Data Solutions:

Develop the software and infrastructure for optimal data extraction, transformation, and loading using leading cloud technologies like Azure and AWS or Big Data ones. Ensure Cost Efficiency:

Keep the Data Lakes and Data solutions within agreed cost models and budgets. Data Engineering Empowerment:

Empower a high-performing engineering team to deliver innovative software while fostering a collaborative environment where ideas are valued. Act as a mentor, helping team members overcome technical challenges and grow in their roles. About You The Senior Lead Data Engineer will be a passionate leader with hands-on seniority in engineer with the ability to inspire, mentor, and bring a team along on the journey. The ideal candidate will possess: Depth of Expertise:

seasoned hands-on experience in data engineering, with extensive experience in a leadership or mentoring role. Demonstrated track record of leading complex data engineering initiatives at scale. Extensive experience in designing, implementing, and optimizing data solutions, supported by a history of successfully managing technical teams and projects. Exceptional coding skills. Degree in Computer Science, Software Engineering, or similar (applied to Data. Data Specialisation). Extensive experience in data engineering, in both Cloud & On-prem Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and Information Security principles. Effective communication, ability to explain technical concepts to a range of audiences. Able to provide coaching and training to less experienced members of the team. Essential skills: Programming Languages such as Spark, Java, Python, PySpark, Scala, etc (minimum 2) Extensive Big Data hands-on experience (coding/configuration/automation/monitoring/security/etc) is a must. Significant AWS or Azure hands-on experience (coding/configuration/automation/monitoring/security). ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications AWS, Azure, or Cloudera certifications are a plus. Nice to have skills: Geospatial data experience. Advanced Database and SQL skills. SQL or Data warehousing design patterns and implementation. Join us and lead the charge in transforming the data landscape at Landmark, while advancing your career in a dynamic and forward-thinking environment.

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details