Data Engineer – Senior Consultant

·
Full time
Location: Edinburgh
·
Job offered by: Opencast
·
Category:
This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. The role

You'll play a crucial role in designing, developing, and maintaining data solutions for our clients. Your focus will be to create efficient and scalable data pipelines, enable data-driven decision-making, and support business intelligence initiatives. Collaborating with cross-functional teams, you'll contribute to the successful delivery of data-driven projects. You'll ensure data integrity, security, and compliance. Essential experience

Please note, you will need to hold valid Security Clearance or eligibility (5+ years residency in the UK). Demonstrated experience of data engineering (job title not required). Knowledge of data modelling business processes for both operational (OLTP) and reporting (OLAP) stores, with a deep understanding of logical and physical data models. Enabled data consistency via auditing existing data for contextual anomalies and ensuring data quality in existing pipelines. Familiarity with business intelligence (BI) processes and tools, such as PowerBI or Tableau, with the ability to support analysts using these tools. Experience leveraging cloud services for big data storage, processing, and analytics, with expertise in Azure or AWS based workflows. Proven experience in data integration techniques, including Extract, Transform, Load (ETL) processes with technologies such as Apache Hadoop or Spark. Knowledge of database management systems, both traditional and NoSQL, with proficiency in at least one of SQL Server, PostgreSQL, Oracle, MongoDB. Understanding of data warehousing principles and methodologies such as the Kimball and Inmon approaches. Proficiency in at least one programming language (e.g., Python, Java, Scala) used for data processing and manipulation. Knowledge of best practices including governance, data quality management, metadata management, and data security measures. Core skills

In the interview, please show how you: Have effective communication skills to collaborate with both technical and non-technical team stakeholders. Work in an Agile development environment. Use problem-solving to address complex challenges. Desirable experience

Some areas of experience are not essential but relevant to the role: Microsoft Azure PaaS and IaaS. AWS PaaS and IaaS. Informatica Data Governance. Erwin data modelling solution. Databricks lakehouses and notebook based processing. Machine learning concepts and developing data pipelines for ML engines such as TensorFlow. DevOps/DataOps practices for continuous integration, deployment, and processing of data solutions. Real-time data streaming technologies like Apache Kafka, AWS Kinesis, or Azure Event Hubs. If you don't have this experience please do still apply, as we can coach you in these areas if you join us. Salary

Senior consultant salary range: £60,000-£78,000. What our offer includes

Competitive pension, health cash plan, share options, and discretionary bonus. Flexible hours and 25 days' holiday. People to support you every step of the way. Where you'll work

Your working time at Opencast will be split between multiple locations, including from our HQ and hub locations, client site, or home. Travel across the UK is part of life at Opencast, varying in frequency based on work, client, and team requirements. We include you

We welcome candidates from all identities, attributes, ways of thinking, and backgrounds to thrive in a career at Opencast. Our aim is for the diversity of our people to be reflected in the solutions we deliver, to help create a fairer society for all. Interview

Job interviews are on Microsoft Teams. We'll make any adjustments to help you. Want to know more?

Visit our website or email

careers@opencastsoftware.com . £60,000 - £78,000 a year

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details