Senior Data Products Engineer – PySpark, Databricks

·
Full time
Location: Dover
·
Job offered by: Eliassen Group
·
Category:
Anywhere Type:

Contract Category:

Data Workplace Type:

Remote Reference ID:

JN -102024-91353 Date Posted:

12/20/2024 Description: We’re recruiting a Data Products Engineer with software development experience to implement robust data pipelines, APIs, and scalable software solutions with best-practice data architectures. We want you to leverage your leading expertise in data engineering, software development, and cloud technologies to design and optimize the data infrastructure for a highly complex, employee-facing data and analytics web application. Team players only, with emphasis on openness, honesty, reliability, and mature competency. Experience Requirements: 10+ years of professional experience in data engineering and software development roles EXTENSIVE experience in Medallion Architecture, Databricks Development, and building robust data platforms for streaming / real-time applications Hands-on experience with PySpark and Python, including multiple libraries Great understanding of how data moves throughout an organization, data validation, cleansing, etc. Proven track record in Agile software product development 7+ years in programming languages like Python, Java, or Scala Extensive experience with Databricks and Azure are a must Experience with other data technologies such as Databricks and Hadoop, Spark, or Kafka are a plus Strong understanding of database technologies (SQL and NoSQL) and data modeling Expertise in designing and implementing scalable data pipelines and ETL processes Experience designing and developing APIs for data access and integration Strong understanding of software engineering principles, including design patterns and version controls Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred Previous experience as a member of an Inaugural Dev Team or start-ups is a plus. Critical technologies for this role: Python SQL Spark / PySpark Scala Advanced Scripting with Bash/Powershell Data Modeling Object-Oriented Programming (OOP) Functional Programming Test-Driven Development (TDD) Version Control (Git) Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $80 - $90 / hr. w2

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details