Job Description

Role: Lead Data Engineer
Location: Seattle, WA
Duration: 6 months

Responsibilities:

• Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files.
• Develop and support data pipelines within a Cloud Data Platform, such as Databricks
• Build data models that reflect domain expertise, meet current business needs, and will remain flexible as strategy evolves
• Monitor and optimize Databricks cluster performance, ensuring cost-effective scaling and resource utilization
• Demonstrates ability to communicate technical concepts to non-technical audiences both in written and verbal form.
• Demonstrates strong understanding with coding and programming concepts to build data pipelines (e.g. data transformation, data quality, data integration, etc.).
• Demonstrates strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
• Implement and maintain Delta Lake for optimized data storage, ensuring data reliability, performance, and versioning
• Automate CI/CD pipelines for data workflows using Azure DevOps
• Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog

Qualifications:

• 7+ years of experience in data engineering or a related field
• Expertise with programming languages such as Python/PySpark, SQL, or Scala
• Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
• Hands-on experience with Databricks Cloud Data Platforms Required
• Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines) Required

Job Tags

Flexible hours,

Similar Jobs

Chicken Salad Chick

Kitchen / Dishwasher/ Prep Job at Chicken Salad Chick

Chicken Salad Chick - Kitchen / Dishwasher/ Prep Position Are you enthusiastic about learning new skills and committed to personal growth? Do you enjoy working in a team towards a common goal and building positive relationships? If yes, we want you to join our energetic...

Garney Construction

Field Engineer Job at Garney Construction

...GARNEY CONSTRUCTION A Field Engineer position is available in Suffolk, VA. In this position, you will act as the glue that unites the team by translating the information between the office engineers and the team that is making the project come to life out on the...

Aerotek

Industrial Assembler Job at Aerotek

**Job Title: Industrial Assembler $19/hour****Job Description**We are seeking a dedicated and detail-oriented Cleanroom Assembler to join... ...week.**Additional Skills & Qualifications**+ Experience with medical assembly is advantageous.+ Proficiency with hand tools and...

Gordian

Lead Data Engineer Job at Gordian

...In this position, you'd lead a team of data engineers providing direction, training, and guidance to implement software solutions. Collaborate with a cross functional team, which includes developers, product managers, QA engineers, and business analysts, to implement...

Williams-Sonoma, Inc.

Ecommerce Site Operations Lead: UAT, Optimization & CMS Job at Williams-Sonoma, Inc.

A leading retail company is seeking an Associate Manager for eCommerce Site Operations in San Francisco. This role involves overseeing site operations, managing testing processes, and collaborating with teams to deliver exceptional digital experiences. Ideal candidates ...

Lead Data Engineer Job at Purple Drive, Seattle, WA

bS9VK0NmQ0wwNGpTVG1zaFRENFJkUk9LTVE9PQ==