LEAD DATA ENGINEER Job at Purple Drive, Seattle, WA

MVpldEdHM2VWTEFZdHBGSEhCZTFJeTQ1eHc9PQ==
  • Purple Drive
  • Seattle, WA

Job Description

Responsibilities:

• Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files.
• Develop and support data pipelines within a Cloud Data Platform, such as Databricks
• Build data models that reflect domain expertise, meet current business needs, and will remain flexible as strategy evolves
• Monitor and optimize Databricks cluster performance, ensuring cost-effective scaling and resource utilization
• Demonstrates ability to communicate technical concepts to non-technical audiences both in written and verbal form.
• Demonstrates strong understanding with coding and programming concepts to build data pipelines (e.g. data transformation, data quality, data integration, etc.).
• Demonstrates strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
• Implement and maintain Delta Lake for optimized data storage, ensuring data reliability, performance, and versioning
• Automate CI/CD pipelines for data workflows using Azure DevOps
• Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog

Qualifications:

• 7+ years of experience in data engineering or a related field
• Expertise with programming languages such as Python/PySpark, SQL, or Scala
• Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
• Hands-on experience with Databricks Cloud Data Platforms Required
• Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines) Required

Job Tags

Flexible hours,

Similar Jobs

Memorial Hermann Health System

Associate Vice President, Chief Nursing Informatics Officer Job at Memorial Hermann Health System

 ...Associate Vice President, Chief Nursing Informatics Officer Memorial Hermann Health System Houston, Texas Kirby Bates Associates has been...  ...age, disability or protected veteran status. We celebrate diversity and are committed to creating an inclusive environment... 

AKRE & Associates

Escrow Assistant Job at AKRE & Associates

 ...Escrow Assistant Scottsdale, AZ Are you ready to be the backbone of a fast-moving escrow team? Our client, a thriving title and escrow company in the heart of Scottsdale, is looking for a detail-loving, people-focused Escrow Assistant who thrives in a busy, energetic... 

Medix™

Registered Nurse - 248247 Job at Medix™

 ...Clinical Research Nurse Manager LinkedIn Job Posting (Completely Rewritten, Client-Neutral) About...  ...preferred. Skills & Competencies Strong RN clinical skills (vital signs,...  ...Licensure & Certifications Active Registered Nurse (RN) license in New Jersey or... 

CPS Outdoors

Sales Coordinator Job at CPS Outdoors

 ...solutions. Role Description This is a full-time hybrid role for a Sales Coordinator, based in Miami, FL, with partial work-from-home flexibility. The Sales Coordinator will support the sales team by managing communications with clients, coordinating schedules,... 

The World Federation of Direct Selling Associations (WFDSA)

Operations Manager Job at The World Federation of Direct Selling Associations (WFDSA)

 ...Director Position Type : Full-Time, Permanent About Us The World Federation of Direct Selling Associations (WFDSA) is a global...  ...Director. Manage calendars, schedule meetings, coordinate travel, and prepare meeting materials. Draft and format...