Senior Data Engineer - Remote Job at Duobridge Talent Solution, United States

  • Duobridge Talent Solution
  • United States

Job Description

Job Summary:

We are looking for a Senior Data Engineer with strong Python and data engineering experience to build scalable data platforms and pipelines using Azure, Databricks, and Snowflake .

Key Responsibilities:
  • Design and develop scalable ETL/ELT data pipelines.
  • Build data ingestion frameworks using Python, APIs, and distributed processing .
  • Develop Databricks pipelines using PySpark and Delta Lake .
  • Work with Snowflake, Azure Data Factory, ADLS Gen2, and Azure Synapse .
  • Design Medallion Architecture, CDC, data models, and data quality frameworks.
  • Develop REST/GraphQL API integrations with authentication, retry, and error handling.
  • Optimize pipeline performance, reliability, and cloud costs.
  • Support batch, real-time, and event-driven data processing.
  • Collaborate with AI engineers, architects, product teams, and business stakeholders.
Required Skills:
  • 5+ years of Data Engineering experience.
  • Strong Python and Advanced SQL skills.
  • Hands-on experience with Databricks, PySpark, Delta Lake, and Snowflake .
  • Strong knowledge of Azure Data Factory, ADLS Gen2, and Azure Synapse .
  • Experience with REST/GraphQL APIs, OAuth2/JWT, and API integrations.
  • Knowledge of data architecture, CDC, Medallion Architecture, and dimensional modeling.
  • Experience with Git and CI/CD .
Good to Have:

Airflow, dbt, Kafka, Terraform, Azure OpenAI, and AI/ML data pipelines.

#J-18808-Ljbffr

Job Tags

Similar Jobs

Byrider

Recruiter Job at Byrider

 ...strong relationships with Franchisees and act as a recruiting advisor Develop talent pipelines for key and recurring roles Utilize ATS and recruiting tools to manage pipelines and track results What You Bring ~5+ years of recruiting experience (multi-location... 

ESOP Partners

ESOP Retirement Plan Administrator - Assistant Job at ESOP Partners

 ...Description Job Description Assistant ESOP Administrator DEPARTMENT: ESOP Services...  ...of Employee Stock Ownership Plans (ESOPs). Our mission is to maximize the...  ...Experience with benefits administration or retirement plans is preferred. PHYSICAL AND COGNITIVE... 

Jump!, Inc

Staff/Principal Software Engineer - Brazil Job at Jump!, Inc

 ...3 by repeat entrepreneurs and is led by a team with backgrounds from Harvard, Stanford, Google, Snowflake, Bill.com , JPMorgan, Fidelity, Bain, EY, Bain Capital Ventures, Auditboard, Nitrogen, and more. What is the job? To succeed in this role, you should have... 

Shure

Data Engineering Intern Job at Shure

 ...a variety of work arrangements from onsite interns to fully remote in US. Each intern will receive...  ...late fall/early winter. The research science team seeks a motivated engineer to create, augment, and simulate audio data. In your role as Data Engineer Intern , you... 

Perplexity AI

Social Media Manager Job at Perplexity AI

Perplexity is looking for a Social Media Manager to expand how Perplexity shows up online. You'll run the channels day to day, writing posts, setting strategy, scaling our accounts, and writing for leadership and the team, working closely with our Communications and marketing...