Azure Data Engineer Job at 2T Consulting, Doraville, GA

  • 2T Consulting
  • Doraville, GA

Job Description

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills
  • Azure Synapse Analytics
  • PySpark
  • Apache Spark architecture
  • Spark SQL
  • Data Lake architecture
  • Medallion Architecture
  • Data transformation and processing
  • Strong troubleshooting and problem-solving skills
Nice-to-Have
  • Microsoft Fabric
  • Experience with modern cloud data platforms
Responsibilities
  • Design, develop, and optimize data solutions using Azure Synapse Analytics.
  • Develop scalable data pipelines and transformations using PySpark and Spark SQL.
  • Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
  • Design and implement Data Lake and Medallion Architecture solutions.
  • Troubleshoot performance, data quality, and pipeline-related issues.
  • Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
  • Evaluate and leverage Microsoft Fabric capabilities where appropriate.
  • Provide technical leadership and contribute to solution architecture and development standards.
Required Qualifications
  • 8+ years of experience in data engineering, cloud platforms, or related technology roles.
  • Strong hands-on experience with Azure Synapse Analytics.
  • Strong programming experience with PySpark and Spark SQL.
  • Deep understanding of Apache Spark and distributed data processing.
  • Experience designing and implementing Data Lake architectures.
  • Excellent communication and collaboration skills.
  • Strong analytical, troubleshooting, and problem-solving abilities.

Job Tags

Similar Jobs

Real Property Management Citadel

Real Estate Agent Job at Real Property Management Citadel

 ...Property Manager & Real Estate Agent Career Opportunity Real Property Management Citadel Orange County, CA Full-Time | Negotiable Compensation + Performance Bonuses + Commission Opportunities Hybrid Office & Field Position | Not an Onsite Property Manager Position... 

Arnold Fit Food Llc

Juice Bar Attendant Job at Arnold Fit Food Llc

Job Description Job Description **Cash and credit card tips** We are looking for a motivated and outgoing person looking to work 20-30 hours per week at our Juice/Smoothie Bar. Our ideal candidate is motivated, enthusiastic, outgoing, and responsible. We are looking...

Scorpion Therapeutics

Field Patient Access Director: Experience & Growth Job at Scorpion Therapeutics

Scorpion Therapeutics seeks a Director to lead Field Patient Access & Experience, guiding a national team of patient support and reimbursement professionals from field offices and sites.You will drive payer strategy, collaborate with Market Access, Sales, and Medical Affairs... 

Brex Inc.

Senior Executive Recruiter Job at Brex Inc.

 ...support you need to grow your career. Recruiting at Brex Recruiting is where every...  ...leaders. What youll do The Senior Executive Recruiter will lead end-to-end executive...  ...have up to four weeks per year of fully remote work! Responsibilities Lead... 

Baker Rullman Manufacturing, Inc.

Engineering Detailer / Draftsperson Job at Baker Rullman Manufacturing, Inc.

 ...Engineering Technology, Drafting or Mechanical Design Advanced knowledge of AutoCAD Inventor Suite, Tekla, Advanced Steel, RISA and Revit preferred. Experience focused in the fabrication of Structural Steel and Construction Candidate should will have good communication...