Senior Data Engineer

TechDigital

  • Chicago, IL
  • 30+ days ago
    Want to know if you’re a fit?
    Upload your resume and let our AI show you.

    Skills

    • Automationunmatched
    • Business Intelligenceunmatched
    • Cloud Architectureunmatched
    • Cloud Computingunmatched
    • Communication Skillsunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Data Lakeunmatched
    • Data Managementunmatched
    • Data Migrationunmatched
    • Data Processingunmatched
    • Data Warehousingunmatched
    • Database Extract Transform and Load (ETL)unmatched
    • DevOpsunmatched
    • Identify Issuesunmatched
    • Information/Data Security (InfoSec)unmatched
    • Microsoft Windows Azureunmatched
    • Performance Tuning/Optimizationunmatched
    • Problem Solving Skillsunmatched
    • Python Programming/Scripting Languageunmatched
    • Regulatory Complianceunmatched
    • SQL (Structured Query Language)unmatched
    • Scalable System Developmentunmatched
    • Software Engineeringunmatched

    Description

    The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging Databricks, Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives.

    Key Responsibilities
    • Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.
    • Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
    • Implement data governance, security, and compliance standards.
    • Automate workflows using Python scripting and CI/CD pipelines.
    • Troubleshoot and resolve issues in data ingestion, transformation, and storage.
    Required Skills & Experience
    • 8+ years in data engineering or related roles.
    • Expert-level Python programming for data processing and automation.
    • Hands-on experience with Databricks and Delta Lake.
    • Strong knowledge of Azure Data Factory, Data Lake, and Synapse (or equivalent cloud platforms).
    • Proficiency in SQL and performance tuning.
    • Familiarity with DevOps practices, CI/CD, and infrastructure-as-code tools.
    • Experience with data migration and cloud-native architectures.
    • Excellent problem-solving and communication skills

    Numbers & Facts

    LocationChicago, IL
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Similar Jobs