The Intersect Group logo

Principal Data Engineer

The Intersect Group
  • Atlanta, GA
  • Instant Apply
3 days ago

Job Description


JOB TITLE
Principal Data Engineer

LOCATION
Atlanta, Georgia | Hybrid

ROLE SUMMARY
Design and deliver enterprise data platforms and products that support reporting, analytics, machine learning, AI, and digital business capabilities. Define architectural direction, reusable engineering standards, and scalable data solutions across multiple teams and business domains. Partner with technical and business stakeholders to turn complex problems into reliable, governed data products.

KEY RESPONSIBILITIES
  • Define and evolve enterprise data engineering architectures, design patterns, standards, and best practices.
  • Create reusable engineering frameworks, templates, automation standards, and playbooks.
  • Design and deliver scalable data platforms and products across lake, warehouse, lakehouse, data mart, and semantic layers.
  • Build and modernize batch, streaming, event-driven, and API-based data integration pipelines.
  • Establish production practices for monitoring, logging, incident response, runbooks, platform support, and continuous improvement.
  • Address systemic gaps in data quality, reliability, observability, performance, cost, resiliency, and operational readiness.
  • Ensure data platforms and products meet standards for security, governance, privacy, data quality, and responsible data use.
  • Provide technical mentorship and lead cross-functional alignment without relying on formal reporting authority.

KEY REQUIREMENTS
  • Deep expertise in Python, SQL, PySpark and/or Scala, and distributed data processing frameworks.
  • Strong experience with Azure cloud platforms and Azure Databricks, including Delta Lake and platform-scale data processing.
  • Experience designing and operating data lakehouse, warehouse, data mart, semantic layer, and enterprise analytical data products.
  • Experience with CI/CD, workflow orchestration, Git-based development, automated testing, and production release practices.
  • Experience with Docker, Kubernetes, Infrastructure as Code, cloud-native deployment patterns, and modern DevOps or DataOps practices.
  • Strong understanding of observability, monitoring, logging, performance optimization, reliability engineering, and cost management.
  • Knowledge of data governance, data quality, data security, access controls, metadata management, and compliance-sensitive environments.
  • Preferred experience with streaming technologies, event-driven architectures, message queues, real-time data integration, BI tools, generative AI, or enterprise AI platforms.

Apply if you are ready to define enterprise data engineering direction and deliver platforms that support analytics, AI, and business decision-making. The role offers the opportunity to influence standards, architecture, and engineering practices across multiple teams and domains.

Numbers & Facts

LocationAtlanta, GA
IndustryStaffing/Employment Agencies
Company Size500 to 999 employees
Year Founded2006

About Company

The Intersect Group is a different and better business partner. We create unparalleled value for our clients by combining industry-leading Consulting capabilities with comprehensive Staffing and recruitment services. Clients trust us to deliver results based on our deep expertise and proven resources within finance, accounting, and information technology. Through our flexible delivery approach, you get the right solution, at the right time to accelerate your success and achieve all of your mission-critical objectives.

Skills

  • Access Controlunmatched
  • Analysis Skillsunmatched
  • Application Programming Interface (API)unmatched
  • Architectural Designunmatched
  • Architectural Servicesunmatched
  • Artificial Intelligence (AI)unmatched
  • Automationunmatched
  • Best Practicesunmatched
  • Business Intelligence Softwareunmatched
  • Cloud Computingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Improvementunmatched
  • Continuous Integrationunmatched
  • Cost Controlunmatched
  • Cross-Functionalunmatched
  • Data Managementunmatched
  • Data Martunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Warehousingunmatched
  • Design Patterns Programming Methodologiesunmatched
  • DevOpsunmatched
  • Dockerunmatched
  • Enterprise Architectureunmatched
  • Gitunmatched
  • Incident Responseunmatched
  • Information/Data Security (InfoSec)unmatched
  • Machine Learningunmatched
  • Mentoringunmatched
  • Messaging Middlewareunmatched
  • Metadataunmatched
  • Microsoft Windows Azureunmatched
  • Performance Tuning/Optimizationunmatched
  • Product Supportunmatched
  • Production Controlunmatched
  • Python Programming/Scripting Languageunmatched
  • Reliability Engineeringunmatched
  • SQL (Structured Query Language)unmatched
  • Scala Programming Languageunmatched
  • Streaming Technologyunmatched
  • Test Automationunmatched

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Resume Builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Resume Builder