Databricks Engineer/Architect

Madison-Davis

  • New York, NY
  • 17 days ago
  • $95
Want to know if you’re a fit?
Upload your resume and let our AI show you.

Skills

  • Amazon Simple Storage Service (S3)unmatched
  • Amazon Web Services (AWS)unmatched
  • Apache Sparkunmatched
  • Application Programming Interface (API)unmatched
  • Applications Securityunmatched
  • Architectural Servicesunmatched
  • Automationunmatched
  • Best Practicesunmatched
  • Cisco Unityunmatched
  • Cloud Architectureunmatched
  • Cloud Computingunmatched
  • Communication Skillsunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Data Lakeunmatched
  • Data Managementunmatched
  • Distributed Computingunmatched
  • Engineeringunmatched
  • Enterprise Protectionunmatched
  • Financial Servicesunmatched
  • Network Configuration Managementunmatched
  • Operational Strategyunmatched
  • Python Programming/Scripting Languageunmatched
  • REST (Representational State Transfer)unmatched
  • SQL (Structured Query Language)unmatched
  • Scalable System Developmentunmatched
  • Software Engineeringunmatched
  • Team Playerunmatched

Description


A leading financial services organization is seeking a Senior Databricks Cloud Platform Engineer to help design, build, and optimize a modern cloud-based data platform supporting enterprise analytics and data initiatives.

This position combines hands-on engineering with architectural responsibilities, offering the opportunity to build scalable infrastructure, secure cloud environments, and enterprise-grade data platforms using AWS and Databricks.

What You'll Tackle
  • Design and implement enterprise-scale Databricks solutions on AWS.
  • Build scalable and automated data ingestion pipelines.
  • Develop cloud-native data lake and lakehouse architectures.
  • Optimize Spark workloads for large-scale distributed processing.
  • Build Infrastructure as Code using Terraform.
  • Configure secure AWS networking including S3, IAM, VPC, and PrivateLink.
  • Implement Databricks security and governance best practices.
  • Develop REST API integrations and automated ingestion frameworks.
  • Collaborate with infrastructure, cloud, security, and application engineering teams.
  • Improve platform scalability, reliability, and operational efficiency.

QUALIFICATIONS
  • 10+ years of cloud, platform, or data engineering experience.
  • 5+ years working with Databricks on AWS.
  • Strong Python, PySpark, and SQL development skills.
  • Hands-on experience with Terraform.
  • Deep knowledge of AWS cloud services including S3, IAM, VPC, and PrivateLink.
  • Experience building enterprise-scale cloud data platforms.
  • Strong understanding of distributed computing and Spark optimization.
  • Experience designing secure cloud architectures.
  • Experience building REST API integrations.
  • Strong communication and stakeholder collaboration skills.
  • AWS Certifications.
  • Databricks Certifications.
  • Unity Catalog.
  • CI/CD automation.
  • Enterprise cloud security.
  • Financial Services experience.

Numbers & Facts

LocationNew York, NY
Salary$95

Similar Jobs