Data Engineer – Azure Databricks

High Bridge Consulting

  • New York, New York
  • 30+ days ago
  • $70–$90 Per Hour
Want to know if you’re a fit?
Upload your resume and let our AI show you.

Skills

  • Agile Programming Methodologiesunmatched
  • Application Programming Interface (API)unmatched
  • Cloud Computingunmatched
  • Communication Skillsunmatched
  • Computer Programmingunmatched
  • Consultingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Data Managementunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • DevOpsunmatched
  • Ecosystemsunmatched
  • Engineeringunmatched
  • Financial Complianceunmatched
  • Identify Issuesunmatched
  • Information/Data Security (InfoSec)unmatched
  • Microsoft C# (C Sharp)unmatched
  • Microsoft Certificationsunmatched
  • Microsoft Windows Azureunmatched
  • Project/Program Managementunmatched
  • Python Programming/Scripting Languageunmatched
  • Quality Metricsunmatched
  • Query Optimizationunmatched
  • SQL (Structured Query Language)unmatched
  • SQL Databasesunmatched
  • Scala Programming Languageunmatched
  • Scalable System Developmentunmatched
  • Scrum Project Management and Software Developmentunmatched
  • ServiceNowunmatched
  • Software Engineeringunmatched
  • Strategic Planningunmatched
  • Structured Dataunmatched
  • System Integration (SI)unmatched
  • Technical Recruitingunmatched
  • Unstructured Dataunmatched
  • Windows PowerShellunmatched

Description

Data Engineer – Azure Databricks (Corporate Data Platform)
We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities, RESO, and HCG.
This role focuses on modern cloud data engineering, ETL/ELT pipelines, and enterprise system integration within a large-scale Azure data ecosystem.
NYC area (Hybrid – 3 days onsite per week)
Responsibilities
  • Design, build, and maintain Azure Databricks + Azure Data Factory pipelines
  • Develop ETL/ELT workflows for structured and unstructured data
  • Build scalable data models and lakehouse architectures
  • Integrate enterprise systems (ServiceNow, Workday, Dataverse, APIs)
  • Optimize SQL queries, Spark jobs, and data processing performance
  • Ensure data governance, security, and data quality standards
  • Support monitoring, troubleshooting, and pipeline reliability
  • Collaborate across business and technical teams
Required Skills
  • 5+ years in Data Engineering / Cloud Data Engineering
  • Strong hands-on experience with Azure, Databricks, Spark
  • Advanced SQL and large-scale data processing
  • Experience with Azure Data Factory
  • Strong programming in Python or Scala
  • Experience with Azure SQL Database
  • Familiarity with APIs, event-driven architecture, and system integration
  • Experience with Azure Functions
  • Working knowledge of C# and/or PowerShell
  • Strong communication and stakeholder management skills
Nice to Have
  • Delta Lake / Lakehouse architecture
  • Azure DevOps / CI-CD pipelines
  • Data governance / catalog tools (e.g., Purview)
  • Agile/Scrum environment experience
  • Microsoft or Databricks certifications
Why This Role
  • High-impact enterprise data platform work
  • Exposure across multiple business domains
  • Opportunity to shape modern Azure Databricks architecture
  • Strong focus on scalability, engineering excellence, and innovation
Compensation: $70.00 - $90.00 per hour

Numbers & Facts

LocationNew York, New York
Salary$70–$90 Per Hour

Similar Jobs

See more jobs