Databricks Engineer (Data Bricks Tech Lead) (Need only azure, do not share AWS, GCP profiles)

ClifyX, INC

Blue Ash, OH

JOB DETAILS
SKILLS
Amazon Web Services (AWS), Application Programming Interface (API), Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Data Management, Data Processing, Data Quality, GCP (Good Clinical Practices), Integration Testing, Mentoring, Microsoft Windows Azure, Object Oriented Programming (OOP), Process Improvement, Python Programming/Scripting Language, Regression Testing, Technical Leadership, Unit Test
LOCATION
Blue Ash, OH
POSTED
30+ days ago
Job Description
  • 5+ years of proven professional Databricks and/or Snowflake
  • 4+ years Python Development
  • Object Oriented Programming
  • 3+ years Distributed Data Processing (PySpark, Snowpark)
  • Proficient CI/CD practices
  • Automated data pipeline orchestration
  • Data observability Logging, Monitoring, and Alerting
  • Databricks and/or Snowflake
  • API development
  • Data quality checks
  • Cloud Technologies (Azure preferred)
Roles & Responsibilities:
  • Develop distributed data processing data pipeline solutions
  • Orchestrate multi-step data transformation pipelines
  • Perform unit, integration, and regression testing on packaged code
  • Build transformation logic and code in an Object Oriented Programming style
  • Enhance CI/CD pipelines in the path to production
  • Create data quality checks for ingested and post processed data
  • Ensure data observability via alerting and monitoring of automated pipeline solutions
  • Maintain and enhance existing applications
  • Build cloud resources via infrastructure as code
  • Provide mentoring to junior team members
  • Participate in retrospective reviews
  • Participate in the estimation process for new work and releases
  • Bring new perspectives to problems
  • Be driven to improve yourself and the way things are done.

About the Company

C

ClifyX, INC