Job Description We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ. This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.
Key Responsibilities:
Design and maintain Airflow DAGs for production data workflows
Develop and optimize Spark / PySpark jobs on Dataproc
Build and optimize complex SQL transformations
Develop REST APIs using FastAPI Python to support data services
Implement robust data quality and validation frameworks
Monitor pipeline performance, retries, and SLA compliance
Required Skills:
6+ years of data engineering experience
Strong Python programming skills
Production experience with Apache Spark PySpark
Experience with Airflow DAG development
Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)