Sr Data Engineer

ClifyX, INC

Phoenix, AZ

Apply

JOB DETAILS

SKILLS

Agile Programming Methodologies, Analysis Skills, Apache, Apache Spark, Big Data, Cloud Computing, Cloud Storage, Coding Standards, Communication Skills, Continuous Deployment/Delivery, Continuous Improvement, Continuous Integration, Cross-Functional, Data Lake, Data Management, Data Modeling, Data Processing, Data Warehousing, Database Extract Transform and Load (ETL), DevOps, Dimensional Modeling, Document Management, GCP (Good Clinical Practices), Git, Identify Issues, Operations Processes, Performance Tuning/Optimization, Problem Solving Skills, Python Programming/Scripting Language, Release Management/Engineering, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages), Scrum Project Management and Software Development, Software Engineering, Source Code/Configuration Management (SCM), Sprint Planning

LOCATION

Phoenix, AZ

POSTED

30+ days ago

Job Description
Experience Required - 6+ Years

Must Have Technical/Functional Skills
" Strong hands-on experience in Big Data technologies and distributed data processing frameworks.
" Proficiency in Python for data engineering, scripting, and performance optimization.
" Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation and processing.
" Solid experience in designing and developing ETL/ELT pipelines for batch and real-time data processing.
" Experience working with Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and Pub/Sub.
" Strong understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
" Experience with CI/CD pipelines and DevOps practices for data engineering workflows.
" Proficiency in version control systems (Git) and build/release management.
" Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.
" Experience working in Agile/Scrum environments with cross-functional teams.
" Strong analytical and problem-solving skills
" Strong collaboration and stakeholder communication skills

Roles & Responsibilities
" Design, develop, and maintain scalable Big Data pipelines using Spark (PySpark/Spark SQL) for batch and real-time processing.
" Build and optimize robust ETL/ELT workflows to ingest, transform, and load data from multiple structured and unstructured sources.
" Develop high-performance SQL queries and implement efficient data models to support analytics and reporting needs.
" Architect and implement data solutions on Google Cloud Platform (GCP) using services such as BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, and Composer.
" Monitor, troubleshoot, and resolve production issues in distributed and cloud environments.
" Automate operational processes and enforce coding standards, version control, and documentation practices.
" Automate operational processes and enforce coding standards, version control, and documentation practices.
" Collaborate with cross-functional teams including business stakeholders, data engineers, and product teams
" Drive analytics initiatives to provide actionable insights.
" Participate in Agile ceremonies including sprint planning, design reviews, and retrospectives.
" Continuously improve reporting frameworks and data processes in alignment with Agile delivery practices

About the Company

ClifyX, INC

Resume Resources

Free Resume Templates Free Resume Builder