Johnson Service Group (JSG) is currently looking for a
Data Engineer with
strong Python, SQL, cloud data engineering, and
big data processing experience. Our client is seeking a Data Engineer to design, develop, and optimize scalable data pipelines, data integration processes, and cloud-based data solutions to support reliable data processing, storage, and analytics.
Must Have Skills- Strong proficiency in Python and SQL.
- Experience developing ETL/ELT pipelines, data ingestion, transformation, data quality processes, and schema design.
- Hands-on experience with Apache Spark/PySpark and distributed data processing fundamentals.
- Experience with relevant cloud technologies, including AWS (S3, Glue, EMR, Redshift), Azure (ADLS, Data Factory, Databricks), or GCP (BigQuery, Dataflow).
- Experience with Snowflake, Databricks, Amazon Redshift, Google BigQuery, or equivalent data warehousing solutions.
- Experience with Apache Airflow, Azure Data Factory, AWS Step Functions, or equivalent orchestration tools.
- Strong understanding of relational database concepts and experience with PostgreSQL, MySQL, or SQL Server.
- Experience with dimensional modeling, star and snowflake schemas, and fact/dimension table design.
- Proficiency with Git, branching strategies, pull request practices, and CI/CD fundamentals.
- Experience with monitoring, logging, error handling, retry/recovery mechanisms, and performance optimization.
- Experience implementing validation, reconciliation, completeness and accuracy checks, and handling incorrect or late-arriving data.
- Understanding of NoSQL database concepts.
Responsibilities- Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, and processing.
- Build and optimize data processing solutions using Python, SQL, and Apache Spark/PySpark.
- Develop and support cloud-based data engineering solutions using AWS, Azure, or GCP.
- Implement and maintain data warehouse structures, dimensional models, and database schemas.
- Develop and manage automated data workflows using orchestration tools.
- Establish data quality controls, including validation, reconciliation, and accuracy checks.
- Monitor and troubleshoot production data pipelines, ensuring reliable performance, error handling, and recovery.
- Optimize data processing performance and support efficient distributed data workloads.
- Apply Git version control and CI/CD practices to support reliable development and deployment processes.
- Payrate- $55- $60 USD as per experience
Johnson Service Group (JSG) is an Equal Opportunity Employer. JSG provides equal employment opportunities to all applicants and employees without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, disability, marital status, protected veteran status, or any other characteristic protected by law.
#LI-KS1