Sign upLog in
See more jobs

Data Engineer

PeopleNTech LLC
  • Santa Clara, CA
  • $70 Per Hour
  • Quick Apply
30+ days ago

Job Description

Role : Data Engineer
Location : New York (100% onsite) (need local to NY)
Interview mode : ( 1 Video interview and CI will be in person)
Rate : $70/hr

Candidates need to have colab set up ready with Gmail account so they can code on the L1 interview


Must have :
Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL
Cloud Platforms: AWS
Data Warehousing & Analytics: Redshift or Snowflake or Big Query
Data Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bricks
CI/CD: AWS Code Pipeline, Jenkins, CloudFormation, Docker, Kubernetes

JD :
  • Results-driven Data Engineer with a decade of expertise in Data engineering across cloud platforms with a total of 12 years in IT.
  • Extensive experience utilizing Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Dataprep, and Pub/Sub, for data engineering solutions.
  • Proficient in building and managing GCP data pipelines with tools like Cloud Composer and Cloud Dataflow.
  • Proven ability in developing and deploying applications on Google Kubernetes Engine (GKE).
  • Strong background in implementing security and compliance on GCP, ensuring data privacy and regulatory adherence.
  • Track record of optimizing cost and resource usage within GCP environments.
  • Skilled in AWS services such as Amazon EMR, Redshift, and Glue for efficient data processing.
  • Expertise in architecting scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless computing.
  • Adept at setting up AWS Kinesis streams to process real-time data, enhancing system responsiveness and data-driven decision-making.
  • Proficient in leveraging AWS DynamoDB to create scalable, low-latency NoSQL databases for dynamic applications.
  • Deep expertise in optimizing and managing Amazon Redshift data warehouses to deliver high-performance analytics and business insights.
  • Experienced in integrating AWS services into CI/CD pipelines, streamlining automation for continuous integration, delivery, and deployment.
  • Skilled in setting up and securing AWS Virtual Private Cloud (VPC) environments.
  • Proficient in managing Azure virtual machines (VMs) for cloud infrastructure operations.
  • Extensive experience managing on-premises data infrastructure, including data warehouses and databases.
  • Familiar with AWS DevOps practices for continuous integration and deployment.
  • Expertise in using Git for version control in DBT projects, ensuring proper tracking and documentation of data model changes.
  • Skilled in performance optimization and tuning of on-premises data systems.
  • Proficient in data migration strategies between on-premises and cloud environments.
  • Strong troubleshooting skills in resolving issues within on-premises data systems.
  • Proven ability to maintain high availability and disaster recovery solutions in on-premises environments.
  • Experienced in implementing CI/CD pipelines using tools like Jenkins and GitLab CI/CD.
  • Adept in automated testing processes, including unit, integration, and regression testing.
  • Skilled in gathering and analyzing project requirements to ensure alignment with business goals.
  • Experienced in Agile project management, contributing to successful outcomes through data-driven analytics and collaborative teamwork


Numbers & Facts

LocationSanta Clara, CA

Skills

  • AWS Lambdaunmatched
  • Agile Programming Methodologiesunmatched
  • Amazon Web Services (AWS)unmatched
  • Automationunmatched
  • Cloud Computingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Cost Controlunmatched
  • Data Analysisunmatched
  • Data Managementunmatched
  • Data Migrationunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • DevOpsunmatched
  • Disaster Recoveryunmatched
  • Dockerunmatched
  • Documentation Modelsunmatched
  • Electronic Medical Recordsunmatched
  • GCP (Good Clinical Practices)unmatched
  • Gitunmatched
  • Google App Engine (GAE)unmatched
  • High Availabilityunmatched
  • Identify Issuesunmatched
  • Integration Testingunmatched
  • Jenkinsunmatched
  • Microsoft Windows Azureunmatched
  • Migration Strategyunmatched
  • Multiplatform/Cross-Platformunmatched
  • NoSQLunmatched
  • Performance Analysisunmatched
  • Performance Tuning/Optimizationunmatched
  • Privacy Regulationsunmatched
  • Private Cloudunmatched
  • Problem Solving Skillsunmatched
  • Project Controlunmatched
  • Project Evaluationunmatched
  • Project/Program Managementunmatched
  • Quality Assurance Methodologyunmatched
  • Regression Testingunmatched
  • Requirements Managementunmatched
  • Sales Pipelineunmatched
  • Snowflake Schemaunmatched
  • Software Developmentunmatched
  • Software Engineeringunmatched
  • Source Code/Configuration Management (SCM)unmatched
  • Team Playerunmatched
  • Test Automationunmatched
  • Testingunmatched
  • Unit Testunmatched
  • VMS Operating Systemunmatched
  • Virtual Machine (VM)unmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder