Job Description
Cloud Engineer (Data Engineer) Austin, TX- 3 days onsite 6+ Months Contract Job Description:- Work with business and technical leadership to understand requirements.
- Design to the requirements and document the designs.
- Ability to write product-grade performant code for data extraction, transformations and loading using Spark, PySpark.
- Do data modeling as needed for the requirements.
- Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and DataBricks Unity Catalog.
- Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS or DataBricks.
- Implement DataBricks job orchestration using DataBricks.
- Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment.
- Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives.
Required :
- Strong development experience in Spark, PySpark, Shell scripting, Teradata, and DataBricks .
- Experience with AbInitio is required.
- Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures.
- Proficiency in Shell Scripting for automation, system administration, and data processing tasks.
- Excellent work experience on DataBricks as data warehouse/Data Lake implementations.
- Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory) Unix/Linux Shell scripting (KSH) and basic administration of Unix servers CA7 Enterprise Scheduler AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch) Databricks (Delta lake, Notebooks, Pipelines, cluster management, Clienture/AWS integration).
- Hands-on experience working with Teradata, including data modeling, SQL development, performance tuning, and large-scale data management.
- Experience in Jira and Confluence Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
- Strong experience developing large-scale data processing solutions using Apache Spark and PySpark.
- Desired:
- Health care domain knowledge.
Numbers & Facts
| Location | Austin, TX |
| Industry | Medical Devices and Supplies |
| Company Size | 500 to 999 employees |
Skills
AWS Lambdaunmatched
Agile Programming Methodologiesunmatched
Amazon Elastic Compute Cloud (EC2)unmatched
Amazon Simple Notification Service (SNS)unmatched
Amazon Simple Storage Service (S3)unmatched
Amazon Web Services (AWS)unmatched
Apache Sparkunmatched
Apiary/Beekeepingunmatched
Atlassian JIRAunmatched
Cisco Unityunmatched
Cloud Computingunmatched
Data Lakeunmatched
Data Managementunmatched
Data Modelingunmatched
Data Processingunmatched
Data Warehousingunmatched
DevOpsunmatched
Documentationunmatched
Gitunmatched
Healthcareunmatched
Identify Issuesunmatched
Jenkinsunmatched
Ksh (Korn Shell) Scriptingunmatched
Linux Operating Systemunmatched
NCR Teradataunmatched
Performance Tuning/Optimizationunmatched
Product Demonstrationunmatched
Production Controlunmatched
Production Systemsunmatched
SQL (Structured Query Language)unmatched
Sales Pipelineunmatched
Schedule Developmentunmatched
Scripting (Scripting Languages)unmatched
Scrum Project Management and Software Developmentunmatched
Simple Queue Service (SQS)unmatched
Software Engineeringunmatched
Sprint Planningunmatched
Stored Proceduresunmatched
Systems Administration/Managementunmatched
Technical Leadershipunmatched
Unix Shell Programmingunmatched
Unix System Administrationunmatched
Writing Skillsunmatched
Level up your application
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesImprove your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder