Amazon Web Services (AWS), Apache, Best Practices, Cloud Computing, Data Management, Data Warehousing, Database Extract Transform and Load (ETL), GCP (Good Clinical Practices), IBM WebSphere DataStage, Identify Issues, Microsoft Windows Azure, Performance Tuning/Optimization, Problem Solving Skills, Production Control, Python Programming/Scripting Language, Query Optimization, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages)
Position: DataStage Developer
Location: Atlanta, GA / Nashville, TN
Duration: Long term contract
Note: Looking for Permanent / Visa independent consultants
We are looking for an experienced Senior Data Engineer to design and build robust ETL pipelines while ensuring the reliability and performance of our existing data infrastructure.
Key Responsibilities:
- Design, develop, and deploy scalable ETL pipelines using IBM DataStage
- Monitor, troubleshoot, and resolve issues in existing data pipelines
- Write and optimize complex SQL queries for data transformation and processing
- Collaborate with stakeholders to translate data requirements into technical solutions
- Document pipeline designs and contribute to engineering best practices
Required Skills & Qualifications:
- 5+ years of experience in data engineering
- Strong hands-on expertise with IBM DataStage
- Advanced SQL skills, including query optimization and performance tuning
- Solid understanding of data warehousing concepts
- Experience monitoring and troubleshooting production data pipelines
Nice to Have:
- Cloud platform experience (AWS, Azure, or GCP)
- Familiarity with orchestration tools like Apache Airflow
- Python or scripting experience