Best Practices, Big Data, Data Collection, Data Management, Data Modeling, Data Processing, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Debugging Skills, Identify Issues, Industry/Trade Analysis, Performance Tuning/Optimization, Process Flow, Process Improvement, Requirements Management, SQL Server Integration Services (SSIS), Scalable System Development, Technical Writing, Unit Test
Job Overview: We are seeking a skilled ETL Developer (9 to 12 years) with hands-on experience in SSIS and Databricks to design, develop, and optimize robust data integration solutions. This role is ideal for professionals who are passionate about building efficient data pipelines and ensuring high data quality across systems.
Key Responsibilities:
- Design, develop, and maintain ETL workflows using SSIS and Databricks.
- Build scalable and reliable data integration solutions to extract, transform, and load data from diverse sources.
- Optimize ETL processes for performance, scalability, and fault tolerance.
- Collaborate with business and technical stakeholders to gather data requirements and design integration strategies.
- Conduct unit testing, debugging, and performance tuning of SSIS packages and Databricks notebooks.
- Ensure data accuracy, consistency, and quality throughout the ETL lifecycle.
- Create and maintain comprehensive technical documentation for all ETL processes and data flows.
- Stay current with industry trends, best practices, and advancements in ETL and big data technologies.
Must-Have Skills:
- Proven expertise in ETL development using SSIS and Databricks.
- Strong experience in performance tuning, troubleshooting, and ensuring data integrity.
- Solid understanding of data warehousing concepts, data modeling, and data governance principles.
M
Macpower Digital Assets Edge Private Limited