Senior Data Engineer Job Description:
Summary | |
General Summary | Independently designs, develops, tests, implements, documents, and supports big data/ data fabric platforms, including big data cataloging, modeling, ingestion, streaming, processing, and storage technologies and processes. Applies a general understanding of the source systems, and leverages general knowledge of data warehouse and business intelligence technologies, as well as processes, to execute responsibilities. Must have effective communication and collaboration skills to ensure work output meets business needs. |
Principle Duties | |
1 | Creates and supports the process to ingest data from source systems and place it into the data fabric and analytics platforms |
2 | Performs big data pipeline design and testing, including data design, data architecture, catalog, and repository creation |
3 | Designs, develops, and maintains the data technologies and architectures |
4 | Works with business and IT stakeholders to optimize information by defining business requirements and populating the data fabric |
5 | Collaborate with business to develop models and transformations that meet advanced analytics needs |
6 | Recommends improvements and applies standards, processes, and procedures for data pipelines |
7 | Seeks continuous data performance improvement and ensures security of information |
8 | Creates and implements effective metrics and monitoring processes |
9 | May lead small projects with manageable risks and resource requirements |
10 | Acts as a resource and impacts the quality of work for colleagues with less experience |
Education | |
Required | Bachelor s degree or equivalent education/experience |
Experience | |
Required |
|
Preferred |
|
Technical Requirements | |
Required |
|
Preferred |
|