Data Engineer

Data Engineer
Philadelphia, PA 19103 (hybrid)
Pay: $100,000-120,000

About the Role: We are seeking a highly skilled Data Engineer to join our innovative team. The successful candidate will play a crucial role in extending our ROCI big data platform and graphDB to support the syndication of the platform. You will work on cutting-edge technologies and complex data systems to drive our data engineering efforts to new heights.

Key Responsibilities:

• Develop and maintain the NEO4J Graph database to support complex data relationships and syndication needs.

• Design and implement ETL processes using Databricks, ensuring efficient data transformation and loading.

• Automate and optimize AWS pipelines to streamline data processing and integration.

• Work with ECS, EKS, and Django-based APIs to build scalable and robust data solutions.

• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data engineering solutions.

• Troubleshoot and resolve issues related to data processing, storage, and retrieval.

• Continuously evaluate and improve the performance, scalability, and reliability of the data platform.

• Stay updated with the latest industry trends and technologies to ensure the platform remains at the forefront of innovation.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• Proven experience in developing and managing NEO4J Graph databases.

• Hands-on experience with Databricks ETL processes.

• Strong expertise in AWS pipeline automation.

• Familiarity with ECS, EKS, and Django-based APIs.

• Excellent problem-solving skills and attention to detail.

• Strong communication and collaboration skills.

• Ability to work in a fast-paced and dynamic environment.

Preferred Qualifications:

• Experience with other big data technologies and platforms.

• Knowledge of data security and compliance best practices.
• Certification in AWS or related technologies.