Senior Data Engineer

Location: Iselin, NJ
Work Mode: Hybrid

Responsibilities:

• Formulates system scope through research and fact-finding to develop or modify moderately complex information systems.
• Evaluates and implements changes to existing system logic difficulties and documentation as necessary.
• Reviews flow charts, models, and procedures and feasibility studies to design possible system solutions.
• Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system.
• Collaborates with system analysts, engineers, and programmers to design systems and to determine project limitations and capabilities, performance requirements, systems performance standards, and interfaces.
• Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
• Educates end users on system designs and functionalities through creation of training materials and conducting demos.
• Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
• Develop ETL frameworks and tools.
• Design and optimize databases (e.g., PostgreSQL, MySQL, Snowflake).
• Deploy and manage cloud solutions on AWS (Lambda, Glue, S3, Airflow).
• Implement CI/CD pipelines, security best practices, and performance monitoring.
• Lead technical discussions, mentor developers, and drive best practices.

Requirements:

• Minimum 5 years of experience in Python backend development.
• Expertise in PostgreSQL and other DB tools.
• Expertise in AWS services, Terraform.
• Experience with ETL frameworks and tools.
• Experience with Kafka, event-driven architecture.
• Strong problem-solving, analytical, and communication skills.

Preferred Skills:

• Experience with working for the technology department of Asset Management firms.