AWS Data Engineer

Pay Range: $55.00hr - $60.00hr

Job Overview:

Data engineering, backend development, or software engineering position with demonstrated hands-on development experience. Requires strong hands-on experience with AWS data and cloud services, including S3, Glue, EMR, Lambda, and Redshift. Proven experience developing and maintaining production-grade APIs and backend services using Java, with a strong understanding of RESTful API design, integration patterns, and error handling. Strong programming skills in Python, with hands-on experience building reusable modules, backend components, or API integrations. Hands-on experience with PySpark and distributed data processing, including developing scalable data transformations and optimising data pipelines. Proficiency in SQL, including complex queries, data transformations, and query performance optimisation. Strong understanding of object-oriented programming, software design principles, data structures, and maintainable application architecture. Practical exposure to MCP, LLMs, generative AI, or AI application integration, with an understanding of how AI capabilities can be integrated into APIs and enterprise workflows. Experience with API testing, debugging, authentication and authorisation, and application integration. Familiarity with Git, CI/CD pipelines, automated testing, and Agile development practices. Strong problem-solving, communication, and collaboration skills, with the ability to work independently on complex technical requirements.

Preferred Qualifications:

• Experience building AI-enabled applications, LLM-powered workflows, or MCP-based integrations.
• Exposure to LLM orchestration frameworks, tool calling, retrieval-augmented generation (RAG), or enterprise AI integration patterns.
• Experience with AWS-native AI services and deployment of AI-enabled applications in cloud environments.
• Familiarity with API gateways, containerisation, microservices architecture, and application observability.
• Experience with data warehousing, distributed computing, Spark performance tuning, and data quality frameworks.

Key Responsibilities:

• Design, develop, and optimise scalable data pipelines and data processing workflows using Python, PySpark, and SQL.
• Develop, enhance, and maintain production-grade APIs and backend services using Java and Python, with a strong focus on API design, integration, performance, and reliability.
• Build and integrate RESTful APIs and microservices to support data-driven applications and enterprise integrations.
• Leverage AWS services such as S3, Glue, EMR, Lambda, Redshift, and other relevant cloud-native services to build and manage scalable data engineering solutions.
• Work with Model Context Protocol (MCP), Large Language Models (LLMs), and generative AI technologies to develop or integrate AI-enabled applications and workflows.
• Implement reusable, maintainable, and scalable code using object-oriented programming principles, design patterns, and established engineering best practices.
• Write and optimise complex SQL queries and implement efficient ETL/ELT processes for large-scale data transformations.
• Collaborate with data engineers, application developers, architects, data scientists, and business stakeholders to translate requirements into robust technical solutions.
• Troubleshoot and resolve issues across APIs, data pipelines, integrations, and cloud-based applications.
• Participate in code reviews, automated testing, CI/CD implementation, performance tuning, and production support while adhering to engineering standards.