Senior Data Software Engineer/ AWS, Databricks, PySpark

Back to Search

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote in Georgia, & 4 others

Data Software Engineering

apply

FacebookLinkedInSend via email

Looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find me a job

Location-specific conditions & benefits*

Choose an option

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions.

Responsibilities

• Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements

• Build and maintain scalable backend services and integrations using Python

• Develop and support data pipelines using PySpark and Apache Airflow (MWAA)

• Deploy and manage Databricks environments on AWS via reusable Terraform modules

• Establish and maintain Delta Sharing for secure data sharing between Databricks accounts

• Create microservices and platform tooling that enable collaboration across distributed engineering teams

• Contribute to platform initiatives used by engineers globally

• Collaborate with cross-functional stakeholders spanning multiple geographies and business units

Requirements

• 3+ years of experience in Data Software Engineering

• Strong backend engineering experience in Python, including async patterns, clean code, and testing with pytest

• Working knowledge of AWS services such as IAM, S3, and DynamoDB

• Familiarity with Kubernetes on AWS, CodeArtifact, and MWAA

• Hands-on proficiency in Databricks and PySpark for data pipeline development and platform management

• Background in designing and building microservices architecture and distributed systems

• Skills in Infrastructure as Code using Terraform or equivalent

• Understanding of data security and privacy principles, including GDPR

• Ownership - proactive accountability for deliverables end-to-end

• Team player - respectful communication and shared responsibility for team outcomes

• Organisational skills - self-directed and able to manage workload in a distributed team

• Engineering mastery - commitment to quality, best practices, and continuous improvement

• English level B2+, with the ability to communicate fluently with English-speaking stakeholders and share technical reasoning clearly

Nice to have

• Expertise in Delta tables and Delta Sharing

• Competency in data modeling and extensible schema design