Staff Data Engineer

ABOUT THE TEAM

As a Staff Data Engineer on the Analytics Team, you will be collaborating with stakeholders across the company to design, build and implement data pipelines and models that enable our next generation of technology to be deployed around the world. You will also shape the current and future vision of the entire data platform. The Analytics space is engrained in our team's DNA, as we regularly discuss shifts in the industry and keep up with the top relevant blogs. If this culture and Anduril's mission speaks to you, you've found the right place.

ABOUT THE JOB

We're looking for Software and Data Engineers who are seeking high impact collaborative roles focused on driving operational execution. Ideally you are looking to learn what it takes to build the next generation of defense technology. As a Staff Engineer, you should be a player-coach; your role is to set an example for your team and define what great looks like while also being their advocate & mentor. Your leadership should take a high performing team on towards the next level.

WHAT YOULL DO

• Lead the design and roadmap for our data platform
• Partner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure for the various data needs
• Own the ingest and egress frameworks for data pipelines that stitch together various data sources in order to produce valuable data products that drive the business
• Palantir Foundry is our central hub for data driven applications, visualizations and large scale data analysis across the Anduril org. We manage a large user base and provide true data self service at scale.
• We use SQLMesh for data transformations, giving our engineers the ability to work with SQL while enjoying software engineering best practices like version control, testing, and CI/CD for data pipelines.
• For querying data, we utilize Athena, an aws serverless solution that allows our team to run analytics directly on our data lake without managing infrastructure.
• Weve implemented Apache Iceberg as our table format, providing advanced data management capabilities like schema evolution and time travel queries.
• We use Flyte for orchestration. It is a highly scalable, kubernetes native modern orchestration platform similar to Airflow or Dagster.

OPERATIONAL RESPONSIBILITIES

• Operate in a player-coach capacity, leading members of the team, while remaining hands on as a contributor

REQUIRED QUALIFICATIONS

• 6+ years of experience in a data engineering role building products, ideally in a fast-paced environment
• 2+ years in a Lead role, demonstrating autonomy and process ownership
• You are motivated by our mission. We are working to solve the biggest problems in defense
• Good foundations in Python or another language
• Experience with Spark, PySpark, SQL and dbt
• Experience with Enterprise Data Systems like Palantir Foundry
• Experience with or interest in learning how to develop data services and data products
• Experience with AWS, Azure, or GCP security ecosystem, containerization, and associated tooling
• Knowledge of data & visualization tools, such as Tableau
• Understand the importance of engineering with security's best practices in mind
• You are empathetic: you are eager to see the world from your users' perspective
• You're energized by business impact & a self-starter: you love to drive the direction of ambiguous projects
• Drive to take ownership of and debug complex data transformation pipelines and data models
• Must be a U.S. Person due to required access to U.S. export controlled information or facilities