Senior Data Engineer

Unity Software

San Francisco, CA

JOB DETAILS
SKILLS
Apache Kafka, Apache Spark, Architectural Services, Cisco Unity, Cloud Architecture, Cloud Computing, Cross-Functional, Data Management, Data Processing, Distributed Computing, Ecosystems, High Throughput, Java, Large-Scale Systems, Leadership, Mentoring, Process Improvement, Production Systems, Production Volume, Python Programming/Scripting Language, Reliability Engineering, Scala Programming Language, Team Lead/Manager, Technical Leadership
LOCATION
San Francisco, CA
POSTED
Today

Unity is building a robust, near real-time reporting platform that powers critical analytics and decision-making across our ecosystem. We are looking for a Data Engineer to help architect and implement the distributed data systems that drive this platform at scale.

In this role, you’ll design and build high-throughput, low-latency data processing pipelines that power reporting used by internal teams and external customers. You’ll operate at the intersection of distributed systems, stream processing, and cloud-native infrastructure — ensuring correctness, reliability, and scalability in a high-volume production environment.

This is a high-impact role where engineering rigor, architectural clarity, and production ownership matter.

What youll be doing

• Design and implement near real-time data pipelines and reporting infrastructure.

• Architect distributed stream and batch processing systems using technologies such as Apache Flink, Spark, and Airflow.

• Build and maintain data processing frameworks that handle large-scale event ingestion and transformation with strong correctness guarantees.

• Ensure production-grade reliability, observability, and operability across distributed systems.

• Define and enforce data processing semantics including:

• Exactly-once processing

• Event time vs. processing time handling

• Stateful stream management

• Backpressure and fault tolerance strategies

• Collaborate cross-functionally with data consumers, product, and infrastructure teams to define scalable reporting solutions.

• Contribute to long-term platform architecture, setting engineering standards for performance, resilience, and maintainability.

What were looking for

• Strong foundation in distributed systems and systems design.

• Hands-on experience building and operating large-scale data processing systems.

• Deep understanding of streaming concepts:-Exactly-once semantics-Watermarking and event-time processing- Stateful stream processing- Checkpointing and recovery- Backpressure handling

• Production experience with frameworks such as Apache Flink, Spark, Kafka, or similar technologies.

• Proficiency in Python, Java, or Scala.

• Experience with workflow orchestration tools (e.g., Airflow) for stream and batch coordination.

• Strong understanding of cloud-native architectures and distributed infrastructure (Kubernetes, containerization, cloud platforms).

You might also have

• Ability to lead architecture across teams and influence platform strategy.

• Experience defining technical roadmaps for distributed data systems.

• Track record of driving reliability improvements and scaling systems to high throughput environments.

• Mentorship and technical leadership across engineering teams.

Additional information

• Relocation support is not available for this position

• Work visa/immigration sponsorship is not available for this position

Benefits

At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.

Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program

About the Company

U

Unity Software