Software Engineer - GPU Reliability

Software Engineer – GPU Reliability

Location: New York, NY

About the Role: A leading global quantitative trading firm is seeking a Software Engineer – GPU Reliability to join its Core Systems Infrastructure group. This team builds, scales, and maintains the centralized platform used across all infrastructure groups to provision, monitor, and manage the firm’s global server and network environment.

In this role, you will focus on developing Python-based tooling to analyze high-density GPU hardware performance and engineer solutions that enhance the observability, uptime, and efficiency of a large-scale accelerator fleet. You will partner closely with quantitative research and trading teams to understand complex workloads and maximize the efficiency and reliability of compute resources.

Responsibilities

• Build, maintain, and scale software tools to automate system management workflows, including GPU fleet monitoring, telemetry collection, dynamic maintenance, and network configuration.
• Diagnose and resolve complex software and hardware issues across the stack—spanning application layers, host OS, Linux kernel, and high-speed interconnects.
• Collaborate with internal engineering and research teams to optimize workload performance and maximize GPU utilization.
• Analyze job telemetry and cluster statistics to detect systemic trends, bottleneck patterns, and hardware degradation.

Qualifications

Required:

• Education: Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical discipline.
• Core Technical Expertise: 2+ years of hands-on experience programming in Python and managing large-scale GPU hardware environments.
• Systems & Hardware: Demonstrated experience deploying, tuning, and troubleshooting high-performance GPU clusters.
• Software Engineering: Solid foundation in computer science fundamentals, data structures, algorithm design, and software design patterns.
• Operating Systems: Deep understanding of Linux/Unix environments, core systems concepts, and open-source ecosystems.
• Automation: Track record of using automation and infrastructure tooling to eliminate manual toil and drive operational efficiency.
• Execution: Strong analytical problem-solving skills, high attention to detail, and the ability to thrive in a high-ownership, fast-paced setting.

Preferred:

• Direct experience with Debian-based Linux distributions.
• Familiarity with infrastructure configuration management and telemetry/monitoring suites (e.g., Ansible, Salt, Prometheus, Grafana).
• Exposure to modern CI/CD pipelines and DevOps workflows.
• Solid understanding of low-latency networking concepts and protocols.

Compensation & Benefits

• Base Salary Range: $200,000 – $300,000 USD per year, dependent on technical depth, relevant experience, and interview performance.
• Additional Benefits: Eligible for discretionary performance-based annual bonuses, comprehensive health coverage (medical/dental/vision), retirement savings plans, generous parental leave, and competitive PTO (including 20 days paid vacation and 10 paid holidays).