HPC Storage Engineer

SW5 Consulting
  • New York City, New York
    3 days ago

    Job Description

    High Performance Compute (HPC) Storage Engineer


    Locations: Austin, TX | Chicago, IL | New York, NY | London, UK | Norway


    About the Role: The Infrastructure and R&D engineering group at a leading global quantitative trading firm designs, builds, and maintains the high-performance computing, networking, and data storage systems that power round-the-clock automated trading strategies and research platforms. The Storage Engineering team manages exabyte-scale data infrastructure tailored for state-of-the-art AI/ML workloads.

    We are seeking an experienced Storage Engineer who thrives in a fast-paced environment and values an open, collaborative organizational culture. In this role, you will oversee existing storage systems while taking key responsibility for designing, automating, and scaling next-generation storage architectures. Joining a agile team dedicated to HPC storage, you will have significant autonomy to evaluate, prototype, and implement new hardware and software technologies to maximize performance and usability across the global research ecosystem.


    Responsibilities

    • Design, deploy, and manage a diverse suite of high-performance storage solutions.
    • Troubleshoot complex storage, Linux OS, and networking interactions.
    • Develop custom automation and tooling to enhance performance, reliability, and telemetry across storage clusters.
    • Research, benchmark, and integrate emerging storage hardware and software technologies.


    Qualifications

    • Distributed Filesystems: Deep expertise with distributed file systems for large-scale cluster environments (e.g., Lustre, CephFS, GPFS/MMFS).
    • Storage Design: Proven ability to architect custom, highly available NAS architectures with built-in redundancy.
    • HPC Experience: 3+ years in high-performance computing or ultra-low-latency environments managing petabyte-scale storage deployments (1PB+).
    • Enterprise Storage Solutions: 3+ years working with scale-out enterprise platforms (e.g., VAST Data, Isilon, NetApp, Pure Storage).
    • Linux Systems & Filesystems: Advanced proficiency in Linux system administration, OS troubleshooting, NFS, ZFS, and native Linux filesystems.
    • Scripting & Automation: Strong practical experience in Python and shell scripting (Bash).
    • Execution & Collaboration: Excellent cross-functional communication, strong time management, and the ability to balance solo execution with collaborative problem-solving in dynamic environments.


    Compensation & Benefits

    • Base Salary Range: $150,000 – $250,000 USD per year (or local currency equivalent), determined by location, skills, and experience.
    • Additional Compensation: Eligible for discretionary annual performance bonuses and a comprehensive benefits package.


    Numbers & Facts

    LocationNew York City, New York

    Skills

    • Artificial Intelligence (AI)unmatched
    • Automationunmatched
    • Bash Scriptingunmatched
    • Benchmarkingunmatched
    • Compensation and Benefitsunmatched
    • Computer Networksunmatched
    • Computer Storage Hardwareunmatched
    • Cross-Functionalunmatched
    • Data Storageunmatched
    • Distributed Computingunmatched
    • Ecosystemsunmatched
    • File Systemsunmatched
    • Hardware-Software Integrationunmatched
    • High Availabilityunmatched
    • Identify Issuesunmatched
    • Large-Scale Systemsunmatched
    • Linux Operating Systemunmatched
    • Machine Toolunmatched
    • NetApp Storage Systemsunmatched
    • Organizational Cultureunmatched
    • Performance Managementunmatched
    • Problem Solving Skillsunmatched
    • Prototypingunmatched
    • Python Programming/Scripting Languageunmatched
    • Research & Development (R&D)unmatched
    • Scripting (Scripting Languages)unmatched
    • Storage Architectureunmatched
    • Storage Softwareunmatched
    • Team Lead/Managerunmatched
    • Team Playerunmatched
    • Telemetryunmatched
    • Time Managementunmatched
    • Unix Shell Programmingunmatched
    • Usability Engineeringunmatched

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Resume Builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Resume Builder