Blue Cross and Blue Shield Association logo

Director, Performance Engineering and Test Automation

Blue Cross and Blue Shield Association
  • Baltimore, MD
    2 days ago

    Job Description

    Your Role

    The Stellarus Technology team builds and operates the platform, services, and products that support payer operations, member experiences, customer integrations, and internal product delivery. The Director, Performance Engineering and Test Automation will report to the VP, Engineering. In this role, you will create the automated performance and reliability validation systems that give engineering teams clear evidence before services reach production.

    You will own the strategy and implementation for performance testing, load testing, scalability validation, resilience testing, synthetic monitoring, test data automation, and release gates across the Stellarus platform. You will work directly with developers to define the standards, patterns, tooling, and expectations teams use when they design, build, test, and operate services, including where AI and AI-assisted engineering tools can improve quality, speed, and signal.

    This is a new role for a builder who can define the practice, implement the tooling, partner with engineering teams, and create a culture where performance and reliability are validated continuously. The role combines performance engineering, platform quality, automation, observability, and production readiness.

    Our leadership model is about developing great leaders at all levels and creating opportunities for our people to grow personally, professionally, and financially. We are looking for leaders energized by creative and critical thinking, building and sustaining high-performing teams, getting results the right way, and fostering continuous learning.

    Your Knowledge and Experience

    • Bachelor's degree or High School Diploma/GED and 4 years of additional relevant experience in lieu of a degree.
    • 10 years of software engineering, quality engineering, performance engineering, platform engineering, SRE, or related technical experience.
    • 6 years leading teams or technical programs focused on performance, test automation, reliability, platform quality, or production readiness.
    • Strong hands-on background building automated test systems, load testing frameworks, performance pipelines, or reliability validation tooling.
    • Experience testing distributed systems, microservices, APIs, event-driven architectures, and cloud-native applications.
    • Practical understanding of latency, throughput, concurrency, queueing, backpressure, retries, caching, database performance, resource saturation, and failure modes in production systems.
    • Experience with tools such as k6, Gatling, JMeter, Locust, Playwright, Cypress, Jest, Grafana, Prometheus, OpenTelemetry, Datadog, New Relic, Azure Monitor, or similar platforms.
    • Experience integrating automated tests into CI/CD pipelines and making test results useful to engineering teams.
    • Experience evaluating or applying AI-assisted engineering tools for test generation, analysis, automation, or developer productivity is preferred.
    • Strong understanding of Kubernetes, containers, cloud infrastructure, API gateways, message queues, relational databases, and service observability.
    • Ability to work with engineers at code, architecture, infrastructure, and operational levels.
    • Experience defining performance benchmarks, synthetic workloads, test data strategies, production-like environments, and release readiness criteria.
    • Strong communication skills. You can explain performance risk clearly and turn findings into practical engineering action.
    • Healthcare, payer, regulated-industry, SOC 2, HIPAA, or security-sensitive platform experience is preferred.

    Technology Context

    Stellarus is building primarily with:

    • TypeScript, Node.js, NestJS, React, Next.js
    • PostgreSQL, Azure Blob Storage, Snowflake
    • Azure Kubernetes Service, Azure API Management, Azure Service Bus
    • Dapr for service invocation and pub/sub
    • Terraform, ArgoCD, GitHub Actions, Docker
    • Auth0, OAuth2, OpenID Connect, API key support for integrations
    • Nx monorepo, API contract-first development, automated testing

    For this role, we especially value experience with:

    • Automated performance and load testing for APIs and distributed workflows
    • Synthetic monitoring and production-like traffic modeling
    • Observability-driven debugging and regression detection
    • AI-assisted test generation, failure analysis, and engineering workflow automation
    • CI/CD quality gates and release readiness automation
    • Database and message-queue performance analysis
    • Kubernetes workload tuning and capacity planning
    • End-to-end test automation for user-facing and service-level workflows

    We value strong engineering judgment, a bias toward automation, and the ability to build systems that help product teams move faster with clear performance and reliability signals.

    Hybrid

    This role requires employees to be in-office based on our hybrid workplace model, balancing purposeful in-person collaboration with flexibility. For most teams, this means coming into the office two days each week.

    Employees living more than 50 miles from an office location will work with their manager to determine in-office time based on business need.

    Your Work

    In this role, you will:

    • Build the performance engineering and automated testing function for Stellarus'' cloud-native platform.
    • Design and implement fully automated performance, load, stress, soak, regression, and scalability test systems for services, APIs, workflows, and products.
    • Establish automated quality gates in CI/CD so teams get clear feedback before code reaches production-like environments.
    • Define service-level performance expectations, test coverage standards, baseline thresholds, release criteria, and escalation paths for performance regressions.
    • Partner directly with developers to define practical standards for testing microservices, event-driven workflows, APIs, customer-facing applications, and internal platform services.
    • Use AI-assisted tools where they make sense to accelerate test generation, synthetic scenario creation, log analysis, regression detection, documentation, and developer feedback loops.
    • Create production-like test environments, test data strategies, traffic models, synthetic workloads, and repeatable test scenarios that reflect real healthcare payer workflows.
    • Use observability data to connect test results to system behavior, including latency, throughput, error rates, queue depth, resource saturation, database performance, cold starts, retries, and downstream failures.
    • Help teams identify bottlenecks in application code, APIs, database queries, infrastructure, Kubernetes configuration, service-to-service calls, and event processing.
    • Build dashboards and reporting that make performance trends visible and actionable for engineers, product leaders, and technology leadership.
    • Collaborate with developers to define standards for automated end-to-end testing, contract testing, integration testing, and performance regression testing across the Nx monorepo.
    • Work with platform engineering to integrate testing into GitHub Actions, AKS, Dapr, Azure Service Bus, APIM, Terraform-managed environments, and ArgoCD deployment workflows.
    • Lead incident and launch readiness reviews where performance, scalability, or reliability risk is material.
    • Mentor developers, architects, and managers on performance design, test automation, failure analysis, and production readiness.
    • Build a small high-leverage team over time, while remaining close enough to the tooling and technical details to set direction credibly.

    Your Work

    In this role, you will:

    • Build the performance engineering and automated testing function for Stellarus'' cloud-native platform.
    • Design and implement fully automated performance, load, stress, soak, regression, and scalability test systems for services, APIs, workflows, and products.
    • Establish automated quality gates in CI/CD so teams get clear feedback before code reaches production-like environments.
    • Define service-level performance expectations, test coverage standards, baseline thresholds, release criteria, and escalation paths for performance regressions.
    • Partner directly with developers to define practical standards for testing microservices, event-driven workflows, APIs, customer-facing applications, and internal platform services.
    • Use AI-assisted tools where they make sense to accelerate test generation, synthetic scenario creation, log analysis, regression detection, documentation, and developer feedback loops.
    • Create production-like test environments, test data strategies, traffic models, synthetic workloads, and repeatable test scenarios that reflect real healthcare payer workflows.
    • Use observability data to connect test results to system behavior, including latency, throughput, error rates, queue depth, resource saturation, database performance, cold starts, retries, and downstream failures.
    • Help teams identify bottlenecks in application code, APIs, database queries, infrastructure, Kubernetes configuration, service-to-service calls, and event processing.
    • Build dashboards and reporting that make performance trends visible and actionable for engineers, product leaders, and technology leadership.
    • Collaborate with developers to define standards for automated end-to-end testing, contract testing, integration testing, and performance regression testing across the Nx monorepo.
    • Work with platform engineering to integrate testing into GitHub Actions, AKS, Dapr, Azure Service Bus, APIM, Terraform-managed environments, and ArgoCD deployment workflows.
    • Lead incident and launch readiness reviews where performance, scalability, or reliability risk is material.
    • Mentor developers, architects, and managers on performance design, test automation, failure analysis, and production readiness.
    • Build a small high-leverage team over time, while remaining close enough to the tooling and technical details to set direction credibly.

    Numbers & Facts

    LocationBaltimore, MD
    IndustryInsurance
    Company Size2,000 to 2,499 employees
    Websitehttps://www.bcbs.com/about-us/careers

    About Company

    At the Blue Cross and Blue Shield Association (BCBSA), we provide business strategy, technical support and consulting expertise to 36 Blue Cross and Blue Shield companies across the nation, employing more than 1,000 of the best strategic thinkers in the industry. We are a Brand manager that sets quality control standards for the 36 independent companies that use the Blue Cross and Blue Shield Brands, and we serve as a trade association that represents these Blue companies. It is through our involvement that the Blues companies share a united vision and strategy while also benefiting from the local strength of all member companies.

    Skills

    • Analysis Skillsunmatched
    • Application Programming Interface (API)unmatched
    • Artificial Intelligence (AI)unmatched
    • Automationunmatched
    • Benchmarkingunmatched
    • Cachingunmatched
    • Capacity Managementunmatched
    • Cloud Applicationsunmatched
    • Cloud Architectureunmatched
    • Cloud Computingunmatched
    • Communication Skillsunmatched
    • Concurrencyunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Customer Experienceunmatched
    • Customer Relationsunmatched
    • Debugging Skillsunmatched
    • Distributed Computingunmatched
    • Dockerunmatched
    • Documentationunmatched
    • Environmental Managementunmatched
    • Failure Analysisunmatched
    • GitHubunmatched
    • HIPAA (Health Insurance Portability and Accountability Act)unmatched
    • Healthcareunmatched
    • High School Diplomaunmatched
    • Home Automationunmatched
    • Integration Testingunmatched
    • JavaScriptunmatched
    • Leadershipunmatched
    • Load Testingunmatched
    • Machine Toolunmatched
    • Mentoringunmatched
    • Messaging Middlewareunmatched
    • Microservicesunmatched
    • Microsoft Windows Azureunmatched
    • Multiplatform/Cross-Platformunmatched
    • Node.jsunmatched
    • OAuthunmatched
    • OpenIDunmatched
    • Operational Supportunmatched
    • Performance Analysisunmatched
    • Performance Engineeringunmatched
    • Performance Testingunmatched
    • PostgreSQLunmatched
    • Product Supportunmatched
    • Production Controlunmatched
    • Production Systemsunmatched
    • Quality Managementunmatched
    • React.jsunmatched
    • Regression Testingunmatched
    • Relational Databases (RDBMS)unmatched
    • Reliability Testingunmatched
    • Reporting Dashboardsunmatched
    • Riskunmatched
    • Scalability Testingunmatched
    • Security Infrastructureunmatched
    • Standards Developmentunmatched
    • System Testunmatched
    • Systems Reliabilityunmatched
    • Systems Scalabilityunmatched
    • Team Lead/Managerunmatched
    • Technical Leadershipunmatched
    • Test Automationunmatched
    • Test Dataunmatched
    • Test Designunmatched
    • Test Scenariounmatched
    • Test Strategyunmatched
    • Test Toolsunmatched
    • Testingunmatched
    • Trend Analysisunmatched
    • Validation Testingunmatched
    • Workflow Analysisunmatched
    • Workload Automationunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder