AI Engineer, Medical Vision Language Models

Lumexa Imaging Inc
  • San Francisco, CA
    1 day ago

    Job Description

    Lumexa Imaging is one of the countrys largest providers of outpatient medical imaging. With over 5,000 team members and more than 185 outpatient imaging centers across 13 states, our team conducts more than 4 million outpatient studies annually. We are the partner of choice for health systems and radiologists, delivering best-in-class clinical excellence, operations, and state-of-the-art technology across our platform.

    Lumexa Imaging is hiring an early-career AI Engineer to help build, adapt, and deploy vision language models (VLMs) and imaging foundation models for clinical radiology. You will work hands-on using agentic coding tools (Claude Code, OpenAI Codex) to transition ideas from radiologists into validated, deployed models. This is a build-focused role centered on model development and deployment.

    Initial priorities include building clinical LLM pipelines (prior report summarization, scanned document summarization, and relevant prior selection) on infrastructure shared with our VLM work.

    Why this role is a rare opportunity: You will have access to a large, growing repository of clinical imaging and reporting data. A central part of this job is leveraging this real-world, domain-specific data, consistent with applicable privacy, security, and governance requirements, to develop, adapt, and evaluate AI models beyond what is possible using public data alone.

    You will work closely with the Chief Clinical AI Officer, the Clinical Applications team, and Infrastructure and Information Security.

    Essential Duties and Responsibilities:

    • VLM Development and Adaptation: Fine-tune and adapt open VLMs (e.g., Qwen-VL, LLaVA-Med, MedGemma, InternVL) and imaging foundation models for report drafting, impression generation, finding detection, and prior comparison. Apply parameter-efficient methods (LoRA, QLoRA) and full fine-tuning under senior guidance.
    • Vision Encoders and Representation Learning: Work with vision encoders, contrastive image-text models (CLIP, SigLIP), and self-supervised approaches (JEPA). Build and maintain embedding pipelines for retrieval, cohort discovery, case similarity search, and drift detection
    • Data Curation: Curate and version datasets from our internal PACS and reporting systems, including DICOM header, burned-in pixel, and paired-report de-identification
    • Agentic Engineering: Use Claude Code and OpenAI Codex daily to build, test, and maintain code. Maintain project context (CLAUDE.md, AGENTS.md), and help build and run MCP servers for internal system access
    • Deployment and MLOps: Deploy models via containerized inference and GPU serving (vLLM, Triton), support CI/CD pipelines, and monitor production models for drift and performance
    • Evaluation: Build automated evaluation harnesses for clinical accuracy, negation, laterality, and hallucination scoring against radiologist ground truth
    • Workflow Automation: Build agentic and LLM driven tools for operational workflows, such as converting unstructured requests into RIS scheduling actions and supporting intelligent operations dashboards

    Required Qualifications:

    • Hands-on experience fine-tuning transformer models in PyTorch (vision, multimodal, or language) using Hugging Face, MONAI, or similar (via internships, research, open-source work, or projects)
    • Working knowledge of embeddings and vector search
    • Experience with open VLMs such as Qwen-VL or LLaVA
    • Daily use of agentic coding tools (Claude Code, OpenAI Codex)
    • Familiarity with Docker and GPU-based model serving
    • Comfort working with real-world data and a reproducible approach to experiments

    Preferred Qualifications:

    • Hands-on experience with vision encoders and contrastive models (CLIP, SigLIP, JEPA)
    • Exposure to medical VLMs, imaging foundation models, or self-supervised methods (DINOv2, MAE)
    • Experience building MCP servers in Python or TypeScript
    • Familiarity with medical imaging formats (DICOM, HL7, FHIR) and HIPAA/PHI handling
    • Awareness of MLOps tooling (MLflow, Weights & Biases, model registries)
    • Awareness of FDA considerations for clinical AI (510(k), PCCP)

    Education/Licensing/Certification:

    Degree in Computer Science, Biomedical Engineering, or a related field (or equivalent practical experience)

    Experience (years and type):

    Experience 0 to 3 years (internships, research, or projects count)

    Travel Required (% of time): Minimal, up to 10%

    Physical Requirements & Work Environment: Standard remote office work

    Lumexa Imaging provides a competitive compensation program to attract, retain, and motivate a high-performance workforce.

    Lumexa Imaging is an equal opportunity employer.

    Numbers & Facts

    LocationSan Francisco, CA

    Skills

    • Artificial Intelligence (AI)unmatched
    • Automationunmatched
    • Biomedical Engineeringunmatched
    • Clinical Information Systemsunmatched
    • Compensation and Benefitsunmatched
    • Computer Scienceunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Data Setsunmatched
    • Digital Imaging and Communications in Medicine (DICOM)unmatched
    • Dockerunmatched
    • FDA (Food and Drug Administration)unmatched
    • GPU (Graphics Processing Unit)unmatched
    • HIPAA (Health Insurance Portability and Accountability Act)unmatched
    • HL7 (Health Level 7)unmatched
    • Healthcare Providersunmatched
    • Information/Data Security (InfoSec)unmatched
    • Leading Edge Technologyunmatched
    • Licensingunmatched
    • MCP - Microsoft Certified Professionalunmatched
    • Machine Toolunmatched
    • Medical Codingunmatched
    • Medical Imagingunmatched
    • Model Validationunmatched
    • Modeling Languagesunmatched
    • Multiplatform/Cross-Platformunmatched
    • Open Sourceunmatched
    • Operational Supportunmatched
    • Outpatient Careunmatched
    • Picture Archiving and Communication System (PACS)unmatched
    • Privacy Controlsunmatched
    • Production Controlunmatched
    • Python Programming/Scripting Languageunmatched
    • Radiologyunmatched
    • Radiology Information System (RIS)unmatched
    • Reporting Dashboardsunmatched
    • Testingunmatched
    • Willing to Travelunmatched

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Resume Builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Resume Builder