Data MLOps Engineer

TechDigital
  • Providence, RI
    12 days ago

    Job Description

    Data MLOps Engineer
    • Experience working within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres and understanding how to leverage them for data processing, storage, and analytics tasks.
    • Ability to preprocess and clean large datasets efficiently using Azure Tools /Python and other data manipulation tools. Experience with techniques such as data normalization, feature engineering, and data augmentation is preferred.
    • To have background in Data Science/MLOps and proficiency in DevOps, CI/CD, Azure Cloud computing and Model monitoring.
    • Expertise in working with healthcare data standards (ex. HIPAA and FHIR), sensitive data and data masking techniques to mask personally identifiable information (PII) and protected health information (PHI) is essential.
    • In-depth knowledge of search algorithms, indexing techniques, and retrieval models for effective information retrieval tasks. Familiarity with search platforms like Elasticsearch or Azure AI Search is a must.
    • Familiarity with chunking techniques and working with vectors and vector databases like Pinecone.
    • Ability to design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
    • Experience with implementing best practices for data storage, retrieval, and access control to ensure data integrity, security, and compliance with regulatory requirements.
    • Be able to implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
    • Ability to proactively identify and address issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
    • Experience with large language model frameworks, such as Langchain and know how to integrate them into data pipelines for natural language processing tasks.
    • Experience working within the snowflake ecosystem.
    • Knowledge of cloud computing principles and experience in deploying, scaling, and monitoring AI solutions on cloud platforms like Snowflake, Azure, AWS.
    • Ability to communicate complex technical concepts effectively to technical and non-technical stakeholders and collaborate with cross-functional teams.
    • Analytical mindset with a keen attention to detail, coupled with the ability to solve complex problems efficiently.
    • Knowledge of cloud cost management principles and best practices to optimize cloud resource usage and minimize costs.
    Must Have:
    • Minimum of 10 years' experience as a data engineer
    • Hands-on experience with Azure Cloud eco-system.
    • Hands-on experience using Python for data manipulation.
    • Deep understanding of vectors and vector databases.
    • Hands-on experience scaling POC to production.
    • Hands-on experience using tools such as Document Intelligence, Snowflake, function app. Azure AI Search
    • Experience working with PII/PHI
    • Hands-on experience working with unstructured data.

    Numbers & Facts

    LocationProvidence, RI
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Skills

    • Access Controlunmatched
    • Amazon Web Services (AWS)unmatched
    • Analysis Skillsunmatched
    • Artificial Intelligence (AI)unmatched
    • Best Practicesunmatched
    • Cloud Computingunmatched
    • Communication Skillsunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Cost Controlunmatched
    • Cross-Functionalunmatched
    • Data Managementunmatched
    • Data Processingunmatched
    • Data Qualityunmatched
    • Data Recoveryunmatched
    • Data Scienceunmatched
    • Data Setsunmatched
    • Data Storageunmatched
    • Detail Orientedunmatched
    • DevOpsunmatched
    • Ecosystemsunmatched
    • Elasticsearchunmatched
    • HIPAA (Health Insurance Portability and Accountability Act)unmatched
    • Healthcareunmatched
    • Identify Issuesunmatched
    • Information Modelsunmatched
    • Information Retrievalunmatched
    • Information/Data Security (InfoSec)unmatched
    • Microsoft Windows Azureunmatched
    • Modeling Languagesunmatched
    • Natural Language Processing (NLP)unmatched
    • PostgreSQLunmatched
    • Problem Solving Skillsunmatched
    • Python Programming/Scripting Languageunmatched
    • Regulatory Complianceunmatched
    • Regulatory Requirementsunmatched
    • Scalable System Developmentunmatched
    • Search Algorithmsunmatched
    • Shallow Parsingunmatched
    • Structured Dataunmatched
    • Unstructured Dataunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder