Sign upLog in

Data Engineer, DevOps

Allness

South San Francisco, California

Apply
JOB DETAILS
SKILLS
Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Apache Hadoop, Apache Spark, Application Servers, Architectural Services, Bioengineering, Biotech and Pharmaceutical, Cloud Computing, Communication Skills, Computer Systems, Configuration Management, Cross-Functional, Data Processing, Data Science, Data Sets, Data Warehousing Applications, Database Administration, Database Programming, Database Programming Languages, Dental Insurance, DevOps, Diversity, GCP (Good Clinical Practices), Git, High Throughput, Linux Operating System, Load Balancing, Machine Learning, Mercurial, Microsoft Windows Azure, NoSQL, On Call, Performance Management, Python Programming/Scripting Language, Resource Management, SQL (Structured Query Language), Source Code/Configuration Management (SCM), Team Player, Unix Shell Programming, Vision Plan
LOCATION
South San Francisco, California
POSTED
10 days ago
Job ID : AINC17464
<\/div>

<\/div>
We have partnered with a large biotechnology company in the South San Francisco, CA area to provide them with a Data Engineer, DevOps.<\/span><\/span><\/span>
<\/span><\/span><\/div>

<\/span><\/span><\/div>
The Data Engineering DevOps team ensures the infrastructure which powers our biological data factory’s robots, instruments, and machine learning platform is reliable, scalable, and manageable.  You will work closely with a cross -functional team of scientists, bioengineers, and data scientists to identify areas where data engineering can make a difference, by developing data architectures and systems on cutting edge, high throughput platforms that enable our scientists to be maximally productive. You will design, implement, and deploy cloud infrastructure, including managed databases, application servers, data warehouses, and interactive/batch computing environments, and work as part of a team to rigorously design our data platform, identify key architectural performance improvements, and join an on -call rotation to ensure that our platform runs at maximum productivity.<\/span><\/span><\/span>
<\/span><\/span><\/div>

<\/span><\/span><\/div>

<\/span><\/span><\/div>
  • 2 -3 years of experience with provisioning AWS cloud services (Experience with GCP and Azure is also relevant).<\/span>
    <\/span><\/span><\/li>
  • Experience with cloud configuration and resource management tools such as Terraform<\/span>
    <\/span><\/span><\/li>
  • Experience architecting reliable infrastructure platforms including monitoring and alerting, load balancing, scalable services, multi -region<\/span>
    <\/span><\/span><\/li>
  • Experience with at least one high -end distributed data processing environment (Hadoop, Spark, etc)<\/span>
    <\/span><\/span><\/li>
  • Experience with batch computing systems such as AWS Batch, SLURM<\/span>
    <\/span><\/span><\/li>
  • Experience with container build and deployment systems like Docker, Kubernetes, or ECS<\/span>
    <\/span><\/span><\/li>
  • Ability to communicate effectively and collaborate with people of diverse backgrounds and job functions<\/span>
    <\/span><\/span><\/li>
  • Proficiency in Linux environment (including shell scripting and Python programming), experience with database languages (e.g., SQL, No -SQL) and experience with version control practices and tools (Git, Mercurial, etc.)<\/span>
    <\/span><\/span><\/li>
  • Passion for making a difference in the world<\/span>
    <\/span><\/span><\/li><\/ul>

    <\/div><\/span>

    Requirements<\/h3>
    • Experience with biological data <\/span>
      <\/span><\/span><\/li>
    • Experience with managing​ medium -sized data sets (100TB+) in object storage systems like S3<\/span>
      <\/span><\/span><\/li>
    • Experience with defining infrastructure following compliance (GDPR, HIPAA, etc).<\/span>
      <\/span><\/span><\/li>
    • Experience with data processing pipelines<\/span>
      <\/span><\/span><\/li>
    • Experience with deploying and monitoring machine learning models in a production environment<\/span>
      <\/span><\/span><\/li><\/ul>

      <\/div><\/span>

      Benefits<\/h3>
      • Medical Insurance<\/span>
        <\/span><\/span><\/li>
      • Dental Insurance<\/span>
        <\/span><\/span><\/li>
      • Vision Insurance<\/span>
        <\/span><\/span><\/li><\/ul>

        <\/div><\/span>

About the Company

A

Allness

Resume Resources

Free Resume TemplatesFree Resume Builder