NewGen Technologies logo

Data & Software Engineer

NewGen Technologies

  • Chantilly, Virginia
  • 30+ days ago
    Want to know if you’re a fit?
    Upload your resume and let our AI show you.

    Skills

    • AWS Lambdaunmatched
    • Amazon Simple Storage Service (S3)unmatched
    • Amazon Web Services (AWS)unmatched
    • Analysis Skillsunmatched
    • Apacheunmatched
    • Apache Sparkunmatched
    • Artificial Intelligence (AI)unmatched
    • Bash Scriptingunmatched
    • Best Practicesunmatched
    • Biometricsunmatched
    • Business Processesunmatched
    • Cisco Unityunmatched
    • Cloud Applicationsunmatched
    • Computer Programmingunmatched
    • Data Analysisunmatched
    • Data Formatsunmatched
    • Data Managementunmatched
    • Data Migrationunmatched
    • Data Processingunmatched
    • Data Qualityunmatched
    • Database Designunmatched
    • Database Extract Transform and Load (ETL)unmatched
    • Debugging Skillsunmatched
    • Design Patterns Programming Methodologiesunmatched
    • Dockerunmatched
    • Documentationunmatched
    • Feasibility Analysisunmatched
    • Gitunmatched
    • Industry Standardsunmatched
    • Information/Data Security (InfoSec)unmatched
    • Javaunmatched
    • MySQLunmatched
    • NoSQLunmatched
    • Operational Support Systems (OSS)unmatched
    • Performance Tuning/Optimizationunmatched
    • PostgreSQLunmatched
    • Privacy Controlsunmatched
    • Problem Solving Skillsunmatched
    • Python Programming/Scripting Languageunmatched
    • Query Optimizationunmatched
    • Requirements Managementunmatched
    • SQL (Structured Query Language)unmatched
    • Scripting (Scripting Languages)unmatched
    • Sensitive Compartmented Information (SCI)unmatched
    • Software Engineeringunmatched
    • Team Playerunmatched
    • Technical Deliveryunmatched
    • Top Secret Clearanceunmatched

    Description

    The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. 

    Responsibilities
    • Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
    • Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
    • Leverage a background in large-scale data migration or platform modernization efforts
    • Contribute to data engineering documentation, best practices, and design patterns
    Requirements
    • TS/SCI FSP Clearance
    • Minimum of 5 years' experience with: 
      • Apache Spark & PySpark
      • Advanced Python skills (including Pandas & NumPy)
      • Docker, Podman
      • AWS S3, Lambda & Step functions
      • Apache Iceberg, Airflow, etc.
      • SQL (with Trino)
      • NoSQL, DynamoDB
      • Unity Catalog OSS, Apache Polaris
      • Apache Superset
      • Terraform or CloudFormation
      • OpenLineage
      • H3, PostGIS
    • Candidate must have experience in:
      • Building end-to-end data pipelines leveraging Python
      • Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
      • Containerizing and deploying applications in cloud environments like AWS
      • Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads
      • Leveraging industry standard tools for code control (Git, IaaC control, etc.)
      • Working with data catalogs, tracking data lineage  and handling a variety of data formats, including Geospatial
      • Using Bash scripting for automation and data processing tasks
      • Integrating Al/ML services and models

    About Us
    For more than 20 years, NewGen Technologies has solved our clients’ toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ

    Numbers & Facts

    LocationChantilly, Virginia
    IndustryComputer/IT Services
    Company Size100 to 499 employees
    Year Founded1997
    Websitehttp://www.newgentechnologies.com/

    About Company

    NewGen Technologies specializes in developing and implementing solutions to your IT challenges-especially those involving specialized technologies.

    Founded in 1997, NewGen grew quickly and became immediately successful because of our primary commitment to satisfying our customers.

    Our formula for success is simple-we deliver high quality products and services. We develop and maintain a staff of highly trained, experienced consultants who devise and execute creative, effective solutions to our clients' IT challenges.

    Despite NewGen's rapid growth, we keep our organization agile so we can respond quickly as our customers' needs develop. And we keep our overhead in check so we can offer top-tier talent for reasonable rates.

    NewGen Technologies, Inc. is a privately held, minority woman-owned small business incorporated in the state of Maryland.

    Similar Jobs

    See more jobs