We are seeking skilled and detail-oriented Data Engineers with expertise in utilizing Python, SQL, and Palantir (or other ETL platforms) to extract, transform, and load structured and unstructured data from various sources. The ideal candidate will have a strong background in data engineering and a deep understanding of ETL processes.
CLEARANCE REQUIRED: TS/SCI Full Scope Polygraph
Responsibilities
Write robust and efficient Python and SQL scripts to automate data processing tasks
Integrate data from diverse sources, such as databases, APIs, and flat files, into centralized systems
Implement data transformations, enrichment, and modeling workflows to ensure data quality and usability
Ensure data structures are optimized for performance and scalability
Provide technical guidance and support to ensure effective use of Palantir tools across teams
Implement data quality checks, validation, and monitoring mechanisms to ensure the accuracy and reliability of datasets
Integrate data from diverse sources, such as databases, APIs, and flat files, into centralized systems
Ensure proper data transformation and curation to meet business and analytics requirements
Maintain and improve data quality, consistency, and accuracy through validation and cleansing processes
Requirements
TS/SCI FSP Clearance
3+ years of experience in data engineering
Strong proficiency in scripting and programming with Python
Expertise in working with SQL for data querying, transformation, and optimization
Experience with data integration from diverse sources such as APIs, relational databases, and file systems
Strong analytical and problem-solving skills with attention to detail
Excellent communication and teamwork skills to collaborate with technical and business teams
Desired Skills
Bachelor’s degree in Computer Science, Data Engineering, or a related field
Hands-on experience with Palantir
Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Apache Spark, Hadoop)
Familiarity with data orchestration tools such as Apache Airflow, Prefect, or similar
About Us
For more than 20 years, NewGen Technologies has solved our clients’ toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
Numbers & Facts
Location
Chantilly, Virginia
Industry
Computer/IT Services
Company Size
100 to 499 employees
Year Founded
1997
Website
http://www.newgentechnologies.com/
About Company
NewGen Technologies specializes in developing and implementing solutions to your IT challenges-especially those involving specialized technologies.
Founded in 1997, NewGen grew quickly and became immediately successful because of our primary commitment to satisfying our customers.
Our formula for success is simple-we deliver high quality products and services. We develop and maintain a staff of highly trained, experienced consultants who devise and execute creative, effective solutions to our clients' IT challenges.
Despite NewGen's rapid growth, we keep our organization agile so we can respond quickly as our customers' needs develop. And we keep our overhead in check so we can offer top-tier talent for reasonable rates.
NewGen Technologies, Inc. is a privately held, minority woman-owned small business incorporated in the state of Maryland.
Skills
Amazon Web Services (AWS)unmatched
Analysis Skillsunmatched
Apacheunmatched
Apache Hadoopunmatched
Apache Sparkunmatched
Application Programming Interface (API)unmatched
Artificial Intelligence (AI)unmatched
Big Dataunmatched
Biometricsunmatched
Business Processesunmatched
Cloud Computingunmatched
Communication Skillsunmatched
Computer Scienceunmatched
Data Processingunmatched
Data Qualityunmatched
Data Setsunmatched
Data Structuresunmatched
Database Extract Transform and Load (ETL)unmatched
Detail Orientedunmatched
File Systemsunmatched
Full Scope Polygraphunmatched
GCP (Good Clinical Practices)unmatched
Microsoft Windows Azureunmatched
Performance Tuning/Optimizationunmatched
Problem Solving Skillsunmatched
Python Programming/Scripting Languageunmatched
Quality Managementunmatched
Relational Databases (RDBMS)unmatched
Requirements Managementunmatched
SQL (Structured Query Language)unmatched
Scripting (Scripting Languages)unmatched
Sensitive Compartmented Information (SCI)unmatched
Software Engineeringunmatched
Structured Dataunmatched
Team Playerunmatched
Technical Deliveryunmatched
Technical Leadershipunmatched
Technical Supportunmatched
Top Secret Clearanceunmatched
Unstructured Dataunmatched
Usability Engineeringunmatched
Validation Testingunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.