Data Engineer

Creative Global Consulting, LLC

(remote)

JOB DETAILS
SALARY
$40–$45 Per Hour
JOB TYPE
Full-time, Employee
SKILLS
AWS Lambda, Agile Programming Methodologies, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Ansible, Application Programming Interface (API), Artificial Intelligence (AI), Automation, Best Practices, Cloud Computing, Cloud Storage, Communication Skills, Computer Science, Data Formats, Data Management, Data Modeling, Data Processing, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Documentation, Electronic Medical Records, Home Automation, Information Technology & Information Systems, Leadership, NoSQL, Oracle, Performance Tuning/Optimization, PostgreSQL, Problem Solving Skills, Proofreading, Python Programming/Scripting Language, Quality Assurance, Query Optimization, Relational Databases (RDBMS), Retail Management, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages), Systems Administration/Management, Team Player, United States Citizen, Unix Shell Programming, Validation Testing
POSTED
24 days ago
Title: Data Engineer
Location: Remote (Fairfax, VA)
Duration: 12 Months Contract
Visa: US Citizen
 
Position Summary:
The Data Engineer will be pivotal in designing, developing, and maintaining robust ETL (Extract, Transform, Load) processes to ensure seamless data flow between our diverse data sources and target data stores. You will be responsible for building and optimizing automated pipelines, ensuring data quality, and accommodating future data format changes. This position requires a strong technical foundation and a proactive approach to problem-solving.
 
Primary Responsibilities:
  • Pipeline Design & Development: Design, develop, and implement scalable and efficient ETL pipelines using modern data integration tools and technologies.
  • Data Transformation: Transform and cleanse data from various sources (databases, APIs, cloud storage, etc.) to ensure accuracy, consistency, and compliance with data governance policies.
  • Data Store Management: Develop and maintain optimized data models and data warehousing solutions utilizing platforms like Oracle, PostgreSQL, Redshift, and EMR.  Focus on performance tuning and query optimization.
  • Automation & Monitoring: Build and maintain automated ETL jobs, incorporating robust monitoring and alerting mechanisms for proactive issue detection and resolution.
  • Data Quality Assurance: Implement data quality checks and validation rules throughout the ETL process to guarantee data integrity.
  • Documentation: Create and maintain comprehensive documentation for ETL processes, data models, and system configurations.
  • Collaboration: Work closely with business stakeholders and other teams to understand data requirements and deliver effective solutions.
  • Future-Proofing: Proactively assess and implement changes to data integration processes to accommodate evolving data formats, sources, and business needs. Ensuring designs accommodate potential future data changes.
  • All other duties as assigned by leadership.
 Skills and Qualifications:
  • ETL development with Glue ETL, Python, Pyspark, RDS.
  • Solid understanding of data governance principles and data quality best practices.
  • Ability to work independently and as part of a collaborative team in an Agile environment.
  • Excellent problem-solving, analytical, and communication skills.
 Required Education and Experience:
  • Bachelor’s degree in Computer Science, Information Systems, or a related field.
  • 10+ years of experience in data integration, ETL development, and data warehousing.
  • Strong proficiency in SQL and experience with relational databases (e.g. Oracle, PostgreSQL) and NoSQL databases.
  • Experienced with scripting languages such as Python or Shell scripting for automation and data manipulation.
  • Experienced with cloud technologies, including AWS Glue, Lambda, CloudFormation/Ansible, S3, Redshift, and EMR.
  • Experienced with Git, GitHub, CI/CD pipelines for DevOps and data engineering.
 Required Certifications:
  • AWS certification (Minimum - Cloud Practitioner, AI Practitioner)
Clearance Requirement:
  • Must be a U.S. Citizen (No dual citizenship will be accepted)
  • Ability to obtain a favorable Public Trust investigation
 Work Location:
  • Fairfax, VA/Remote

About the Company

C

Creative Global Consulting, LLC

INDUSTRY
Staffing/Employment Agencies