Sign upLog in

Big Data Engineer II

Primary Talent Partners

Arlington, VA

Apply
JOB DETAILS
SALARY
$71–$81 Per Hour
SKILLS
Apache Hadoop, Apache Hive, Apache Spark, Best Practices, Big Data, Code Reviews, Communication Skills, Customer/Client Research, Data Analysis, Data Management, Data Modeling, Data Processing, Data Quality, Data Sets, Data Warehousing, Database Design, Database Extract Transform and Load (ETL), Database Technology, Ecosystems, Finance, HDFS (Hadoop Distributed File System), Identify Issues, Mathematics, Presentation/Verbal Skills, Process Development, Process Quality, Python Programming/Scripting Language, Quality Management, Query Optimization, Regulations, Reporting Dashboards, SQL (Structured Query Language), SQL Databases, Scalable System Development, Source Code/Configuration Management (SCM), Time Management, Writing Skills
LOCATION
Arlington, VA
POSTED
3 days ago
Primary Talent Partners has a new contract opening for a Big Data Engineer II with our global technology client in Arlington, VA. This is a 2-month contract with a potential for extension.


Pay:$71.00 - $81.00/hr; W2 contract, no PTO, no Benefits. ACA-compliant supplemental package available for enrollment. Candidates must be legally authorized to work in the United States and must be able to sit on Primary Talent Partners W2 without sponsorship.


Schedule: 9 AM to 5 PM ET | Hybrid role


Description:
This person will be supporting the Analytics Solutions team - whose responsibility is to assist stakeholders in extracting data from the Client Data Warehouse, transforming it and then building dashboards on top that can be exported back to the client.
  •  Support the design, implementation, and maintenance of enterprise ETL processes for data platforms, for a global client base.
  • Develop scalable and efficient code to process data, ensuring availability and accessibility in a timely manner.
  • Leverage big data processing frameworks such as Apache Spark and Hadoop to build and optimize data pipelines.
  • Collaborate with senior engineers to address data challenges, contributing to solutions that maintain high data quality.
  • Assist in the data delivery process, working alongside Data Engineers and Analysts to support accurate, high-value data solutions across various clients and industries.
  • Build strong working relationships with team members and clients, contributing to both local and global projects.
  • Learn and apply industry best practices, including version control, code reviews, and data validation, to ensure quality in data processes.
  • Use SQL and other database technologies to help optimize data processing and reduce the time required to handle large data sets.
  • Design, implement, and maintain data pipelines using ETL frameworks, orchestration tools, and distributed data processing engines.
  • Participate in efforts to automate routine data tasks and streamline processes.
  • Comply with all Client internal policies and adhere to external regulations.


Top 3 required skills:
  • Spark, Hadoop, Python


All About You:
  • Experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts and methodologies.
  • Strong knowledge of writing and optimizing SQL queries to retrieve, manipulate, and analyze data efficiently.
  • Hands-on experience with big data technologies such as:
  • Apache Spark (PySpark, Spark SQL, Spark Streaming)
  • Hadoop ecosystem (HDFS/ Ozone, Hive, YARN)
  • Familiarity with ETL frameworks and the ability to design, implement, and maintain data pipelines.
  • Understanding data modeling concepts and database design to support scalable data solutions.
  • Familiarity with Python.
  • Ability to analyze and troubleshoot data issues and provide solutions with minimal supervision.
  • Basic knowledge of testing and validating data to ensure accuracy and consistency in data pipelines.
  • Excellent verbal and written communication skills, with the ability to articulate complex ideas clearly and concisely to both technical and non-technical stakeholders.
  • Bachelor's degree in quantitative discipline such as Engineering, Mathematics, Finance, Business, or a related field. Equivalent practical experience may also be considered.



Primary Talent Partners is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.

If you are a person with a disability needing assistance with the application or at any point in the hiring process, please contact us at info@primarytalentpartners.com

#PTPJobs

#LI-PTP

About the Company

P

Primary Talent Partners

Resume Resources

Free Resume TemplatesFree Resume Builder