Data Engineer - Data Platforms

Job Title: Data Engineer - Data Platforms
Location: Piscataway, NJ
Duration: 12 Months
Interview: Virtual
Pay Rate: $68 on C2C (All inclusive)

2MCR - 5825048
Required Skills:
" Apache Spark & Scala Strong hands-on experience developing distributed data-processing applications.
" Hadoop / Hive / Impala Strong experience working with enterprise Big Data platforms and large datasets.
" SQL Advanced SQL skills including complex queries, joins, transformations, reconciliation, and performance tuning.
" Python Strong scripting and data-processing experience for automation, utilities, and data engineering activities.
Preferred Skills:
" Experience working within banking or financial services environments.
" Understanding of large-volume transactional and financial datasets.
" Knowledge of ETL/data pipelines, data quality, and data reconciliation.
" Experience with Agile development and CI/CD practices.
*BGC*

A Data Engineer with expertise in Data Platforms specializes in developing applications on Big Data technologies, such as API development. This role requires a strong foundation in traditional Application Development, along with knowledge of Analytics libraries, open-source Natural Language Processing, and statistical and big data computing libraries. The ideal candidate will possess exceptional technical abilities to understand, design, write, and debug complex code.