Want to know if you’re a fit? Upload your resume and let our AI show you.
Skills
Apache Hadoopunmatched
Apache Hiveunmatched
Communication Skillsunmatched
Data Processingunmatched
Database Extract Transform and Load (ETL)unmatched
Ecosystemsunmatched
HDFS (Hadoop Distributed File System)unmatched
Javaunmatched
Performance Tuning/Optimizationunmatched
Presentation/Verbal Skillsunmatched
Production Supportunmatched
Programming Languagesunmatched
Python Programming/Scripting Languageunmatched
Regulationsunmatched
SQL (Structured Query Language)unmatched
Scala Programming Languageunmatched
Writing Skillsunmatched
Description
Job Title - Senior Developer Hadoop (H1B, OPT and EAD also Applicable) Experience - 8+ years Location - Jersey City, NJ / Pennington, NJ Hire Type - Fulltime
Must Have Technical/Functional Skills
Primary Skill: Data Engineering, Platform Engineering or architecture roles. Deep Expertise in Pyspark.
Experience: 10+ yrs
Roles & Responsibilities
Deep Expertise in PySpark, including performance tuning and optimization
Strong python development experience in large-scale distributed environment
Solid knowledge of Hadoop ecosystem (HDFS,Hive/Impala, YARN)
Proven experience designing and governing enterprise, regulatory facing data platforms.
Expertise in designing data lakes, ELT/ETL pipelines, batch and real time data processing solution
Proficiency in programming languages such as Java, Scala and SQL
Strong understanding of non-functional requirements and production support models
Clear written and verbal communication skills with ability to influence across organizations
Preferred Skills / Experience
Financial services experience, particularly in Market Surveillance, AML, Fraud, Or Risk Technology
Experience supporting regulatory or audit facing platforms
Kafka and Spark Structured streaming exposure
Familiarity with Orchestration tools(Airflow,Control-M,Oozie)
Knowledge of data governance, lineage, and data quality controls