Python Developer- Cloudera/Hadoop, CI/CD, Databricks

Iconma

Jersey City, NJ

JOB DETAILS
SALARY
$1–$73.68 Per Hour
SKILLS
Agile Programming Methodologies, Apache Hadoop, Apache Hive, Apache Spark, Banking Services, Broadcasting, Caching, Cloudera, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Data Quality, Debugging Skills, DevOps, Documentation, Error Handling, Git, HDFS (Hadoop Distributed File System), Health Plan, Integration Testing, Jenkins, Memory Hardware, Metrics, Microsoft Windows Azure, Performance Tuning/Optimization, Python Programming/Scripting Language, Secure Coding, Software Engineering, Team Player, Technical/Engineering Design, Unit Test
LOCATION
Jersey City, NJ
POSTED
1 day ago
Our Client, a Banking company, is looking for a Python Developer- Cloudera/Hadoop, CI/CD, Databricks for their Jersey City, NJ/Hybrid location.
 
Requirements:
  • Must have strong design fundamentals along with hands-on experience.
  • Required Qualifications
  • The Python Engineer designs and implements data ingestion and transformation jobs using Python and PySpark.
  • They build reusable frameworks for data quality checks and integrate pipelines with CI/CD processes.
  • The role requires performance tuning, secure coding practices, and strong debugging skills. Close collaboration with architects and Data Ops teams ensures robust and compliant solutions.
  • Desired Qualifications
  • Strong Python (packaging, virtual environments), PySpark/Spark performance tuning.
  • Experience with data ingestion (batch/stream), schema management, and error handling/retry logic.
  • Test discipline:
  • Unit/integration tests, data quality assertions, reproducible pipelines.
  • CI/CD (Azure DevOps/Jenkins), Git workflows, artifact versioning, release readiness.
  • Experience on Cloudera/Hadoop (HDFS, Spark, Hive/Impala) and Databricks (clusters, jobs, notebooks, Delta).
  • Observability:
  • Structured logging, metrics, tracing; debuggability in distributed contexts.
  • Secure coding and handling of secrets, PII protection, and compliance considerations.
  • Strong communication and collaborative work style; documentation of frameworks and usage patterns.
  • Performance optimization:
  • Partitioning, caching, broadcast joins, memory tuning.
  • Comfort with Agile ceremonies and iterative delivery.
  • Min 5 yrs of experience
  • Technology Specialist Skillset
  • Yes|Cloudera Impala
  • Python
  • Technical by default
  • Cloudera Impala
  • Spark
 
Why Should You Apply?

About the Company

I

Iconma

ICONMA is a global information consulting management firm providing Professional Staffing Services and Project-Based Solutions for organizations in a broad range of industries.

  • Corporate Headquarters in Troy, Michigan; 20+ locations worldwide.
  • Certified Woman-Owned Business Enterprise (WBE); certified by Women’s Business Enterprise National Council, National Women Business Owners Corporation (NWBOC); and California Public Utilities Commission (CPUC).
  • Founded in 2000
  • 2000+ Employees

The company was founded on the principle that success is derived from delivering high quality service and resources in the most responsive, flexible, and innovative way. ICONMA invests in people and resources with a single goal: To provide our customers with the highest quality service in the most responsive manner. Through its network of offices, ICONMA provides the resources to help clients maintain their competitive advantage.

COMPANY SIZE
2,000 to 2,499 employees
INDUSTRY
Management Consulting Services
EMPLOYEE BENEFITS
401K, Employee Referral Program, Life Insurance
FOUNDED
2000
WEBSITE
https://www.iconma.com/