Big Data Hadoop Architect Hybrid

We are hiring a Big Data Hadoop Architect to lead the design and modernization of enterprise-scale data platforms. This role requires a hands-on architect who can balance strategy with execution, drive cloud transformation, and build highly scalable, cost-efficient data ecosystems.Key Responsibilities (Expanded & Realistic)Define enterprise data architecture roadmap aligned with business goalsArchitect and implement large-scale Hadoop/Spark-based data platformsLead migration from on-prem Hadoop clusters to cloud-native architecturesDesign real-time and batch data pipelines using Kafka, Spark Streaming, Flink, etc.Establish data lake / lakehouse architecture (Delta Lake, Iceberg, Hudi)Drive data modeling standards (dimensional, data vault, normalized models)Build frameworks for data ingestion (ETL/ELT) from structured & unstructured sourcesOptimize cluster performance, cost, and resource utilizationDefine and enforce data governance, lineage, cataloging, and quality frameworksImplement security best practices (encryption, IAM, data masking, compliance – HIPAA/GDPR where applicable)Lead capacity planning and scalability strategies for petabyte-scale dataEvaluate and introduce modern tools (Databricks, Snowflake, etc.) beyond Hadoop ecosystemWork closely with DevOps teams to implement CI/CD pipelines for data workflowsProvide technical leadership, code reviews, and mentoring to engineering teamsCollaborate with business stakeholders to translate requirements into technical solutionsDrive incident resolution and root cause analysis for production data issuesEnsure high availability and disaster recovery strategies are in placeInfluence tooling, vendor selection, and long-term data platform investments

Required Skills & Experience

• 10–15+ years of IT experience with minimum 5+ years in Big Data Architecture
• Strong expertise in:
• Hadoop Ecosystem (HDFS, YARN, Hive, HBase)
• Apache Spark (Core, SQL, Streaming)
• Kafka / Pulsar / Flink
• Hands-on experience with cloud platforms:
• AWS (EMR, S3, Glue, Redshift) OR
• Azure (Data Lake, Synapse, HDInsight) OR
• GCP (Dataproc, BigQuery)
• Strong programming skills in Java / Scala / Python
• Deep understanding of distributed systems, parallel processing, and data partitioning
• Experience with containerization (Docker, Kubernetes)
• Expertise in data warehousing and ETL frameworks

  Preferred Qualifications

• Experience with Databricks, Snowflake, or modern lakehouse platforms
• Exposure to AI/ML pipelines and feature engineering systems
• Cloud certifications (AWS/Azure/GCP Architect level)
• Strong leadership and stakeholder management experience

  Total Rewards & Benefits (Realistic US Package)

• Comprehensive Medical, Dental & Vision Insurance
• 401(k) with employer match (up to 5–6%)
• Paid Time Off (20–25 days) + Paid Holidays
• Parental Leave (12–16 weeks)
• Learning Budget ($2,500/year for certifications & courses)
• Home Office Setup Allowance ($1,000 one-time)
• Wellness Programs (Gym reimbursement, mental health support)