Big Data Hadoop Architect Hybrid

We are hiring a Big Data Hadoop Architect to lead the design and modernization of enterprise-scale data platforms. This role requires a hands-on architect who can balance strategy with execution, drive cloud transformation, and build highly scalable, cost-efficient data ecosystems.

Key Responsibilities (Expanded & Realistic)
Define enterprise data architecture roadmap aligned with business goals
Architect and implement large-scale Hadoop/Spark-based data platforms
Lead migration from on-prem Hadoop clusters to cloud-native architectures
Design real-time and batch data pipelines using Kafka, Spark Streaming, Flink, etc.
Establish data lake / lakehouse architecture (Delta Lake, Iceberg, Hudi)
Drive data modeling standards (dimensional, data vault, normalized models)
Build frameworks for data ingestion (ETL/ELT) from structured & unstructured sources
Optimize cluster performance, cost, and resource utilization
Define and enforce data governance, lineage, cataloging, and quality frameworks
Implement security best practices (encryption, IAM, data masking, compliance – HIPAA/GDPR where applicable)
Lead capacity planning and scalability strategies for petabyte-scale data
Evaluate and introduce modern tools (Databricks, Snowflake, etc.) beyond Hadoop ecosystem
Work closely with DevOps teams to implement CI/CD pipelines for data workflows
Provide technical leadership, code reviews, and mentoring to engineering teams
Collaborate with business stakeholders to translate requirements into technical solutions
Drive incident resolution and root cause analysis for production data issues
Ensure high availability and disaster recovery strategies are in place
Influence tooling, vendor selection, and long-term data platform investments

Required Skills & Experience

10–15+ years of IT experience with minimum 5+ years in Big Data Architecture
Strong expertise in:
Hadoop Ecosystem (HDFS, YARN, Hive, HBase)
Apache Spark (Core, SQL, Streaming)
Kafka / Pulsar / Flink
Hands-on experience with cloud platforms:
AWS (EMR, S3, Glue, Redshift) OR
Azure (Data Lake, Synapse, HDInsight) OR
GCP (Dataproc, BigQuery)
Strong programming skills in Java / Scala / Python
Deep understanding of distributed systems, parallel processing, and data partitioning
Experience with containerization (Docker, Kubernetes)
Expertise in data warehousing and ETL frameworks

Preferred Qualifications
Experience with Databricks, Snowflake, or modern lakehouse platforms
Exposure to AI/ML pipelines and feature engineering systems
Cloud certifications (AWS/Azure/GCP Architect level)
Strong leadership and stakeholder management experience

Total Rewards & Benefits (Realistic US Package)
Comprehensive Medical, Dental & Vision Insurance
401(k) with employer match (up to 5–6%)
Paid Time Off (20–25 days) + Paid Holidays
Parental Leave (12–16 weeks)
Learning Budget ($2,500/year for certifications & courses)
Home Office Setup Allowance ($1,000 one-time)
Wellness Programs (Gym reimbursement, mental health support)