Data Engineer

Position - Data Engineer

Location - Atlanta, GA
Experience - 7+ Years

Type - W2 Contract

Job Description - This role plays a critical role in building and enhancing Databricks platform for client's Data and AI usecases.

Responsibilities: This role will Implement Data and AI usecases on Databricks platformKey Skills: Databricks , Data Engineering , Cloud

• Data Engineering & Architecture: Databricks Lakehouse, Lakehouse Architecture, Medallion Architecture (Bronze/Silver/Gold), Data Modeling, Data Warehousing
• Databricks & Spark: Apache Spark, PySpark, Databricks SQL, Delta Lake, Delta Live Tables (DLT), Unity Catalog, Databricks Notebooks, Databricks Workflows/Jobs
• Data Integration & Processing: ETL/ELT Development, Data Pipelines, Batch Processing, Streaming Processing, Structured Streaming, APIs, JSON
• Performance & Governance: Performance Tuning, Optimization, Delta Optimization, Partitioning, Z-Ordering, Data Quality, Data Validation
• Cloud Platforms (Azure/AWS/GCP): Azure Data Factory, ADLS Gen2, Synapse, Key Vault; AWS S3, Glue, Lambda, IAM, Redshift; GCP Cloud Storage, BigQuery, Dataflow, Pub/Sub Programming & DevOps: SQL, Git.