Big Data Engineer

Tech3pillars Technologies

NULL, VA

JOB DETAILS
SKILLS
Analysis Skills, Apache Kafka, Apache Spark, Big Data, Consulting, Cross-Functional, Data Analysis, Data Management, Data Modeling, Data Processing, Data Warehousing, Database Extract Transform and Load (ETL), Debugging Skills, Distributed Computing, Identify Issues, Large-Scale Systems, Performance Modeling, Performance Tuning/Optimization, Problem Solving Skills, Query Optimization, SQL (Structured Query Language), Scalable System Development, Stored Procedures
LOCATION
NULL, VA
POSTED
1 day ago
Job Title: Consultant Big Data Engineer

Location: Phoenix, AZ 85054
Contract Duration: Long Term
Experience Required: 5 8 Years

Job Overview

We are seeking an experienced Big Data Engineer with strong expertise in Big Data technologies, Spark, and Kafka. The ideal candidate will be responsible for designing scalable ETL pipelines, optimizing data models, and developing high-performance data processing solutions for enterprise data platforms.

Must Have Skills
  • Big Data
  • Apache Spark
  • Apache Kafka
Nice to Have
  • Grafana
Key Responsibilities
  • Design and implement robust, automated ETL processes to move data from source systems to target data warehouses
  • Develop and optimize complex SQL queries and stored procedures
  • Perform data modeling and performance tuning for large-scale data environments
  • Build scalable Spark-based data processing pipelines
  • Work with Kafka for real-time data streaming and distributed processing
  • Collaborate with cross-functional teams to support data integration and analytics initiatives
  • Monitor and troubleshoot data processing and performance issues
Required Experience
  • 5 8 years of experience in Big Data and Data Engineering
  • Strong hands-on expertise with:
    • Spark
    • Kafka
    • SQL
    • ETL Development
  • Experience with data warehousing and large-scale distributed systems
  • Strong analytical, debugging, and problem-solving skills
Top 3 Responsibilities
  1. Design and implement scalable ETL and data processing solutions
  2. Write complex SQL queries, stored procedures, and optimize data models
  3. Build and maintain Spark and Kafka-based data pipelines

About the Company

T

Tech3pillars Technologies