Sr. Azure Data Engineer

Experience: - 10+ Years

Location: - Chicago, IL (Hybrid 3 days' Work from Office)

Duration: - Long Term

Educational Qualifications: -

Engineering Degree BE/ME/BTech/MTech/BSc/MSc.

Technical certification in multiple technologies is desirable.

Skills: -

Mandatory skills

10+ years of Data Engineering experience with strong focus on modern cloud data platforms. Hands-on experience with Databricks, PySpark, SQL, and Python.

Strong understanding of ETL/ELT design patterns, data integration, and data warehousing concepts. Experience with relational databases, data modeling, partitioning, indexing, and query optimization.

Expertise in building and maintaining large-scale data pipelines and batch processing solutions. Experience working with cloud platforms such as Azure, AWS, or GCP.

Strong problem-solving, debugging, and analytical skills. Proven experience architecting and delivering systems using agentic IDEs

Ability to: Define architectural intent that agents can follow

Break features into agent executable tasks

Govern AI autonomy (guardrails, permissions, reviews)

Integrate agentic workflows into CI/CD pipelines

Experience supervising AI agents across: Multi service systems

Legacy modernization

Large codebases / monorepos

Strong understanding of: Security implications of autonomous code execution

Compliance, auditability, and traceability

AI assisted SDLC operating models

Core Responsibility:

Guide effective use of agentic IDEs for complex, multi-module or cross-service changes

Establish review practices and quality checks for AI-generated code

Mentor team members on balancing autonomy, correctness, and maintainability in AI-assisted development

Design system architectures that support AI-augmented and agentic development workflows

Define guardrails, standards, and governance for the use of autonomous coding agents

Evaluate impact of agentic IDEs on SDLC, CI/CD pipelines, security posture, and technical debt.