Azure Databricks Data Engineer

Careers at LTM

Azure Databricks Data Engineer

• Job ID: 883874
• 10 - 12 Years
• 1 Opening
• Raritan - New Jersey - USA

Apply Now

Share with friends

• Share on Facebook
• Share on Linkedin
• Post on X App
• Email your friends

Role description

Azure Databricks Data Engineer

Location Rartian NJ Onsite

Role Overview

We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practices

The ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processes

and working with Delta Lake technologies The candidate must possess excellent Python programming skills

a solid understanding of Unity Catalog and the ability to collaborate effectively within large crossfunctional teams

Key Responsibilities

Design develop and maintain scalable ETLELT pipelines Notebooks using Databricks

Build and optimize data processing solutions using PySpark and Python

Implement and manage data governance security and access controls using Unity Catalog

Work with Delta Lake features including Delta Sharing Time Travel Change Data Feed CDF and data optimization techniques

Develop and maintain CICD pipelines for Databricks deployments using industrystandard DevOps practices

Perform performance tuning and optimization of Databricks workloads

Collaborate with architects business analysts and stakeholders to understand data requirements and deliver solutions

Support production deployments troubleshooting monitoring and performance improvements

Follow coding standards documentation and best practices for software development lifecycle SDLC

Required Skills

Databricks Strong

Strong understanding of Databricks architecture and ecosystem

Handson experience with

Delta Lake

Delta Sharing

Unity Catalog

Structured Streaming

Workflow orchestration

Performance tuning and optimization

Data governance and access management

Experience with Medallion Architecture Bronze Silver Gold layers

Programming

Strong handson coding experience in Python

Experience with PySpark for largescale data processing

Good understanding of SQL and query optimization

DevOps CICD

Experience implementing CICD processes for Databricks workloads

Familiarity with Gitbased source control and branching strategies

Experience with deployment automation tools and DevOps pipelines

Data Engineering Concepts

ETLELT design patterns

Data modeling and data warehousing concepts

Data quality monitoring and observability frameworks

Good to Have Skills

AWS Cloud

AWS Glue

S3

IAM

Lambda

Azure Cloud

Azure Data Factory ADF

Azure Storage

Azure Databricks

Key Vault

Soft Skills

Excellent verbal and written communication skills

Strong problemsolving and analytical abilities

Ability to work effectively in a large global team environment

Strong stakeholder management and collaboration skills

Selfdriven proactive and able to work independently with minimal supervision"

Skills

Mandatory Skills : Databricks

Other details

Actual compensation within the range will be dependent upon the individual''s skills, experience, performance and internal equity.

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree ("LTIM"):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.

Benefits

Compensation range: $ 100,000.00 to 135,000.00 per year

View all 1039 role(s)

Apply Now

Share with friends

Toggle Dropdown

• Share on Facebook
• Share on Linkedin
• Share on WhatsApp
• Post on X App
• Email your friends

View more

About LTM

LTM is an AI-centric global technology services company and the Business Creativity partner to the world's largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI - enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM - a Larsen & Toubro company - owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltimindtree.com/recruitment-fraud-alert/

View more

Wish to submit your profile for future opportunities?

Click here