Sign upLog in

Data Engineer

Yantran LLC

Washington, DC

Apply
JOB DETAILS
SKILLS
Agile Modeling, Apache Spark, Artificial Intelligence (AI), Automation, Best Practices, Cloud Computing, Code Reviews, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Cross-Functional, Data Analysis, Data Management, Data Processing, Data Quality, Database Extract Transform and Load (ETL), DevOps, Information/Data Security (InfoSec), Metadata, Microsoft Windows Azure, Performance Tuning/Optimization, Productivity Management, Python Programming/Scripting Language, Regulatory Compliance, SQL (Structured Query Language), Sales Pipeline, Scalable System Development, Software Engineering, Source Code/Configuration Management (SCM), Use Cases
LOCATION
Washington, DC
POSTED
30+ days ago
Data Engineer
Washington DC (Day1 onsite)
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark
Implement complex data transformations using Spark SQL and Python (mandatory)
Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practices
Develop and orchestrate data ingestion and transformation workflows using Azure Data Factory
Ensure data quality, reliability, and performance across batch and near real time pipelines
Integrate Databricks workloads with downstream reporting, analytics, and AI/ML use cases
Collaborate with cross functional teams to understand business requirements and translate them into technical solutions
Implement CI/CD pipelines and source control using Azure DevOps
Apply secure data engineering practices aligned with WBG data governance and compliance standards
Leverage AI assisted tools to improve developer productivity, code quality, and operational efficiency
Participate in design reviews, code reviews, and knowledge sharing sessions
Mandatory Skills
Qualifications
Strong expertise in Spark SQL and Python programming (Mandatory)
Azure Databricks Data Engineer with at least one real time project implementation
Hands on experience with DBT Core and/or DBT Cloud
Experience building and managing pipelines using Azure Data Factory
Proficiency with Azure DevOps (Repos, Pipelines, CI/CD)
Experience using AI tools (e.g., AI assisted development, data analysis, or automation tools)
Solid understanding of data warehousing concepts, ETL/ELT patterns, and distributed data processing
Ability to work in agile delivery models and collaborate with global teams
Primarily looking At
Azure Data Factory (ADF)
Dbt
Databricks
Python
Google Vertex
Preferred / Good to Have Skills
Databricks Certification - Associate or Professional (strongly preferred)
Experience with Azure data ecosystem (ADLS Gen2, Azure SQL, Synapse a as applicable)
Exposure to data governance, metadata management, and security frameworks
Familiarity with performance tuning and cost optimization on Databricks
Experience supporting analytics or AI/ML workloads on cloud platforms
*** is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities.
Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at
*** .

About the Company

Y

Yantran LLC

Resume Resources

Free Resume TemplatesFree Resume Builder