Lead Databricks Integration Architect

Expert Technology Services

Washington, DC

Apply

JOB DETAILS

SKILLS

Agile Programming Methodologies, Application Integration, Application Programming Interface (API), Architectural Services, Business Intelligence Software, Cloud Computing, Code Reviews, Communication Skills, Consensus Building Skills, Data Management, Data Quality, Design Document, Ecosystems, Engineering, Enterprise Applications, Leadership, Maintain Compliance, Mentoring, Microservices, Performance Tuning/Optimization, Software Design, Software Engineering

LOCATION

Washington, DC

POSTED

2 days ago

Job Summary (List Format):

- Serve as a hands-on Lead Solutions Architect specializing in Databricks and Application Integration.
- Design, document, and actively build end-to-end integration solutions linking Databricks with enterprise applications, microservices, BI tools, and external APIs.
- Develop and maintain reusable platform libraries and abstraction layers to accelerate development.
- Architect and enforce data quality frameworks, including automated DLT Expectations and data lineage tracking.
- Lead architectural review boards, oversee code/design reviews, and provide direct technical mentorship to data engineers.
- Optimize real-time streaming data pipelines and implement performance tuning strategies to balance throughput with cloud costs.
- Design and govern enterprise-grade CI/CD and Infrastructure as Code (IaC) deployment strategies for Databricks environments.
- Collaborate with platform, cloud infrastructure, and engineering teams to ensure seamless integration and technical alignment.
- Operate within a SAFe (Scaled Agile) framework, participating in agile ceremonies and on-site PI planning in Washington, D.C.
- Leverage 8+ years of IT solution architecture, application design, or senior data engineering experience with a focus on cloud data ecosystems.
- Demonstrate advanced expertise in Databricks, PySpark, SQL, Delta Lake, and structured streaming architectures.
- Exhibit leadership, consensus building, and the ability to communicate complex technical concepts to non-technical stakeholders.
- Ensure compliance with agile methodologies and contribute to iterative planning and execution.

About the Company

Expert Technology Services

Resume Resources

Free Resume Templates Free Resume Builder