Databricks Architect

Title: Databricks Architect

Location: Remote

Duration: 12+ Months Contract to hire

Client: Public Consulting Group

Rate: $60-$70/hr on W2 (Flexible)

Referral: $5/hr

Visa: USC, GC, GC EAD, H4 EAD, TN

Interview Mode: Video

SUBMISSION REQUIREMENTS:

Need Genuine LinkedIn- NO RECENT OR MULTIPLE LINKEDIN

Must have Visa Copy with the submission (FOR GC and EADs)

Must have full educational details with University Name and year of completion in resume.

WITHOUT ABOVE MENTIONED PREREQUISITE RESUME WILL BE DEEMED AS FAKE.

Job Description:

We haven't been able to find someone hands-on enough.

We've had a lot of fake candidates with fake references so now moving forward we need at least one reference that I can call. Must have phone number, LinkedIn and with a work email domain

• Please send me this reference with your usual submittal template

The profile that fits best is someone who still writes PySpark and Databricks code day to day. That means Unity Catalog administration they've done themselves, Terraform, and ideally SQL Server change tracking or CDC into Databricks. Strong résumés haven't been the hard part; current hands-on depth has been.

Job Description:

We are seeking an experienced Databricks Architect to design and lead the implementation of a modern, enterprise-grade data platform built on the Databricks Lakehouse architecture. This role focuses on establishing architectural standards, defining governance frameworks, and driving strategic decisions that enable scalable, secure, and high-performance analytics across the organization.

Key Responsibilities

• Technical Leadership: Establish architectural patterns and best practices for medallion architecture, Delta Lake optimization, data mesh principles, pipeline orchestration, and cross-domain data sharing. Lead technical code reviews for data engineering teams, providing detailed feedback on PySpark, SQL, and architectural patterns; ensure code quality, performance optimization, and adherence to best practices.
• Architecture & Strategy: Define the overall Databricks platform architecture, including workspace design, Unity Catalog governance model, storage patterns, compute strategies, and integration with broader enterprise data ecosystems.
• DevOps & Automation: Design CI/CD architecture for Databricks assets, including Git-based development workflows, automated testing frameworks, deployment pipelines, and infrastructure-as-code patterns using Terraform or similar tools.
• Governance & Security: Design and implement comprehensive governance frameworks within Unity Catalog, including multi-catalog strategies, metastore configuration, identity federation, fine-grained access controls, attribute-based access control (ABAC), data classification, and compliance requirements.
• Platform Design: Architect solutions for compute resource allocation (all-purpose clusters, job clusters, SQL warehouses, serverless), autoscaling strategies, cost optimization, and workload isolation across teams and environments.
• Data Modeling & Standards: Define enterprise data modeling standards, schema design patterns, slowly changing dimensions (SCD) strategies, CDC architectures, and data quality frameworks that scale across multiple domains.
• Performance & Optimization: Architect solutions for query optimization, storage layout strategies (partitioning, Z-ordering, liquid clustering), caching, materialized views, and monitoring/observability across the platform.
• Integration Architecture: Design integration patterns with upstream source systems (APIs, databases, streaming), downstream analytics tools (Power BI, Tableau), and adjacent cloud services (Azure Synapse, AWS services, etc.).
• Collaboration & Enablement: Partner with engineering teams, data teams, and stakeholders to translate business requirements into architectural blueprints; mentor engineers on implementation of architectural patterns.
• Innovation & Evaluation: Stay current with Databricks platform evolution, evaluate new features (Lakehouse Federation, AI/ML capabilities, streaming enhancements), and drive adoption of capabilities that deliver business value.

Required Skills & Experience

• Current, hands-on development experience is essential. This role requires the ability to read, write, debug, and lead code reviews of production PySpark and SQL code-not just architectural oversight. Candidates must demonstrate recent (within past 12 months) hands-on development work including debugging live code, explaining business logic and technical implementation, optimizing queries, and implementing data pipelines. Ability to comprehend and explain unfamiliar code samples is a core requirement.
• Advanced proficiency in SQL and Python/PySpark with demonstrated ability to write complex transformations, optimize query performance, explain code logic at both business and technical levels, and troubleshoot production issues. Must be comfortable with CTEs, window functions, table-valued functions, APPLY operators, advanced SQL operators, and PySpark DataFrame/RDD operations. Current, active coding skills required-not aspirational or theoretical knowledge.
• 7+ years of experience in data architecture, data engineering, or platform engineering roles, with at least 3+ years focused on Databricks platform architecture.
• Expert-level knowledge of Databricks platform components: Unity Catalog, Delta Lake, Delta Live Tables, Workflows, SQL Warehouses, MLflow, and Databricks SQL.
• Deep expertise in Unity Catalog governance, including metastore design, catalog/schema strategies, permission models, data lineage, and multi-workspace/multi-cloud patterns.
• Strong architectural background in cloud platforms (Azure, AWS, or GCP), including storage services, identity management (Azure AD, AWS IAM), networking, and security best practices.
• Proven experience designing enterprise-scale data architectures, including medallion/multi-hop architectures, data mesh patterns, domain-driven design, and data product frameworks.
• Hands-on experience with infrastructure-as-code (Terraform, ARM templates, CloudFormation) for platform configuration and governance automation.
• Strong understanding of DevOps practices, CI/CD pipelines, version control strategies, and automated testing for data platforms.
• Experience with performance tuning, cost optimization, and capacity planning for large-scale data platforms.

Preferred Qualifications

• Databricks certification (e.g., Databricks Certified Data Engineer Professional, Solutions Architect). Note: Certification alone is insufficient; candidates must demonstrate current hands-on technical execution aligned with certification level.
• Cloud certifications such as Azure Solutions Architect, AWS Solutions Architect, or GCP Professional Data Engineer.
• Experience designing multi-tenant architectures with secure data isolation, cross-tenant data sharing, and compliance controls.
• Background in streaming architectures using Structured Streaming, Kafka, Event Hubs, or Kinesis.
• Exposure to machine learning operations (MLOps), feature stores, model serving, and AI/ML platform architecture.
• Experience with data mesh implementations, federated governance, and distributed data ownership models.
• Knowledge of analytics platforms (Power BI, Tableau, Looker) and their integration patterns with Databricks.
• Familiarity with domain-specific data models in education (CEDS), healthcare, finance, or operational domains.
• Experience with real-time CDC patterns, change data capture tools (Debezium, Qlik, Fivetran), and event-driven architectures.

Leadership & Soft Skills

• Professional presence and composure under pressure, including ability to handle unexpected technical challenges, maintain calm in production incidents, and communicate effectively during high-stress situations.
• Strategic thinking with ability to balance long-term architectural vision with pragmatic, incremental delivery.
• Exceptional communication skills to articulate complex architectural concepts to technical and non-technical stakeholders, including executive leadership.
• Proven ability to influence and drive consensus across multiple teams and organizational levels.
• Mentorship and enablement mindset to uplift engineering teams through knowledge sharing, documentation, and hands-on guidance.
• Strong problem-solving capabilities with a focus on root cause analysis and sustainable solutions.
• Commitment to quality, including comprehensive documentation, architectural decision records (ADRs), and knowledge transfer.

Position Summary

This role is ideal for a seasoned architect who thrives on designing elegant, scalable solutions and wants to shape the foundation of a next-generation Lakehouse platform. The Databricks Architect will serve as the technical authority for the platform, driving architectural excellence, governance maturity, and innovation that enables the organization to unlock the full value of its data assets across analytics, data science, and operational use cases.

Terms & Conditions for Candidate Portal

Last Updated: May 6th, 2026

Please read these Terms & Conditions ("Agreement", "Terms") carefully before using the Candidate Portal ("Portal", "Service") provided by AKT Corp ("we", "us", "our").

By accessing or registering for the Portal, you ("Candidate", "User", "you", "your") agree to be bound by these Terms.

If you do not agree with any part of these Terms, you may not use the Portal.

1. Acceptance of Terms

By accessing or using the Candidate Portal, you affirm that you are at least 18 years old and are legally authorized to enter into this Agreement.

If you are accessing the Portal on behalf of an employer or third party, you represent that you have the authority to bind that entity to these Terms.

2. Purpose of Portal

The Portal is provided as a digital platform for Candidates to:

• Create and manage profiles
• Upload resumes, documents, and other professional details
• View and apply for job opportunities
• Track application status
• Communicate with recruiters and client organizations
• Access profile and document-related information

These Terms govern your use of the Portal and all related services.

3. User Registration & Account Security

• You agree to provide accurate, complete, and current information during signup.
• You are responsible for maintaining the confidentiality of your account credentials.
• You agree to immediately notify us of any unauthorized use of your account.
• You are responsible for all activities that occur under your account.

4. Document Upload & Verification

You understand and agree that:

• All resumes, documents, and information you upload must be true, accurate, and valid
• You are fully responsible for the accuracy and legality of the information you provide
• The Portal may use third-party verification services where applicable
• We reserve the right to reject or remove any document or information that appears invalid or misleading

5. Use of Portal Services

You agree to use the Portal in compliance with:

• Applicable laws and regulations
• Professional standards for IT professionals
• Client-specific requirements
• Instructions provided on the Portal

Prohibited actions include, but are not limited to:

• Uploading false or misleading information
• Interfering with Portal operations
• Sharing your credentials or login with others
• Attempting to bypass or manipulate application processes

6. Job Application

You acknowledge that:

• Job opportunities displayed on the Portal are not guaranteed of employment.
• Applications are subject to client requirements, screening, and approval.
• Job details (role, location, requirements) are subject to change.

7. Profile Accuracy & Updates

• You agree to maintain accurate and up-to-date information in your profile.
• Failure to keep your profile updated may impact your eligibility for job opportunities or result in account restrictions.

8. Privacy & Data Use

Your use of the Portal is subject to our Privacy Policy, which describes how we collect, use, and safeguard your personal information.

By using the Portal, you consent to the collection and use of information as described.

9. Intellectual Property

All intellectual property contained in or presented through the Portal is owned by us or our licensors.

You may not copy, modify, distribute, or otherwise use any Portal content without express written permission.

10. Disclaimer of Warranties

The Portal and all content and services are provided "as is" and "as available."

We make no warranties, express or implied, including:

• Merchantability
• Fitness for a particular purpose
• Accuracy or completeness of information

11. Limitation of Liability

To the fullest extent permitted by law, we are not liable for:

• Direct, indirect, incidental, special, or consequential damages
• Loss of data, profits, or business opportunities
• Claims arising from job application outcomes

12. Amendments

We may modify these Terms at any time.

Changes will be posted on the Portal with an updated "Last Updated" date.

Your continued use of the Portal after changes indicates your acceptance.

13. Termination

We may suspend or terminate your access to the Portal if you violate these Terms or for any reason, with or without notice.

The profile that fits best is someone who still writes PySpark and Databricks code day to day. That means Unity Catalog administration they've done themselves, Terraform, and ideally SQL Server change tracking or CDC into Databricks. Strong résumés haven't been the hard part; current hands-on depth has been.