Job Description
Overview:
TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client is a trusted engineering, construction and project management partner to industry and government. Differentiated by the quality of their people and their relentless drive to deliver the most successful outcomes, they align their capabilities to their customers' objectives to create a lasting positive impact. Since 1898, they helped customers complete more than 25,000 projects in 160 countries on all seven continents that have created jobs, grown economies, improved the resiliency of the world's infrastructure, increased access to energy, resources, and vital services, and made the world a safer, cleaner place.
Job Title: Senior Azure Databricks Engineer
Location: Glendale, AZ, 85301
Duration: 12 Months
Job Type: Temporary Assignment
Work Type: Onsite
Job Desription:
Roles & Responsibilities:
- Collaborate with Data Platforms and Integration team in architecting and implementing scalable enterprise data platform solutions utilizing Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, and related Azure services.
- Design and develop enterprise data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics workloads.
- Administer and maintain Azure Databricks workspaces including cluster configuration, job scheduling, workspace administration, Unity Catalog implementation, secret management, compute policies, cluster policies, and workspace governance.
- Define and implement enterprise security architecture including identity integration with Microsoft Entra ID (Azure AD), Role-Based Access Control (RBAC), Privileged Identity Management (PIM), data encryption, private networking, managed identities, Key Vault integration, and secure access patterns.
- Establish enterprise data governance standards utilizing Unity Catalog including data lineage, data quality, metadata management, catalog organization, access policies, and audit capabilities.
- Optimize Databricks workloads through performance tuning, Spark optimization, cluster sizing, workload isolation, caching strategies, partitioning, Delta optimization, Photon, and cost optimization best practices.
- Design enterprise monitoring, logging, operational dashboards, alerting, and platform health monitoring utilizing Azure Monitor, Log Analytics, Application Insights, and Databricks system tables.
- Develop reusable architecture patterns, reference implementations, development standards, naming conventions, coding standards, operational procedures, and platform documentation.
- Support migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehouse architecture.
- Provide technical support and troubleshooting for production incidents related to Azure Databricks, Spark workloads, data pipelines, and platform infrastructure.
Requirements
- At least 8-10 years of experience in designing and implementing enterprise data platforms;
- At least 5 years of hands-on experience hands-on Azure Databricks experience in enterprise environments;
- Experience with architecting modern Lakehouse solutions using Azure Databricks and Delta Lake;
- Experience in administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security;
- Experience in developing data engineering solutions using Apache Spark (PySpark and/or Spark SQL);
- Experience in implementing enterprise data governance utilizing Unity Catalog, metadata management, data lineage, and fine-grained access controls;
- Experience designing and working with enterprise security architectures including RBAC, Managed Identities, Private Endpoints, Key Vault integration, encryption, and network security;
- Experience implementing enterprise data quality frameworks, monitoring, observability, and operational dashboards;
- Strong understanding of data modelling techniques including dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts;
- Strong knowledge of Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking;
- Strong SQL programming skills and proficiency in Python and PySpark development
- Strong experience implementing CI/CD pipelines utilizing Azure DevOps, automated testing, release management, and deployment automation
TekWissen Group is an equal opportunity employer supporting workforce diversity.
Numbers & Facts
| Location | Glendale, AZ |
| Industry | Computer/IT Services |
| Salary | $51.40–$66.71 |
| Company Size | 100 to 499 employees |
| Year Founded | 2009 |
| Website | http://www.tekwissen.com/ |
About Company
WE THE TEKWISSEN PEOPLE
TekWissen offers you a broader portfolio of services, industry-leading solutions, and the meaningful innovations that give you greater flexibility and speed to respond to market dynamics, reduced costs and risk to improve enterprise performance, and increased productivity to enable growth.
To keep pace with global market demands, TekWissen keeps its finger on the pulse of change. Our organized approach to guiding a project from its inception to closure. Managing projects is becoming more and more important as we enter the digital era. To cope with the pace that this transition demands, a method is required to manage projects so they can yield quality work, while incorporating efficient use of time and resources.
Project involves identifying which quality standards are relevant to the project and determining how to satisfy them.
It is important to perform quality planning during the Planning Process and should be done alongside the other project planning processes because changes in the quality will likely require changes in the other planning processes, or the desired product quality may require a detailed risk analysis of an identified problem. It is important to remember that quality should be planned, designed, then built in, not added on after the fact.
Capabilities and accomplishments in one TekWissen business enhance the opportunity for success in the others. Put simply, TekWissen's unique combination of attributes promotes success.Skills
- Access Controlunmatched
- Apache Sparkunmatched
- Automationunmatched
- Best Practicesunmatched
- Cachingunmatched
- Cisco Unityunmatched
- Coding Standardsunmatched
- Computer Programmingunmatched
- Construction Engineeringunmatched
- Construction Managementunmatched
- Continuous Deployment/Deliveryunmatched
- Continuous Integrationunmatched
- Cost Controlunmatched
- Cryptographyunmatched
- Customer Support/Serviceunmatched
- Data Lakeunmatched
- Data Managementunmatched
- Data Modelingunmatched
- Data Qualityunmatched
- Data Storageunmatched
- Data Warehousingunmatched
- Database Extract Transform and Load (ETL)unmatched
- DevOpsunmatched
- Dimensional Modelingunmatched
- Diversityunmatched
- Documentationunmatched
- Enterprise Architectureunmatched
- Enterprise Protectionunmatched
- Governmentunmatched
- Identify Issuesunmatched
- Identity Data Managementunmatched
- Metadataunmatched
- Microsoft Product Familyunmatched
- Microsoft Windows Azureunmatched
- Microsoft Windows Mobileunmatched
- Network Securityunmatched
- Operations Processesunmatched
- Performance Tuning/Optimizationunmatched
- Project/Program Managementunmatched
- Protocol Independent Multicast (PIM)unmatched
- Python Programming/Scripting Languageunmatched
- Quality Managementunmatched
- Quality Monitoringunmatched
- Release Management/Engineeringunmatched
- Reporting Dashboardsunmatched
- SQL (Structured Query Language)unmatched
- Security Architectureunmatched
- Technical Supportunmatched
- Test Automationunmatched
- Workforce Managementunmatched
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesFree resume builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder