Allied Consultants, Inc is a proudly Austin based firm with over 34 years of experience delivering top-tier technical and business professionals within Texas State Agencies. We are currently seeking an experience Senior Data Engineer to play a key role within a high-impact technical services team.
At Allied Consultants, we value our consultants and are committed to providing an exceptional experience including:
Candidates selected for interviews will be subject to a criminal background check and may be required to pass a drug screening, in compliance with federal and state regulations. All offers of employment are contingent upon successful completion of these checks.
Allied Consultants is a proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Responsibilities:Client is seeking a hands-on Senior Data Engineer with extensive experience (Hands on) in Azure data services and Databricks.
Responsibilities:
**Location of job: Hyrid, 3 days onsite & 2 days remote. Candidates must be local to Austin, TX**
Qualifications:Minimum (Required):
Years | Skills/Experience |
10+ | IT experience, including a minimum of 5 years as a Data Engineer. |
5+ | Experience with the Azure cloud platform. |
| Proven experience with Azure data services (e.g., Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions). |
| Experience with Databricks, Microsoft Fabric, Power Automate, Power BI and SQL. |
| Proficiency in Python, SQL, API, and PySpark. |
| Expertise in optimizing ETL processes, data warehouse, and data lake management. |
| Experience with CI/CD and DevOps practices. |
| Experience with structured, unstructured, and semi-structured data. |
| Experience with maintaining and publishing code to GitHub. |
| Ability to work in a cross-functional team and coordinate with Infra/Ops and Information Security departments. |
| Experience with requirement gathering and Scrum methodologies |
Preferred (Optional):
Years | Skills/Experience |
| Experience with on premises to Azure cloud migration. |
| Knowledge of Snowflake, Microsoft Fabric, Microsoft Purview, AI/ML, streaming data services, and marketplace data services. |
| Relevant certifications. |
| Experience with multiple cloud implementations. |