Senior Data Engineer

Overview

Allied Consultants, Inc is a proudly Austin based firm with over 34 years of experience delivering top-tier technical and business professionals within Texas State Agencies. We are currently seeking an experience Senior Data Engineer to play a key role within a high-impact technical services team.

At Allied Consultants, we value our consultants and are committed to providing an exceptional experience including:

• Highly competitive pay rates
• Local support staff for responsive, personal service
• Comprehensive benefits package, including:
  • Medical insurance (with employer cost sharing)
  • Life insurance
  • A 401(K) plan with company match
  • Flexible spending through a cafeteria plan

Candidates selected for interviews will be subject to a criminal background check and may be required to pass a drug screening, in compliance with federal and state regulations. All offers of employment are contingent upon successful completion of these checks.

Allied Consultants is a proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Responsibilities

Client is seeking a hands-on Senior Data Engineer with extensive experience (Hands on) in Azure data services and Databricks.

Responsibilities:

• Design and implement data solutions using Azure services (e.g., Synapse Analytics, Databricks, Snowflake, Azure SQL, Azure Blob Storage, ADLS Gen2, Azure Functions, Azure Key Vault, AI/ML).
• Develop data pipelines and transformations (ETL/ELT).
• Collaborate with stakeholders to understand data requirements and deliver solutions.
• Ensure data solutions are scalable, reliable, and secure.
• Implement CI/CD and DevOps practices.
• Maintain and publish code to GitHub. 
• Follow PMO/Scrum master instructions using Agile/Scrum methodologies.

**Location of job: Hyrid, 3 days onsite & 2 days remote. Candidates must be local to Austin, TX**

Qualifications

Minimum (Required):

Years

Skills/Experience

10+

IT experience, including a minimum of 5 years as a Data Engineer.

5+

Experience with the Azure cloud platform.

Proven experience with Azure data services (e.g., Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions).

Experience with Databricks, Microsoft Fabric, Power Automate, Power BI and SQL.

Proficiency in Python, SQL, API, and PySpark.

Expertise in optimizing ETL processes, data warehouse, and data lake management.

Experience with CI/CD and DevOps practices.

Experience with structured, unstructured, and semi-structured data.

Experience with maintaining and publishing code to GitHub.

Ability to work in a cross-functional team and coordinate with Infra/Ops and Information Security departments.

Experience with requirement gathering and Scrum methodologies

Preferred (Optional):

Years

Skills/Experience

Experience with on premises to Azure cloud migration.

Knowledge of Snowflake, Microsoft Fabric, Microsoft Purview, AI/ML, streaming data services, and marketplace data services.

 Relevant certifications.

Experience with multiple cloud implementations.