Apache Kafka, Application Programming Interface (API), Automation, Best Practices, Business Skills, Computer Science, Consulting, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Analysis, Data Lake, Data Management, Data Modeling, Database Extract Transform and Load (ETL), Debugging Skills, GitHub, Identify Issues, Information Technology & Information Systems, Information/Data Security (InfoSec), Mentoring, Messaging Technology, Microsoft Windows Azure, Performance Management, Production Systems, Production Volume, Python Programming/Scripting Language, Query Optimization, RabbitMQ, Requirements Management, SQL (Structured Query Language), SQL Server Integration Services (SSIS), Scalable System Development, Scripting (Scripting Languages), Stored Procedures, System Integration (SI), TIBCO Product family, Technical Writing, Windows PowerShell
Sr. Data Engineer
Calabasas, CA (3 days a week onsite)
6+ month contract to hire
$67-$75 an hour ( $140,000 - $156,000 salary upon conversion)
Immediate opening for a Senior Data Engineer to build and maintain scalable data pipelines and integrations using ETL/ELT frameworks, APIs, and messaging systems (Kafka, RabbitMQ). Partner with cross-functional teams to translate business needs into data solutions, models, and production-ready systems. Optimize Azure data platforms (Azure SQL, Data Factory, SSIS) for performance and cost, while implementing best practices in data governance, security, and compliance. Leverage Azure services (Data Lake, Blob Storage, Functions, Logic Apps) for scalable processing. Lead tool evaluations (Snowflake, Databricks, Airflow), support CI/CD with GitHub Actions, and develop automation using Python and PowerShell. Mentor junior team members and maintain clear technical documentation.
Requirements:
- 5+ years of experience as a Data Engineer with a strong focus on integration design and development
- 5+ years of hands-on experience with Azure Data Factory, Azure SQL, and SSIS
- Proven ability to translate business requirements into scalable, robust, and long-term data solutions, with strong ownership of system design
- Solid experience in data engineering, including data modeling, pipeline development, optimization, and troubleshooting/debugging
- Proficiency in SQL, Python, stored procedures, and data transformation techniques
- Experience with scripting and automation using Python and PowerShell
- Hands-on experience with integration platforms (e.g., SnapLogic) and iPaaS tools (TIBCO, Adeptia), including external system integrations
- Strong understanding of data pipelines and data assets, with the ability to support and maintain high-volume production environments (200+ processes across varying schedules)
- Experience optimizing SQL queries and improving performance of data systems
- Exposure to modern data platforms such as Databricks, Synapse, BigQuery, or Snowflake
- Bachelor's degree in Computer Science, Information Systems, Data Analytics, or related field
Welcome to ConsultNet, a premier national provider of technology talent and solutions. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid. For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. Our comprehensive service offerings cover a wide range of technology and engineering positions across key markets nationwide. Learn more at www.consultnet.com .
We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.