Amazon Web Services (AWS), Apache Spark, Artificial Intelligence (AI), Automation, Cisco Unity, Cloud Architecture, Cloud Computing, Communication Skills, Computer Science, Consulting, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Customer Relations, Customer Support/Service, Data Management, Data Modeling, Data Warehousing, DevOps, Enterprise Protection, GCP (Good Clinical Practices), Information Technology & Information Systems, Information Technology Consulting, Microsoft Product Family, Microsoft Windows Azure, MySQL, Network Administration/Management, Network Scalability, Oracle, Security Architecture, Software Administration, Software Development, Systems Administration/Management, Technical Delivery, Technical Leadership, Technical Support
Title: Data Engineer
Location: USA
Exp: 5+
7 + years of IT experience
Databricks (data engineering, SQL, notebooks, app/backend integration patterns)Enterprise data warehouses and lakehouse platforms (Nice to have Fabric, Snowflake, Synapse, BigQuery - experience)
Deep knowledge of data modeling, data warehousing, and lakehouse patterns
Hands‑on experience with at least one modern data platform:
Experience integrating data platforms with applications using APIs, services, or event‑driven patterns
Solid understanding of cloud architecture concepts (security, networking, scalability, cost management)
Strong communication skills with the ability to engage both technical and business stakeholders
Experience working in client‑facing or consulting environments
- Bachelor''s Degree in Computer Science, Information Technology, Engineering, Business, or related field
- 4+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting. Or, equivalent experience
- Deep hands on experience with Databricks Lakehouse Platform and Apache Spark
Strong proficiency in PySpark, SQL, Delta Lake, Databricks SQL
- Experience implementing Unity Catalog, data governance, and enterprise security controls
- Cloud experience with Azure Databricks, AWS Databricks, or GCP Databricks
- Familiarity with CI/CD, DevOps, and automation for Databricks workloads
- 8-12+ years in data engineering or architecture, with 4-5+ years delivering Databricks solutions
- Proven experience in client facing consulting roles, including requirements discovery, solution design, and executive communication
Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.