Our Client, an IT Services and Consultant company, is looking for a Data Engineer – Starburst, AWS Redshift & Snowflake for their Johnston, RI location.
Responsibilities:
Configure and administer Starburst clusters for federated querying across AWS Redshift and Snowflake. Set up and manage Starburst connectors for Redshift and Snowflake, ensuring secure and performant connectivity between both platforms.
Design and optimize SQL queries to support QA/QC data validation, cross-platform reconciliation, and data comparison workflows.
Collaborate with QA/QC and data governance teams to define validation rules, reconciliation logic, and exception reporting across Redshift and Snowflake datasets.
Monitor query performance across federated sources, troubleshoot connector/cluster issues, and tune Starburst for optimal throughput.
Manage access control, security configuration, and catalog/schema setup for both Redshift and Snowflake connectors within Starburst.
Document architecture, connector configurations, and best practices for federated querying across the two platforms.
Partner with data engineering and platform teams to ensure the Starburst deployment aligns with broader enterprise data architecture standards.
Requirements:
3+ years of hands-on experience with Starburst.
Direct experience configuring Starburst connectors for both AWS Redshift and Snowflake.
Strong SQL skills, with experience in federated/distributed query environments.
Strong AWS skills, including Redshift, IAM, and networking/VPC configuration for connector setup.
Familiarity with data quality, reconciliation, or QA/QC frameworks in an enterprise data environment.
Understanding of connector configuration, catalog management, and cluster performance tuning in Starburst.
Ability to collaborate with cross-functional data governance and QA teams.
Preferred Qualifications:
Experience in banking/financial services data environments.
Familiarity with data governance and metadata management tools.
Starburst certification, or equivalent hands-on project experience with multi-source federation.