Database Developer

Summary:

• We are seeking a highly skilled and innovative Database Developer with expertise in modern data architectures, specifically Apache Iceberg, Oracle, and Starburst (Trino), to join our dynamic data engineering team.

Responsibilities:

• Design, develop, and maintain robust and scalable data solutions within our data lakehouse architecture, leveraging Apache Iceberg for open table format management.
• Develop and optimize data ingestion, transformation, and curation processes using technologies compatible with Iceberg, Oracle, and Starburst.
• Utilize Starburst (Trino) for high-performance querying and data virtualization across various data sources, including Iceberg tables and Oracle databases.
• Work extensively with Oracle databases for enterprise data management, including schema design, stored procedures, performance tuning, and data integration.
• Collaborate with data architects, data scientists, and business intelligence teams to translate business requirements into technical data models and data solutions.
• Implement and manage ETL/ELT pipelines to move data efficiently between Oracle, data lake storage (e.g., S3, ADLS), and Iceberg tables.
• Ensure data quality, integrity, and security across all data platforms, adhering to data governance standards.
• Perform performance tuning and optimization for queries running on Starburst, Iceberg tables, and Oracle databases.
• Participate in the evaluation and adoption of new data technologies and best practices to enhance our data platform capabilities.
• Troubleshoot and resolve complex data-related issues, ensuring high availability and reliability of data infrastructure.
• Document technical specifications, data flows, data models, and operational procedures.
• Mentor junior team members and contribute to a culture of continuous learning and improvement.

Requirements:

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
• Minimum of 7 years of experience in database development or data engineering roles.
• Proven hands-on experience with Apache Iceberg for managing large-scale, high-performance table formats in a data lake context.
• Strong expertise in Oracle database development, including SQL, PL/SQL, schema design, indexing, and performance tuning.
• Experience with Starburst (Trino) for distributed query processing and federated queries across heterogeneous data sources.
• Proficiency in SQL for complex data manipulation, analysis, and optimization.
• Solid understanding of data warehousing concepts, dimensional modeling, and ETL/ELT methodologies.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data storage services (e.g., S3, ADLS, GCS).
• Familiarity with distributed data processing frameworks (e.g., Apache Spark, Flink).
• Experience with version control systems (e.g., Git).
• Excellent analytical, problem-solving, and communication skills, with the ability to articulate complex technical concepts.

Preferred Skills:

• Master's degree in a related field.
• Experience with other data lake table formats (e.g., Delta Lake, Apache Hudi).
• Knowledge of other distributed query engines (e.g., Presto, Athena, Dremio).
• Proficiency in programming languages such as Python or Scala for data engineering tasks.
• Experience with workflow orchestration tools (e.g., Apache Airflow, Dagster).
• Familiarity with data governance tools and practices in a data lakehouse environment.
• Relevant industry certifications (e.g., Oracle Certified Professional, AWS Certified Data Analytics).