Sign upLog in
Media Production Jobs in Charleston, SC

Data Engineering - Lead

Pyramid, Inc
  • Charleston, SC
  • $130,000–$150,000 Per Year
  • Full-time
30+ days ago

Job Description

Immediate need for a talented Data Engineering - Lead. This is a Fulltime opportunity with long-term potential and is located in Charleston, SC (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID:26-22310

Pay Range: $130000 - $150000/annum.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:
  • Data Strategy & Architecture
  • Define and drive the enterprise data engineering strategy and roadmap.
  • Design scalable data architectures supporting operational, analytical, and AI workloads.
  • Establish standards for data modeling, data integration, metadata management, and data lifecycle management.
  • Lead modernization efforts from legacy data environments to cloud-native data platforms.
  • Ensure alignment with enterprise architecture, cybersecurity, and compliance requirements.
  • Data Platform Engineering
  • Lead the design and implementation of enterprise data platforms utilizing cloud technologies and modern data architectures.
  • Develop and maintain high-volume batch, streaming, and event-driven data pipelines.
  • Build and manage data lakes, data warehouses, lakehouse architectures, and data products.
  • Establish reusable frameworks and accelerators that improve engineering velocity and solution consistency.
  • Drive platform automation through Infrastructure-as-Code and DataOps practices.
  • Leadership & Team Development
  • Lead and mentor a team of Data Engineers, Data Architects, and Data Integration specialists.
  • Establish engineering best practices and technical standards.
  • Provide technical oversight, architecture reviews, and design guidance across projects.
  • Foster a culture of innovation, accountability, continuous learning, and operational excellence.
  • Support recruitment, onboarding, career development, and performance management activities.
  • Data Governance & Quality
  • Implement enterprise data governance practices.
  • Establish data quality frameworks, monitoring, observability, and remediation processes.
  • Partner with data stewards and business stakeholders to improve trust in enterprise data assets.
  • Ensure compliance with regulatory, privacy, retention, and security requirements.
  • Define and monitor KPIs related to data quality, availability, and reliability.
  • AI & Advanced Analytics Enablement
  • Build and optimize data environments that support AI, machine learning, and advanced analytics initiatives.
  • Collaborate with data scientists and AI teams to operationalize models and data products.
  • Support enterprise AI initiatives through governed, trusted, high-quality data pipelines.
  • Establish patterns for feature engineering, model data preparation, and data consumption.
  • Delivery & Execution
  • Manage delivery of multiple concurrent data engineering initiatives.
  • Create project plans, estimates, resource forecasts, and delivery commitments.
  • Drive agile delivery practices while maintaining governance and quality expectations.
  • Identify risks, dependencies, technical debt, and remediation plans.
  • Ensure predictable delivery, operational stability, and stakeholder satisfaction.
  • Stakeholder Engagement
  • Work closely with executive leadership to align data investments with business objectives.
  • Partner with engineering, product management, operations, and business teams to prioritize initiatives.
  • Present technical recommendations, investment strategies, and progress updates to leadership audiences.
  • Act as a trusted advisor for enterprise data strategy and modernization initiatives.
Key Requirements and Technology Experience:
  • Must have skills: - Data Architecture, Data Governance, Insurance
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field.
  • Master's degree preferred.
  • 10+ years of experience in Data Engineering, Data Architecture, or related technology disciplines.
  • 3+ years leading technical teams or enterprise-scale data initiatives.
  • Demonstrated experience designing and delivering enterprise data platforms.
  • Experience leading cross-functional teams in global delivery environments.
  • Technical Expertise
  • Strong experience in multiple areas including:
  • SQL and advanced database technologies
  • Python, Spark, Scala, or similar data engineering technologies
  • ETL and ELT frameworks
  • Data Lakes, Lakehouse, and Data Warehouse architectures
  • Cloud platforms (Azure, AWS, or Google Cloud)
  • Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies
  • Real-time data processing and streaming architectures
  • API-based integration and event-driven architectures
  • CI/CD, DataOps, Infrastructure-as-Code, and automation practices
  • Insurance industry experience.
  • Experience supporting AI, Machine Learning, and Generative AI initiatives.
  • Experience implementing enterprise data governance programs.
  • Success leading large-scale cloud migration or data modernization programs.
  • Experience with observability, operational monitoring, and reliability engineering.
  • Leadership Competencies
  • Strategic Thinking
  • Technical Leadership
  • Decision Making
  • Stakeholder Management
  • Talent Development
  • Executive Communication
  • Continuous Improvement Mindset
  • Customer Focus
  • Results Orientation
  • Cross-Functional Collaboration
Our client is a leading IT Industry and we are currently interviewing to fill this and other similar fulltime positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.

Numbers & Facts

LocationCharleston, SC
Job TypeFull-time
Salary$130,000–$150,000 Per Year

Skills

  • Amazon Web Services (AWS)unmatched
  • Application Programming Interface (API)unmatched
  • Artificial Intelligence (AI)unmatched
  • Automationunmatched
  • Best Practicesunmatched
  • Career Developmentunmatched
  • Cloud Computingunmatched
  • Computer Scienceunmatched
  • Consultingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Improvementunmatched
  • Continuous Integrationunmatched
  • Cross-Functionalunmatched
  • Customer Relationsunmatched
  • Data Managementunmatched
  • Data Migrationunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Scienceunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • Database Technologyunmatched
  • Delivery Managementunmatched
  • Employee Benefitsunmatched
  • Enterprise Architectureunmatched
  • Establish Prioritiesunmatched
  • Forecastingunmatched
  • Information Technology & Information Systemsunmatched
  • Insuranceunmatched
  • Internet Securityunmatched
  • Investment Strategyunmatched
  • Leadershipunmatched
  • Machine Learningunmatched
  • Maintain Complianceunmatched
  • Mentoringunmatched
  • Metadataunmatched
  • Microsoft Windows Azureunmatched
  • Onboardingunmatched
  • Operational Auditunmatched
  • Operational Supportunmatched
  • Performance Managementunmatched
  • Performance Metricsunmatched
  • Privacy Regulationsunmatched
  • Process Improvementunmatched
  • Product Managementunmatched
  • Project Estimatesunmatched
  • Project Planningunmatched
  • Python Programming/Scripting Languageunmatched
  • Quality Managementunmatched
  • Quality Monitoringunmatched
  • Regulatory Complianceunmatched
  • Reliability Engineeringunmatched
  • Risk Analysisunmatched
  • SQL Databasesunmatched
  • Scala Programming Languageunmatched
  • Short Messaging Service (SMS)unmatched
  • Systems Engineeringunmatched
  • Talent Managementunmatched
  • Team Buildingunmatched
  • Team Lead/Managerunmatched
  • Technical Leadershipunmatched
  • Technical Presentationunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder