Software Engineer: IV (Lead)

Dale Workforce Solutions
  • St. Paul, MN
  • Remote
  • Instant Apply
Today

Job Description

Confluent Kafka Developer - Contractor

Job Overview:

We are seeking an experienced Confluent Cloud Kafka Developer to design, develop, and manage scalable, real-time data streaming solutions using Apache Kafka on Confluent Cloud. The ideal candidate will work with data engineering teams to architect streaming data pipelines, integrate diverse data sources, and optimize Kafka for high-performance applications. This role requires strong expertise in Apache Kafka, Confluent Cloud, and distributed streaming platforms, with a focus on real-time integrations.

Key Responsibilities:
  • Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink.
  • Collaborate with data engineering teams to integrate streaming solutions with existing data platforms such as AWS and Snowflake.
  • Design, build, and maintain real-time data pipelines and ensure high data quality, integrity, and reliability.
  • Utilize Terraform to manage and automate code deployments on AWS or other cloud environments.
  • Develop and maintain CI/CD pipelines for deploying and managing Kafka clusters and related infrastructure.
  • Collaborate with development, DevOps, and data science teams to understand data needs and deliver optimal solutions.
  • Provide support and guidance on Kafka-related issues and best practices for other teams.
  • Stay updated with the latest Kafka and streaming technologies and provide recommendations for improvements.

Required Qualifications:
  • 3+ years of experience in software development, with a strong focus on Apache Kafka development and distributed systems.
  • 2+ years of experience in Python for building Kafka applications
  • Proven experience with Confluent Kafka, including Schema Registry
  • Experience with Infrastructure as Code (IaC) tools, particularly Terraform.
  • Hands-on experience with AWS services (e.g., EC2, S3, IAM, Lambda).
  • Solid understanding of data integration, ETL processes, and data pipeline orchestration.
  • Experience with operational monitoring and performance optimization of streaming pipelines.
  • Ability to troubleshoot and resolve complex technical issues related to Kafka and its ecosystem.
  • Strong analytical and problem-solving skills, with attention to detail.
  • Excellent verbal and written communication skills.
  • Ability to work effectively in a team environment and collaborate with cross-functional teams.

Preferred Qualifications:
  • 2+ years of experience working with Confluent Cloud and implementing Kafka-based solutions.
  • Proficiency with Apache Flink, ksqlDB, and Kafka Connect for real-time data processing and integration.
  • Working knowledge of Snowflake for data warehousing and analytics in cloud environments.
  • Strong programming skills in Java, with the ability to build and maintain scalable, event-driven applications.
  • Experience with other data streaming tools or platforms is a plus.
  • Familiarity with DevOps practices and tools, including CI/CD pipelines, Docker, and Kubernetes, for building and deploying modern cloud-native applications.
  • Certifications in AWS, Apache Kafka, or related cloud and data streaming technologies are highly desirable.

Numbers & Facts

LocationSt. Paul, MN (
Remote
)

Skills

  • AWS Lambdaunmatched
  • Amazon Elastic Compute Cloud (EC2)unmatched
  • Amazon Simple Storage Service (S3)unmatched
  • Amazon Web Services (AWS)unmatched
  • Analysis Skillsunmatched
  • Apacheunmatched
  • Apache Kafkaunmatched
  • Best Practicesunmatched
  • Cloud Applicationsunmatched
  • Cloud Computingunmatched
  • Communication Skillsunmatched
  • Computer Programmingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Cross-Functionalunmatched
  • Data Analysisunmatched
  • Data Managementunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Scienceunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • Detail Orientedunmatched
  • DevOpsunmatched
  • Distributed Computingunmatched
  • Dockerunmatched
  • Ecosystemsunmatched
  • Identify Issuesunmatched
  • Javaunmatched
  • Needs Assessmentunmatched
  • Performance Analysisunmatched
  • Performance Tuning/Optimizationunmatched
  • Presentation/Verbal Skillsunmatched
  • Problem Solving Skillsunmatched
  • Python Programming/Scripting Languageunmatched
  • Sales Pipelineunmatched
  • Scalable System Developmentunmatched
  • Snowflake Schemaunmatched
  • Software Developmentunmatched
  • Software Engineeringunmatched
  • Streaming Technologyunmatched
  • Team Playerunmatched
  • Writing Skillsunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder