Kafka Platform Engineer

DCM INFOTECH LIMITED

Columbus, OH

JOB DETAILS
SKILLS
Acceptance Testing, Apache Kafka, Application Programming Interface (API), Brokerage, Capacity and Performance Management, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, DevOps, Disaster Recovery, Enterprise Architecture, GitHub, Identify Issues, Information/Data Security (InfoSec), Microservices, Microsoft Windows Azure, OAuth, Performance Tuning/Optimization, Quality Assurance, REST (Representational State Transfer), Replication and Remote Mirroring, Reporting Dashboards, SASL (Simple Authentication and Security Layer), SSL-TLS (Secure Socket Layer - Transport Layer Security), Software Engineering, Systems Administration/Management, Technical/Engineering Design
LOCATION
Columbus, OH
POSTED
2 days ago

Description:

• Design and implement Confluent Cloud environments across Development, QA, UAT, and Production.

• Configure Kafka clusters, topics, partitions, replication policies, and retention settings.

• Establish environment standards, naming conventions, and deployment procedures.

• Implement multi-region and disaster recovery strategies where required.

• Integrate applications, databases, cloud services, and enterprise systems with Kafka.

• Configure and manage Confluent Cloud connectors.

• Implement event-driven architecture and streaming integration patterns.

• Monitor platform health, throughput, consumer lag, and broker utilization.

• Troubleshoot producer, consumer, and connectivity issues.

• Configure alerts and operational dashboards.

• Support platform upgrades, performance tuning, and capacity planning.

• Automate Kafka infrastructure deployment using Infrastructure as Code (Terraform preferred).

• Integrate Kafka deployments into CI/CD pipelines.

• Collaborate with enterprise architects, integration teams, cloud engineers, and business stakeholders.

• Conduct technical design reviews and architecture discussions.

Kafka & Confluent - Apache Kafka architecture and administration, Kafka Producers and Consumers, Kafka Connect, Schema Registry, Stream Governance, Kafka topic design and partitioning strategies.

Cloud Platforms - Experience with Microsoft Azure Integration Technologies - REST APIs, Event-driven architecture, Microservices integration, Data streaming platforms Security - SASL/SSL, Oauth, RBAC, API Key management DevOps – Terraform, GitHub/GitLab/Azure DevOps, CI/CD pipelines, Infrastructure as Code

About the Company

D

DCM INFOTECH LIMITED