Job Description We are seeking a Software Engineer with a strong focus on data streaming and real-time processing platforms to help design, build, and operate scalable, high-throughput, low-latency systems. This role will work on distributed systems that ingest, process, and deliver streaming data used for analytics, machine learning, monitoring, and mission-critical applications. You will collaborate closely with data engineers, platform engineers, product teams, and infrastructure to ensure reliability, performance, and scalability across streaming pipelines. Responsibilities - Design, build, and maintain scalable data streaming pipelines
- Develop and operate event-driven architectures using streaming technologies
- Implement real-time and near-real-time data processing applications
- Ensure data correctness, ordering, fault tolerance, and exactly-once or at-least-once semantics as required
- Contribute to the design and evolution of streaming platforms and internal data infrastructure
- Build resilient, high-availability services capable of handling large volumes of data
- Optimize systems for throughput, latency, and resource efficiency
- Participate in capacity planning and performance tuning
- Implement monitoring, logging, alerting, and metrics for streaming applications
- Debug production issues related to performance, lag, data loss, or backpressure
- Support on-call rotations and incident response for critical data systems
- Improve automation, deployment pipelines, and operational tooling
- Collaborate with product, analytics, and ML teams to support data use cases
- Write clean, maintainable, and well-tested code
- Participate in design reviews, code reviews, and technical discussions
- Contribute to documentation and engineering best practices
Required Qualifications - Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field (or equivalent practical experience).
- 3+ years of professional software engineering experience.
- Systems Programming: 2+ years of hands-on experience programming real-time applications at the Low-Level / Packet Level using C, C++, or Rust.
- Must be highly comfortable with manual memory management, pointer manipulation, and multi-threaded optimizations.
- Strong experience in a modern concurrency language like Go or Python for stream orchestration, tooling, and control-plane API development.
- Network Protocols: Deep, foundational understanding of UDP and TCP/IP networking mechanics. Direct experience managing socket programming, custom congestion control, packet pacing, and error correction techniques (ARQ / selective retransmission).
- Media Transport: Proven experience with broadcast and linear video workflows, including media containers and multiplexing (specifically MPEG-TS wrappers).
- Experience building custom stream troubleshooting, diagnostic, or real-time monitoring software.
- Codecs: Codec-agnostic architecture mindset with low-level implementation knowledge of H.264/AVC, H.265/HEVC, and emerging standards like AV1.
- Automation & Scripting: Strong scripting capabilities in Python or Bash for stream orchestration, pipeline automation, and local-first systems management.
Preferred Qualifications - Direct development experience with libsrt, librist, RTMP, or similar APIs.
- Deep familiarity with open-source media frameworks like FFmpeg, Astreamer, GStreamer, and low level packet streaming tools.
- Experience using network analysis to debug packet loss, jitter, clock drift, and MTU issues on live networks.
- Familiarity with AWS, GCP, or Azure specifically regarding networking components (firewall traversal, listener/caller architecture, and high-bandwidth ingress).
- Lightweight containerization experience or portable streaming endpoints or edge-compute tools.
- Knowledge of serialization formats (like Protobuf or JSON) strictly for control-plane APIs and performance telemetry aggregation.
|