Description

Captivation Software is looking for a principal Data Flow Engineer is a senior technical leader responsible for designing, integrating, and sustaining enterprise-scale dataflow architectures that support mission-critical analytics across secure cloud and distributed environments. This role oversees high-availability Linux and Cloudera Hadoop infrastructures, develops and maintains end-to-end dataflow solutions using technologies such as Niagara files and XKS, and ensures reliable, secure, and compliant data ingestion, processing, and delivery. The position also leads automation, monitoring, troubleshooting, and DevOps initiatives to improve system performance and operational efficiency while coordinating across engineering, operations, analytics, and stakeholder teams to deploy scalable, resilient, and mission-focused dataflow capabilities.

Responsibilities

• Lead the design, integration, and sustainment of complex enterprise dataflow architectures supporting mission-critical analytics, ensuring reliable ingestion, processing, routing, and delivery across large-scale cloud and distributed environments
• Manage and optimize high-availability Linux and Cloudera Hadoop cloud infrastructures, including virtual machines, storage containers, and enterprise data repositories, to support thousands of secure operational dataflows
• Engineer and maintain end-to-end dataflow solutions using technologies such as Niagarafiles and XKS, and related processing systems, ensuring schema compatibility, metadata integrity, and proper data governance throughout the lifecycle
• Develop and implement monitoring, troubleshooting, and automation strategies utilizing system instrumentation, cron scripting, logging, and operational monitoring tools to improve system continuity, performance, and incident response capabilities
• Provide technical leadership for DevOps and Agile/Scrum initiatives, including task prioritization, workflow modernization, requirements management, and cross-functional coordination to improve operational efficiency and team performance
• Ensure compliance with enterprise security, classification, and data handling requirements by applying deep knowledge of intelligence community governance policies, access controls, and secure data routing methodologies
• Coordinate across engineering, operations, analytics, and stakeholder organizations to deploy new capabilities, transition systems into production, establish standard operating procedures, and support enterprise-wide mission objectives through scalable and resilient dataflow solutions.

Requirements

Security Clearance:

• Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen

Minimum Qualifications:

• Bachelor's degree in a Qualified Engineering Field or related discipline from an accredited college or university with twenty (20) years of systems engineering experience.
• A High School Diploma or GED plus twenty-four (24) years of general systems engineering experience 
• A Master's degree in a Qualified Engineering Field or a related discipline from an accredited college or university plus eighteen (18) years of systems engineering experience.

This position is open for direct hires only. We will not consider candidates from third party staffing/recruiting firms.