Data Engineer

We are seeking a highly skilled and innovative Data Engineer to join our team in the greater DMV area, supporting the Army National Guard.

Responsibilities

• Lead design, build, and optimization of data pipelines to ingest, normalize, and store logs, events, and telemetry for SOC, DCO, vulnerability management, CDAP, and analytics use cases.
• Implement schemas, mappings, ETL/ELT logic, and data models to support correlation, threat hunting, reporting, dashboards, and RMF/CCRI evidence generation.
• Onboard and integrate new data sources (OT/DCI telemetry, threat feeds, CDAP outputs, cloud logs), ensuring proper parsing, enrichment, and normalization.
• Monitor data quality, latency, completeness, and pipeline reliability; identify gaps and implement remediation or fallback strategies.
• Collaborate with detection engineers, analysts, and data consumers to translate analytic requirements into pipeline designs and delivery SLAs.
• Develop and maintain data flow documentation, schemas, codebooks, and lineage artifacts to support traceability and auditability.
• Implement data retention, partitioning, and storage optimization patterns to balance performance, cost, and forensic requirements.
• Build automated validation, testing, and observability for pipelines (data health checks, anomaly detection, alerting).
• Support production troubleshooting, incident response data needs, and timely delivery of evidentiary exports for assessments.
• Mentor junior engineers and drive continuous improvement of data engineering practices and tooling.

#ENOCS

Qualifications

• Minimum of 8 years with BS/BA; Minimum of 6 years with MS/MA; Minimum of 3 years with PhD

• Clearance: Active TS/SCI clearance.

• Candidate must meet ONE of the following:

  • Master’s degree in Computer Science, Engineering, Information Technology, Data Science, or a related field; OR
  • Relevant DoD/military training (example: SANS SEC545 (Cloud Security Architecture)); OR
  • Relevant professional certification or equivalent experience (examples: AWS Certified Solutions Architect – Professional; Microsoft Certified: Power Platform Solution Architect Expert; Microsoft Certified: Azure Solutions Architect Expert; CISSP‑ISSAP).

• Required experience and skills:

  • Data engineering, analytics pipeline, or platform engineering experience with at least 3 years building large‑scale telemetry/log pipelines for security or operations use cases.
  • Strong expertise in ETL/ELT design, schema design, data modeling, stream/batch processing (Kafka, Spark, Flink, etc.), and data storage technologies (Elasticsearch, Splunk, data lake, cloud data warehouses).
  • Proficiency in programming/scripting (Python, Java, Scala), infrastructure as code, and CI/CD for data pipelines.
  • Experience with data quality frameworks, observability (metrics/logs/tracing), and automated validation/testing of ingestion pipelines.
  • Familiarity with security telemetry (IDS/IPS, EDR, network flows), threat intelligence feeds, CDAP outputs, and requirements for RMF/CCRI evidence and auditability.
  • Ability to produce data lineage, codebooks, and documented data flows for auditors and analysts.

• Desired:

  • Prior DoD/ARNG/enterprise experience integrating classified and unclassified telemetry sources.
  • Experience optimizing storage/cost for high‑volume telemetry and implementing secure cross‑domain data handling patterns.
  • Familiarity with SOC analytic platforms, detection engineering workflows, and delivery of data for threat hunting and CDAP analyses.

#ENOCS

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.