Senior Software Engineer

Qualifications: Master’s degree in computer science or related discipline from an
accredited college or university, plus five (5) years of experience as a SWE, in programs and
contracts of similar scope, type, and complexity.
OR
Bachelor’s degree in computer science or related discipline from an accredited college or
university, plus seven (7) years of experience as a SWE, in programs and contracts of similar
scope, type, and complexity
OR
Nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and
complexity.
Position Description 
The Software Engineer shall possess extensive expertise in dataflow design, data transport
mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer
shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to
ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.
Position Required Skills 
Experience using the Linux CLI and Linux tools
Experience developing Bash scripts to automate manual processes
Recent software development experience using Python and Java
Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
Experience with Distributed Big Data processing engines including Apache Spark
Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
Experience using Jupyter Notebook
Experience with data wrangling and preprocessing using tools such as pandas, NumPy
Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
Familiarity with data quality concepts, data validation, and anomaly detection
Experience with Git Source Control System
Position Desired Skills 
Familiar with HPC Job Scheduling tools including Slurm
Experience using the Atlassian Tool Suite (JIRA, Confluence)