Sr. Data Engineer (Operations AI)

Mindbank

Monterey, CA

Apply

JOB DETAILS

JOB TYPE

Full-time

SKILLS

AWS Lambda, Algorithms, Amazon Relational Database Service (RDS), Amazon Simple Notification Service (SNS), Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Apache, Apache Kafka, Application Programming Interface (API), ArcGIS, Artificial Intelligence (AI), Business Analysis, Cloud Computing, Communication Skills, Computer Programming, Computer Skills, Computer Systems, Consulting, Cross-Functional, Data Analysis, Data Formats, Data Management, Data Science, Database Administration, Distributed Computing, Elasticsearch, Federal Government, Fortune 1000 Customers, Geospatial Analysis, Go Programming Language (Golang), Government, Government Organizations, High Reliability, Internet Security, Interoperability, JSON, Local Government, Machine Learning, Machine Tool, Military, Performance Management, PostgreSQL, Problem Solving Skills, Python Programming/Scripting Language, R Programming Language, RabbitMQ, Redis, Rust Programming Language, SQL (Structured Query Language), Safety Compliance, Safety Training, Simple Queue Service (SQS), Small Business, Snowflake Schema, Software Engineering, Spatial Data, State Government, Streaming Technology, Team Player, Test Plan/Schedule, Top Secret Clearance, United States Department of Defense (DoD), Willing to Travel, XML (EXtensible Markup Language)

LOCATION

Monterey, CA

POSTED

28 days ago

Mindbank Consulting Group has an immediate need for a Sr. Data Engineer (Operations AI). Sr. Data Engineer (Operations AI) Responsibilities: Collaborate with cross-functional teams to understand and address Navy operational challenges using data pipelines and analytics. Design, develop, and implement data pipelines and analytics for naval applications. Perform exploratory data analysis, algorithm development, and testing. Normalize and structure data to common standards for interoperability. Work with multiple data formats, including CSV, JSON, XML, Parquet, and ORC. Develop and deploy data pipelines and analytics in real-world operational environments. Deploy, monitor, and optimize data pipelines to ensure high performance and reliability. Implement event streaming pipelines using Apache Kafka, AWS Kinesis, RabbitMQ, or ZeroMQ. Utilize distributed computing platforms such as AWS Lambda, Dask, or Spark. Leverage cloud-native tools including AWS S3, RDS, EFS, SNS, and SQS. Utilize data pipeline frameworks such as Airbyte, Apache Airflow, dbt, Apache Iceberg, and Snowflake. Work with GIS data using ArcGIS, PostGIS, and related tooling. Implement containerized environments using Docker or Kubernetes. Apply cybersecurity principles in the context of secure DoD data applications. Communicate findings and engineering solutions effectively with technical and mission stakeholders. Sr. Data Engineer (Operations AI) Required Qualifications: Must have at a minimum an active Top Secret clearance Willingness to travel up to 15%. Strong programming skills in Python, Go, Rust, Pandas, R, SQL, or related languages 10 years of experience as a business analyst, data analyst, data scientist, data engineer, database administrator, geospatial analyst/engineer, machine learning engineer, or software engineer, or related field. Ability to safely carry tools, equipment, and materials aboard ship, including ascending and descending shipboard ladders(stairwells) and navigating confined spaces while maintaining required points of contact. Tools and equipment will weigh no more than 50 lbs. Ability to perform required work aboard Navy vessels and in shipboard environments, including navigating narrow passageways, ascending, and descending ladders (stairwells), working on elevated platforms, and operating in variable sea conditions. Ability to perform activities on a reoccurring basis during shipboard operations or testing evolutions. Ability to comply with Navy safety requirements and wear required personal protective equipment (PPE). Ability to operate in a DDIL office environment. Reasonable accommodations may be provided to enable qualified individuals to meet these requirements and perform the essential functions of the position. Candidates should be prepared to complete a coding exercise as part of the interview process. Sr. Data Engineer (Operations AI) Preferred Qualifications: Experience with large-scale data architecture across secure DoD or government environments. Experience working with NAVWAR, NIWC Pacific, or naval C2/ISR programs. Experience architecting data solutions across multi-domain or cross-domain systems. Familiarity with MLOps practices or deploying analytics/ML-enabled pipelines in classified, cross-domain, or constrained environments. Experience with cloud-native data architecture and API design. Programming experience in Go or Rust. Proven experience designing, developing, and deploying complex data pipelines. Experience working with multiple data formats (e.g., CSV, JSON, XML, Parquet, ORC). Familiarity with event streaming technologies: (e.g., Kafka, AWS Kinesis, RabbitMQ, ZeroMQ). Experience deploying, monitoring, and optimizing operational data pipelines. Expertise in Elasticsearch, Redis, S3, PostgreSQL, or related datastores. Experience with AWS data services (EFS, RDS, S3, SNS, SQS). Experience with distributed computing: AWS Lambda, DASK, Spark. Familiarity with Airbyte, Airflow, dbt, Iceberg, Snowflake. Experience managing, integrating, and retrieving GIS data (ArcGIS, PostGIS). Understanding of cybersecurity principles as applied to data applications and operational environments (including DDIL constraints) Strong analytical and problem-solving skills. Excellent communication skills in a collaborative team environment. Previous experience supporting government agencies or military organizations. Why should you work for Mindbank? Since 1986, Mindbank has helped hundreds of clients solve some of the most complex IT problems through the strategic implementation of solutions and resources. Our clients include US Federal agencies, State & Local Governments, Tribal Organizations, Fortune 1000 companies, as well as Small Businesses. Mindbank believes that our employees deserve the best care that our company can provide. We offer our employees a comprehensive and competitive benefits package including: Medical Insurance Dental Insurance Vision Insurance Life Insurance Long Term Disability Short Term Disability 401 (k) Plan Paid Time Off Training and Education Reimbursement Referral Bonuses As an Equal Opportunity Employer, Mindbank is committed to a diverse workforce and we seek the most qualified candidate for each opening without regard to race, color, religion, age, gender, gender identity, marital status, sexual orientation, national origin, protected veteran status, or disability status.

About the Company

Mindbank

Resume Resources

Free Resume Templates Free Resume Builder