AI/ML Software Engineer

Macpower Digital Assets Edge Private Limited

Annapolis, MD(remote)

JOB DETAILS
SALARY
$120,000–$149,000 Per Year
SKILLS
Apache, Application Programming Interface (API), Artificial Intelligence (AI), Benchmarking, Cloud Applications, Computer Science, Cross-Functional, Data Management, Data Processing, Data Recovery, Data Science, Docker, GPU (Graphics Processing Unit), Git, Government, Hybrid Cloud, Integration Testing, Machine Learning, Mathematics, Middleware, Modeling Languages, Neo4j, Performance Tuning/Optimization, PostgreSQL, Python Programming/Scripting Language, Relational Databases (RDBMS), SQL Databases, Service-Oriented Architecture (fka Distributed Object Architecture), Software Design, Software Engineering, Source Code/Configuration Management (SCM), System Integration (SI), Technical/Engineering Design, Test Plan/Schedule, Unit Test, Web Programming
LOCATION
Annapolis, MD(remote)
POSTED
12 days ago
Position Overview: We are seeking an experienced AI/ML Software Engineer to design and build production-grade tools for the Maryland Judiciary. The successful candidate will integrate AI/ML techniques to automate tasks, assist internal staff, and enhance the digital experience for external users. This role focuses on developing intelligent systems within hybrid cloud environments, often optimizing for resource-constrained settings.
  • Location: Remote (Annapolis, MD - Requires 2 initial days onsite)
  • Salary Range: $120,000 - $149,000 USD
  • Industry: Public Sector / Government
Key Responsibilities:
  • Design and implement software systems that integrate AI/ML techniques to automate specific tasks with high accuracy.
  • Develop agent architectures, workflows, and system designs in collaboration with cross-functional teams.
  • Build and deploy containerized applications within hybrid cloud environments.
  • Determine optimal approaches for technical challenges, including the selection between LLM-based and non-LLM techniques.
  • Optimize system performance for environments with limited computational resources and minimal GPU availability.
  • Create robust testing and evaluation pipelines, including the generation of synthetic data for benchmarking.
  • Develop unit and integration tests for AI-enabled workflows and backend data pipelines.
  • Document all system designs, technical decisions, and workflows to ensure production-grade quality.
  • Contribute to high-level decision-making regarding data processing and retrieval strategies.
Minimum Requirements:
  • Bachelor of Science in Computer Science, Engineering, Data Science, Mathematics, or a related field.
  • At least 3 years of experience in data science, machine learning, or applied AI development.
  • At least 3 years of experience in software engineering, architecture, or web development.
  • Proven proficiency in Python for developing production-grade backend services, APIs, and middleware.
Preferred Experience:
  • Collaborating with Large Language Models (LLMs) via API-based integration and local deployment.
  • Implementing RAG systems using embedding models, vector similarity, re-ranking, and graph retrieval.
  • Working with SQL/relational databases (e.g., PostgreSQL) and graph databases (e.g., Neo4j, Apache AGE).
  • Fine-tuning small language models or embedding models.
  • Designing multi-agent or task-oriented AI systems.
  • Utilizing version control (Git) and containerization (Docker) within service-oriented architectures.

About the Company

M

Macpower Digital Assets Edge Private Limited