Principal AI Engineer - Java

ApTask
  • NYC, NY
  • $170,000–$200,000 Per Year
  • Quick Apply
2 days ago

Job Description

About Client:
The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare, manufacturing, government, transportation, communications, and consumer and retail industries.



Salary Range: $170K-$200K/Annum



Job Description:
  • 8 14 years of software engineering experience, with strong hands-on large-scale Python
  • Working depth in at least one systems or backend language Go, Rust, Java, or C/C++ and the judgment to know when to reach for it
  • Strong data structures and algorithms.
  • Strong understanding of APIs, microservices, and system design
  • Hands-on experience building and operating data pipelines and production-grade distributed systems.
Agentic AI and LLMs
  • 2+ years of hands-on LLM engineering, with at least couple agentic system you designed and took to production
  • Production experience with agent frameworks LangGraph, Google ADK, CrewAI, Claude Agent SDK, or equivalent and the fluency to move between them as the ecosystem evolves
  • Experience building MCP (Model Context Protocol) servers and tool-calling interfaces
  • RAG from first principles: chunking strategy, embeddings, vector and hybrid retrieval, reranking, and response validation
  • Strong experience with vector databases (Milvus, Pinecone, Weaviate, FAISS, etc. or cloud equivalents)
  • Design of guardrails and reliability patterns validators, policy checks, self-correction loops, deterministic fallbacks, circuit breakers, and rollback paths
Optimization
  • Deep familiarity with token optimization and context-window management context shaping, pruning, and compaction
  • Latency and cost optimization through caching, model routing, batching, streaming, and parallel tool calls
  • Performance testing and tuning systems against defined SLOs
Evaluation
  • Experience building evaluation frameworks for LLM systems offline eval sets, continuous online evaluation, and regression detection
  • Instrumentation and traceability suitable for regulated enterprise environments using tools like LangSmith, Langfuse, etc.
Cloud
  • Hands-on AWS: containerized services (ECS/EKS), serverless (Lambda), data services (S3, DynamoDB, Redshift) and orchestration (Step Functions); Azure or GCP equivalents also valued
  • Familiarity with CI/CD pipelines and DevOps practices
  • Infrastructure as code with Terraform or CloudFormation, and mature CI/CD practice
Working traits
  • Strong analytical problem-solving with a bias to ownership and urgency
  • Clear cross-team communication, working directly with client stakeholders to translate business problems into technical roadmaps
  • Able to work productively in ambiguity from system-level documentation and ramp quickly in unfamiliar codebases
  • Good to Have
  • Experience with managed AI platforms Amazon Bedrock, Vertex AI, Azure AI paired with fluency in the underlying fundamentals
Roles & Responsibilities:
  • Design and build agentic systems: Lead the architecture and implementation of tool-calling agents that combine retrieval, structured reasoning, and secure action execution with least-privilege access.
  • Productionize LLM applications: Build retrieval pipelines, prompt synthesis, response validation, and self-correction loops, backed by rigorous evaluation.
  • Own the full stack: Deliver the data pipelines, backend services, distributed compute, and orchestration layer that agentic systems depend on not only the model invocation.
  • Engineer for reliability and governance: Build validator models, adversarial test suites, and policy checks; enforce deterministic fallbacks and rollback strategies; instrument continuous evaluation.
  • Optimize for cost and latency: Drive measurable improvements in token efficiency, response time, and unit economics against defined SLOs.
  • Codebase ownership: Build, maintain, and review high-quality Python and SQL, with an emphasis on reusable components, scalability, and performance.
  • Cloud integration: Deploy AI applications on AWS, Azure, or GCP with optimized resource usage and robust CI/CD.
  • Cross-functional collaboration: Partner with product owners, data scientists, and business SMEs to define requirements and deliver impactful AI products.
  • Mentoring and technical leadership: Set engineering standards and share knowledge across the team, raising the bar on AI and software engineering practice.




About ApTask:
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-owned company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.

If you have any concerns or queries about your personal information, please feel free to contact our compliance team at compliance@aptask.com.

Applicant Consent:
By submitting your application, you agree to ApTask's (www.aptask.com) Terms of Use and Privacy Policy, and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at 732-355-8000 or help@aptask.com. Message frequency may vary. Msg & data rates may apply.

About ApTask:
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-owned company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.

If you have any concerns or queries about your personal information, please feel free to contact our compliance team at

businessexcellence@aptask.com

ompliance@aptask.com

.

Applicant Consent:
By submitting your application, you agree to ApTask's (www.aptask.com) Terms of Use and Privacy Policy, and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at 732-355-8000 or help@aptask.com. Message frequency may vary. Msg & data rates may apply.

Numbers & Facts

LocationNYC, NY
Salary$170,000–$200,000 Per Year

Skills

  • AWS Lambdaunmatched
  • Algorithmsunmatched
  • Amazon Simple Storage Service (S3)unmatched
  • Amazon Web Services (AWS)unmatched
  • Analysis Skillsunmatched
  • Application Programming Interface (API)unmatched
  • Artificial Intelligence (AI)unmatched
  • C Programming Languageunmatched
  • C++ Programming Languageunmatched
  • Cachingunmatched
  • Circuit Breakersunmatched
  • Cloud Computingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Cost Controlunmatched
  • Cross-Functionalunmatched
  • Data Managementunmatched
  • Data Scienceunmatched
  • Data Structuresunmatched
  • DevOpsunmatched
  • Distributed Computingunmatched
  • Documentationunmatched
  • Economicsunmatched
  • Ecosystemsunmatched
  • Engineeringunmatched
  • Financeunmatched
  • Financial Servicesunmatched
  • GCP (Good Clinical Practices)unmatched
  • Governmentunmatched
  • Healthcareunmatched
  • Information Technology Consultingunmatched
  • Information/Data Security (InfoSec)unmatched
  • Instrumentationunmatched
  • Insuranceunmatched
  • Javaunmatched
  • MCP - Microsoft Certified Professionalunmatched
  • Management of Information Systems/Technology (MIS)unmatched
  • Manufacturingunmatched
  • Mentoringunmatched
  • Microservicesunmatched
  • Microsoft Windows Azureunmatched
  • Model Validationunmatched
  • Performance Testingunmatched
  • Performance Tuning/Optimizationunmatched
  • Problem Solving Skillsunmatched
  • Process Improvementunmatched
  • Project/Program Managementunmatched
  • Python Programming/Scripting Languageunmatched
  • Reliability Engineeringunmatched
  • Requirements Managementunmatched
  • Retailunmatched
  • Rust Programming Languageunmatched
  • SQL (Structured Query Language)unmatched
  • Shallow Parsingunmatched
  • Short Messaging Service (SMS)unmatched
  • Software Developmentunmatched
  • Software Engineeringunmatched
  • Speech Technologyunmatched
  • Systems Analysisunmatched
  • Technical Leadershipunmatched
  • Test Suiteunmatched
  • Traceabilityunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder