NewSr. AI Software Engineer (C#/.Net, infrastructure & startup exp. req'd) - 100% REMOTE JobotSr. AI Software Engineer (C#/.Net, infrastructure & startup exp. req'd) - 100% REMOTENew York City, NYRemote$170,000–$270,000 / yearThe ideal candidate will be mid-level backend .Net Software Engineer with recent experience within a small, fast-paced, API-focused AI infrastructure startup company with lean, highly collaborative engineering teams, where they have operated with significant ownership, autonomy, and a strong “go-getter” mentality. Information collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal.
NewSenior AI Engineer JobotSenior AI EngineerNew York, NY$225,000–$280,000 / yearInformation collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal. The product sits at the intersection of AI, automation, and real world impact, using LLMs and agentic systems to replace hours or weeks of manual work with intelligent, scalable software.
NewAI Risk & Compliance Analyst JobotAI Risk & Compliance AnalystNew York, NY$70–$80 / hourAs AI adoption continues to expand across the business, our Governance, Risk & Compliance team plays a critical role in helping teams evaluate, document, and manage AI use cases in a practical, thoughtful, and compliant way. The contractor will be expected to make an immediate impact by improving AI use case intake, strengthening risk review workflows, maintaining clear documentation, and helping align AI activities with evolving legal, regulatory, privacy, security, and compliance expectations.
IT Project / Program Manager (PMP / AI & Cloud platform) TRIGYN TECHNOLOGIES, INC.IT Project / Program Manager (PMP / AI & Cloud platform)White Plains, NY$75–$78 / hourContractorThe successful candidate will be responsible for ensuring the successful delivery of projects and use cases in this program by coordinating across teams, managing timelines, budgets, and resources, and maintaining alignment with organizational goals. The ideal candidate will possess deep expertise in IT project management, AI technologies, cloud platforms, and governance structures.
Principal Software Engineer - Responsible AI (CoreAI) MicrosoftPrincipal Software Engineer - Responsible AI (CoreAI)New York, NY$139,900–$274,800 / yearThere is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Bachelors Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, or Python OR equivalent experience.
Member of Technical Staff - Data Engineering Manager - Microsoft AI - Copilot MicrosoftMember of Technical Staff - Data Engineering Manager - Microsoft AI - CopilotNew York, NY$139,900–$274,800 / yearBachelors Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work OR Masters Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
NewSenior Software Engineer II - AI Tooling and Interfaces DoubleVerifySenior Software Engineer II - AI Tooling and InterfacesNew York, NY$107,000–$193,000 / yearSoftware Engineer II in AI Tooling and Interfaces, youll design and build systems purpose-built for AI agents, automations, and decisioning engines that drive real outcomes for our clients and internal teams. If you enjoy turning high-volume data into clean, powerful systems—and you want your work to drive real business outcomes rather than just dashboards—this role puts you right at the center of the action.
Internal Audit AVP- AI BarclaysInternal Audit AVP- AINew York, NYYou may be assessed on the key critical skills relevant for success in this role, such as risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, as well as job-specific technical skills. Relevant professional certifications such as Certified Information Systems Auditor (CISA), Certified Information Systems Security Professional (CISSP), Certified in Risk, and Information Systems Control (CRISC), or ISACA Advanced in AI Audit (AAIA).
NewStaff AI Engineer Grafana LabsStaff AI EngineerNew York, NYRemote$174,986–$209,983 / yearYou’ll define the technical direction for the automation platform (data models, API contracts, shared libraries, reference architectures) and partner with Data Engineering, GTM Systems, and Field Operations to build scalable, self-service automation that eliminates manual work and drives operational efficiency. Today, more than 35 million users and 7,000+ customers – including Anthropic, Bloomberg, NVIDIA, Microsoft, and Salesforce – trust Grafana Labs to ensure reliability of their applications and systems, resolve incidents quickly, and optimize their telemetry to reduce noise and cost.
NewSenior AI Engineer Grafana LabsSenior AI EngineerNew York, NYRemote$154,445–$185,334 / yearYou’ll define the technical direction for the automation platform (data models, API contracts, shared libraries, reference architectures) and partner with Data Engineering, GTM Systems, and Field Operations to build scalable, self-service automation that eliminates manual work and drives operational efficiency. Today, more than 35 million users and 7,000+ customers – including Anthropic, Bloomberg, NVIDIA, Microsoft, and Salesforce – trust Grafana Labs to ensure reliability of their applications and systems, resolve incidents quickly, and optimize their telemetry to reduce noise and cost.
NewRevenue Manager (AI/Tech) Vaco LLCRevenue Manager (AI/Tech)New York, NY$150,000–$180,000Determining compensation for this role (and others) at Vaco by Highspring depends upon a wide array of factors including but not limited to: the individual’s skill sets, experience and training; licensure and certification requirements; office location and other geographic considerations; other business and organizational needs. Industry Tenure: Minimum of 3 years of direct experience in revenue management, pricing strategy, or asset performance roles within multifamily, real estate, or related sectors.
Senior Product Manager - AI Investment Operations, Vice President BlackRockSenior Product Manager - AI Investment Operations, Vice PresidentNew York, NY$162,500–$215,000 / yearTo help you stay energized, engaged and inspired, we offer a wide range of benefits including a strong retirement plan, tuition reimbursement, comprehensive healthcare, support for working parents and Flexible Time Off (FTO) so you can relax, recharge and be there for the people you care about. As a $1BN+ technology platform, Aladdin is increasingly leveraging artificial intelligence to transform investment operations—driving automation, improving data quality, and enabling more intelligent decision-making across the post-trade lifecycle.
NewAI Engineer Kforce Inc.AI EngineerNew York, NY$57–$63This role combines full stack engineering with modern AI technologies, focusing on developing scalable applications and intelligent features that improve developer productivity and system performance. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs.
Member of Technical Staff - Responsible AI (CoreAI) MicrosoftMember of Technical Staff - Responsible AI (CoreAI)New York, NY$139,900–$274,800 / yearThere is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. The CoreAI organization brings together Microsoft’s industry‑leading developer products (such as GitHub and VSCode) with the world’s largest selection of cutting‑edge AI models and tools through Microsoft Foundry.
Vice President, AI Strategy Mutual Of America Life InsuranceVice President, AI StrategyNew York, NY$176,700–$265,100 / yearThis is a strategic role, focused on working with business leaders and technology teams to define the company’s AI strategy and building scalable AI solutions that can be used across the organization. Build partnerships with executive leadership and senior team members to execute on the vision for managing AI projects and applications, to exploit data and AI capabilities to maximize the value.
Full Stack AI Software Engineer BC ForwardFull Stack AI Software EngineerJersey City, NJ$68–$68.25 / hourFull timeThe ideal candidate will have strong experience in full stack development across modern UI frameworks and Python backends and a proven ability to deliver scalable, low-latency, AI-enabled enterprise applications. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Senior GenAI Engineer / AI Engineer BC ForwardSenior GenAI Engineer / AI EngineerJersey City, NJ$68–$68.25 / hourFull timeWith delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity. BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients.
Senior AI Engineer BC ForwardSenior AI EngineerJersey City, NJ$68–$68.25 / hourFull timeThe ideal candidate will have strong experience in end-to-end GenAI solution delivery, data management, and Python engineering, and a proven ability to translate business strategy into actionable, governed AI solutions. We are seeking an experienced Application Programmer III to join our team and lead development for a high-visibility Generative AI initiative focused on document summarization and chatbot capabilities across multiple lines of business.
Senior Python Developer - Generative AI (GenAI) BC ForwardSenior Python Developer - Generative AI (GenAI)Jersey City, NJ$68–$68.25 / hourFull timeThe ideal candidate will have strong experience in Python, GenAI lifecycle management, RAG pipelines, vector databases, and API-first application development and a proven ability to deliver secure, scalable AI-driven applications for document processing, risk analytics, and compliance reporting . With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Technical Program Manager - Generalist (AI/ML) MicrosoftTechnical Program Manager - Generalist (AI/ML)New York, NY$139,900–$274,800 / yearThere is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Coordinate projects and programs including all elements of end-to-end program planning, timelines, milestones, performance metrics, risk anticipation/mitigation and resource needs for programs and product cycles.
NewTechnical Project Manager III (AI/Initiatives) BC ForwardTechnical Project Manager III (AI/Initiatives)New York, NYFull timeThe ideal candidate will have strong experience in planning and coordinating information systems, systems analysis, and software delivery and a proven ability to lead large cross-functional initiatives to successful outcomes . With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
NewAI Engineer - Access Management GenAI (Hybrid) Talent Wave Associates, LLCAI Engineer - Access Management GenAI (Hybrid)New York, NY$90–$100 / hourJoin our client’s team to design and integrate AI capabilities into IAM platforms, enhancing access decisions and governance workflows. As part of our commitment to a fair, consistent, and efficient recruitment process, we may use artificial intelligence (AI) tools to assist in the initial screening of applications submitted through our applicant tracking system.
AI Product Owner - Exempt TTI of USA, Inc.AI Product Owner - ExemptNew York, NY$60–$65 / hourIn this role, you ll make an impact in the following ways: Define, lead, and continuously refine the AI product strategy and roadmap for Credit Services, prioritizing high-value use cases that improve decision quality, reduce manual work, and enhance client and colleague experiences. Demonstrated ability to define product strategy and execute complex deliveries in cross-functional environments; strong backlog management, prioritization, and stakeholder management skills, preferably in Financial Services.
AI Security & Compliance Engineer - Onsite NTT DATAAI Security & Compliance Engineer - OnsiteJersey City, NJ$60–$70 / hourAs part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications development and management, managed edge-to-cloud infrastructure services, BPO, systems integration and global data centers. Outsourcing is not just a method of gaining a one-time cost advantage, but an effective strategy for gaining and maintaining competitive advantages when executed as part of an overall sourcing strategy.
Senior Full Stack Developer - AI, Python and Angular/React BC ForwardSenior Full Stack Developer - AI, Python and Angular/ReactJersey City, NJ$68–$68.25 / hourFull timeThe ideal candidate will have strong experience in Java, Python, data engineering, MCP-based services, AI-enabled applications, APIs, and DevOps and a proven ability to design, deliver, and support enterprise-scale, API-driven platforms end-to-end. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
AI Enablement Specialist Kyndryl IncAI Enablement SpecialistNew York, NY$100,080–$190,080 / yearKyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value.
AI & Product Transformation Manager Sovos Compliance LLCAI & Product Transformation ManagerNY$100,000–$120,000 / yearOperating as a program manager, you''ll lead AI skill-building across the support org, serve as the support-side liaison for major product launches, and make sure every agent has the documentation, training, and tooling they need to succeed---in both English and Spanish. The Work You''ll Do: At Sovos, we''re transforming how companies around the world manage tax compliance---helping half of the Fortune 500 and thousands more stay ahead in a complex, ever-changing global landscape.
Solution Engineer - Cloud & AI Infrastructure Microsoft CorpSolution Engineer - Cloud & AI InfrastructureNY$86,100–$169,800 / yearRequired Qualifications: 3+ years of technical pre-sales or technical consulting experience OR a bachelor's degree in computer science, Information Technology, or related field AND 2+ years of technical pre-sales or technical consulting experience OR a master's degree in computer science, Information Technology, or related field AND 1+ year(s) of technical pre-sales or technical consulting experience OR equivalent experience. You will also apply strong networking knowledge to design hybrid and cloud-native solutions, including virtual networks, VPNs, and secure routing architectures that meet enterprise performance and compliance needs.
AI Architect, Finance ZipHQ IncAI Architect, FinanceNew York City, NY$130,000–$150,000 / yearAs an AI Architect, Finance, you will work directly with enterprise customers to design, deploy, and optimize AI agents across the full AP cycle: invoice inbox, PO and invoice coding, three-way matching, approval workflows, invoice processing, disbursements, payments, and wallet management. Design and Build AP AI Agents: Collaborate with customers to understand their AP and P2P workflows and configure agents that handle invoice intake, GL coding, three-way matching, exception routing, and payment approvals.
Client Success Specialist- AI The Circana GroupClient Success Specialist- AINY$90,000–$100,000 / yearThis role bridges product support, user experience, and development by investigating issues, coordinating resolutions, coaching commercial teams, and managing communication between users, client service teams, and product development. An employee's position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, shift, travel requirements, sales or revenue-based metrics, any collective bargaining agreements, and business or organizational needs.
AI Engineering, Vice President (New York, New Jersey, Toronto) The Goldman Sachs Group IncAI Engineering, Vice President (New York, New Jersey, Toronto)New York, NY$115,000–$180,000 / yearJoin our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. We''re committed to fostering and advancing diversity and inclusion in our own workplace and beyond by ensuring every individual within our firm has a number of opportunities to grow professionally and personally, from our training and development opportunities and firmwide networks to benefits, wellness and personal finance offerings and mindfulness programs.
AI Forward Deployed Engineer Railway Health IncAI Forward Deployed EngineerNew York City, NY$180,000–$225,000 / yearPrototypes or demos do not measure success in this role; it's measured by operational leverage: faster workflows, fewer manual processes, lower costs, and teams that can scale far more efficiently because of the systems you deployed. At most insurance companies, teams such as underwriting, claims, premium finance, member support, care navigation, and sales operations each rely on extensive ecosystems of external vendors and legacy SaaS tools.
AI Forward Deployed Engineer ZipHQ IncAI Forward Deployed EngineerNew York City, NY$130,000–$150,000 / yearAs an AI Forward Deployed Engineer, you will embed directly inside our most strategic accounts, uncover the operational problems that are hardest to see from the outside, and build working solutions using Zips agent infrastructure and AppStudio. You will work where Zips platform meets real enterprise complexity, across procurement, finance, legal, and risk workflows, and you will be expected to see what needs to exist before the customer can articulate it.
Digital Experience & AI Enablement Partner World Economic Forum SwitzerlandDigital Experience & AI Enablement PartnerNY$120,000–$140,000 / yearThis position will lead the adoption and effective use of the Forum's core digital and AI-enabled products across internal teams and external users, while continuously identifying opportunities to streamline workflows through practical automation. The Digital Experience & AI Enablement Partner will report to the Head of Digital Success & Support in Geneva and will work closely with the Intelligent Workplace Product Team and internal stakeholders across the New York and San Francisco offices.
Quantitative AI Strategist DRW Holdings LLCQuantitative AI StrategistNY$175,000–$250,000 / yearPrototype and validate quantitative workflows end-to-end - from data retrieval and signal construction through to strategy evaluation, PnL simulation, testing, and risk/scenario analysis - while defining how the AI should interact with data sources, analytics libraries, desk-specific tools, etc., and work with engineers to deliver them as production platform capabilities. Your job is to make it indispensable - by working directly with trading desks to understand their workflows, building the quantitative and AI capabilities they need to generate better ideas and make better decisions, and partnering with software engineers to deliver them at production quality.
Principal Solution Architect, AI Agents Wolters Kluwer N.V.Principal Solution Architect, AI AgentsNY$146,900–$262,400 / yearIn addition to creating proof-of-concepts to demonstrate best practices and accelerate adoption, you'll play a key role in driving the evolution of the GenAI platform by identifying gaps, proposing enhancements, and collaborating with platform engineering teams to deliver new capabilities. Help product engineering teams design and implement scalable AI solutions that leverage WKs GenAI platform to drive impact in healthcare, legal, tax, and compliance industries.
Data Architect with Snowflake & AI Platforms Capgemini SEData Architect with Snowflake & AI PlatformsNY$90,786–$110,762 / yearArchitect and implement AI‑powered solutions using Snowflake Cortex including Cortex LLM functions, Cortex Search for semantic/vector/RAG capabilities, Cortex Analyst for conversational analytics, Document AI, and integration with external LLMs (e.g., for fine‑tuning, agents, and multimodal data processing). Lead end‑to‑end data architecture and solution design for Snowflake‑based data platforms including logical/physical data models, ingestion patterns (batch, streaming, Snowpipe), storage layers (raw, curated, consumption/semantic), and consumption patterns for analytics, BI, and AI/ML.
Lead Software Engineer - Core AI Zeta Global CorpLead Software Engineer - Core AINY$200,000–$215,000 / yearAs a Lead Software Engineer on our AI Platform Team, you will drive the design and development of the next generation of agentic, reliable, and scalable GenAI platforms supporting state-of-the-art large language models, evaluation systems, and secure developer tooling. Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently.
NewPrincipal or Senior Principal Anthropic AI Solutions East Region Slalom IncPrincipal or Senior Principal Anthropic AI Solutions East RegionNYRemote$157,000–$216,000 / yearLead the design and delivery of enterprise AI solutions using Anthropic technologies, including large language model integrations, agentic workflows, and retrieval-augmented generation pipelines, to drive measurable client outcomes. You spend roughly 40% of your time delivering: architecting Claude-based solutions, leading technical engagements, and acting as the SME on model usage, MCP integrations, agentic workflows, and enterprise deployment patterns.
Medical Academy, AI Enablement & Professional Development Director PfizerMedical Academy, AI Enablement & Professional Development DirectorNew York City, New YorkCandidate demonstrates a breadth of diverse leadership experiences and capabilities including: the ability to influence and collaborate with peers, develop and coach others, oversee and guide the work of other colleagues to achieve meaningful outcomes and create business impact. Stakeholder Management and collaboration: Collaborating with key stakeholders across the organization, such as the Regional Medical Affairs Leadership, broader Medical Engagement and Impact Team, and other relevant teams to ensure alignment and integration of learning program design and delivery.
AI Enablement Specialist KyndrylAI Enablement SpecialistNew York, New YorkKyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value.
AI Forward Deployed Engineer ArloAI Forward Deployed EngineerNew York City, New YorkPrototypes or demos do not measure success in this role; it’s measured by operational leverage: faster workflows, fewer manual processes, lower costs, and teams that can scale far more efficiently because of the systems you deployed. At most insurance companies, teams such as underwriting, claims, premium finance, member support, care navigation, and sales operations each rely on extensive ecosystems of external vendors and legacy SaaS tools.
NewVice President, Product Management - Agentic AI Publicis Groupe SAVice President, Product Management - Agentic AINew York, NY$164,500–$351,000 / yearThis is a critical role at the intersection of AI and the future of marketing - an opportunity to shape how the world's largest brands harness AI to evolve planning, execution, measurement, and optimization of marketing campaigns spanning owned and paid advertising channels in an increasingly autonomous era. As VP of Product Management - Agentic AI, you will own the vision, strategy, roadmap, and commercialization of AI agents and agentic worfklows that deliver measureable outcomes for marketers, agencies, and publishers, ultimately translating to commercial value for Epsilon.
Senior Manager, AI Solutions Architect Salesforce IncSenior Manager, AI Solutions ArchitectNY$172,500–$260,100 / yearOwn agent identity and session design - author and maintain agent context files (identity files, session startup protocols, memory structures, and skill definitions) that govern how agents behave consistently across sessions, users, and evolving workflows. LLM context file design as a craft - knows how to write durable agent context (identity, memory, startup protocols, skill definitions) that holds up across sessions - not one-off prompts, but role-level design.
Java Fullstack Engineer (AI) Capgemini SEJava Fullstack Engineer (AI)NY$61,087–$104,364 / yearIt delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem. Important Notice: Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgemini's discretion, consistent with applicable laws.
Director, AI Product / Program Facilitator Pfizer IncDirector, AI Product / Program FacilitatorNew York City, NY$162,900–$271,500 / yearSubject to further legal review and statutory or regulatory clarification, which Pfizer intends to pursue, reimbursement of recruiting expenses for licensed physicians may constitute a reportable transfer of value under the federal transparency law commonly known as the Sunshine Act. You turn an initiative's goals into a running program: you own the plan and key milestones, drive cadence, manage dependencies and risk, coordinate vendors and contractors, and keep the delivery team, the business sponsor, and the governance functions moving as one.
AI Governance Capgemini SEAI GovernanceBrooklyn, NY$103,330–$128,656 / yearThe disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. Important Notice: Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgemini's discretion, consistent with applicable laws.
Lead AI Engineer, Data Solutions Salesforce IncLead AI Engineer, Data SolutionsNY$172,500–$260,100 / yearThis role focuses on developing intelligent decisioning systems and building an agent flywheel-a system of feedback loops that continuously evaluate, optimize, and improve agent performance over time. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.
Principal AI Engineer Salesforce IncPrincipal AI EngineerNY$172,500–$313,700 / yearYou'll build and maintain the core infrastructure, CI/CD pipelines, and platform services that underpin our machine learning initiatives and go further in designing the harnesses, sandboxes, and evaluation frameworks that let AI agents be developed, tested, and trusted in production. Implement evaluation frameworks for agent behavior using a combination of vendor , open source or in house built tools - covering task success, tool selection accuracy, trajectory evaluation, hallucination rates, latency, and cost.