Overview
The AI Development and Enablement Analyst supports the Bank's responsible adoption of artificial intelligence by designing, building, testing, publishing, and maintaining approved AI agents and related automation capabilities. This role helps translate business needs into practical, governed AI solutions that improve efficiency, improve access to internal knowledge, support process consistency, and mature the Bank's use of AI in a safe, controlled, and measurable manner.
The position is responsible for creating and supporting centrally published agents, validating agents developed by other Bank groups or third parties, maintaining the inventory of AI use cases and published agents, and partnering with Technology, Information Security, Risk, Compliance, Legal, Audit, Model Risk Management, and business stakeholders to ensure AI solutions are aligned with approved standards, governance expectations, and business objectives. The analyst serves as a hands-on builder, tester, documentation owner, and lifecycle support resource for AI agents across the Bank.
What You'll Do
- Design, build, configure, test, publish, and support approved AI agents using Bank-approved platforms such as Microsoft Copilot Studio, Microsoft 365 Copilot, enterprise knowledge sources, workflow automation tools, and other approved AI capabilities.
- Partner with business units to evaluate AI use case requests, clarify business objectives, define scope, identify intended users, document expected outputs, and establish appropriate guardrails before development or deployment.
- Develop and maintain agent instructions, prompts, knowledge source configurations, connectors, fallback responses, disclaimers, source citation requirements, and escalation instructions to support accurate and reliable responses.
- Perform structured testing of AI agents before release, including expected answer testing, source grounding validation, boundary testing, unauthorized information request testing, hallucination checks, prompt injection or misuse testing, and user acceptance testing.
- Review, test, and maintain AI agents or AI-enabled solutions created by other Bank teams, citizen developers, vendors, or third parties to ensure alignment with Bank standards, approval conditions, access controls, and lifecycle requirements.
- Maintain the enterprise inventory of AI use cases, approved tools, published agents, agent owners, business purposes, knowledge sources, risk classifications, review dates, test results, deployment status, exceptions, and retirement status.
- Coordinate with the Application and Architecture Review Board, Technology Steering Committee, Information Security, Model Risk Management, Legal, Compliance, Audit, Third Party Risk Management, and business owners to support governance review and approval processes.
- Monitor published agents after release by reviewing usage, user feedback, failed searches, inaccurate responses, escalation activity, knowledge source freshness, access issues, and other operational indicators.
- Create and maintain documentation for each published agent, including purpose, scope, data sources, permissions, ownership, test evidence, change history, known limitations, support procedures, and periodic review records.
- Support ongoing maintenance of AI agents by updating instructions, refreshing knowledge sources, adjusting configurations, remediating defects, retiring outdated agents, and ensuring changes are documented and approved as required.
- Develop metrics, dashboards, and management reporting related to AI use cases, agent adoption, user feedback, operational performance, control effectiveness, issue remediation, and AI maturity progress.
- Assist with AI awareness, training, and enablement activities by helping users understand appropriate AI use, effective prompt practices, agent limitations, responsible use requirements, and procedures for requesting new AI capabilities.
- Identify opportunities to use AI to improve efficiency, reduce repetitive work, improve knowledge retrieval, strengthen quality control, and support measurable business outcomes while maintaining appropriate human oversight and accountability.
- Stay current on AI platforms, agent design practices, governance expectations, security considerations, vendor capabilities, and emerging risks relevant to responsible AI use in banking.
- Compliance Training: Participate in all required compliance training, including Bank Secrecy Act/anti-money laundering training, as well as internal and external training programs, online training, meetings, and seminars/conferences, etc.
- Other Duties: This job description is not designed to cover or contain a comprehensive list of activities, duties or responsibilities that are required of the employee. Other duties, responsibilities and activities may change or be assigned at any time with or without notice.
Requirements For Success
Education:
- Bachelor's degree in Information Technology, Computer Science, Data Analytics, Business Analytics, Management Information Systems, or a relevant field, or equivalent work experience preferred.
Experience:
- 2+ years of experience in technology, business analysis, data analysis, automation, software support, digital transformation, enterprise applications, or a related technology role preferred.
- Experience building, configuring, testing, or supporting AI agents, chatbots, virtual assistants, workflow automations, RPA solutions, or low-code/no-code applications preferred.
- Experience with Microsoft 365, Microsoft Copilot, Copilot Studio, Power Platform, SharePoint, Teams, ServiceNow, Wrike, GitHub, Jira, or similar enterprise platforms preferred.
- Experience documenting business requirements, test cases, user acceptance testing, operating procedures, inventories, dashboards, and control evidence.
- Banking, financial services, risk management, compliance, audit, information security, or third-party vendor governance experience is a plus.
Required Skills:
- Strong analytical skills with the ability to translate business needs into practical technology solutions and controlled AI use cases.
- Ability to understand AI agent behavior, knowledge source management, user permissions, data sensitivity, and the operational risks associated with AI-generated outputs.
- Strong written and verbal communication skills with the ability to communicate effectively with technical teams, nontechnical business users, risk partners, and executives.
- Ability to write clear instructions, prompts, test scripts, support documentation, user guidance, and executive-level summaries.
- Ability to perform detailed testing, identify gaps, document issues, validate remediation, and maintain repeatable evidence of agent performance and controls.
- Ability to manage multiple use cases and competing priorities while maintaining attention to detail, documentation quality, and governance discipline.
- Ability to work cross-functionally with Technology, Information Security, Risk, Compliance, Legal, Audit, Model Risk Management, Third Party Risk Management, and business stakeholders.
- Proficiency with Microsoft Office Suite, especially Word, Excel, PowerPoint, Teams, SharePoint, and Visio.
Preferred Skills:
- Microsoft Copilot Studio or Power Platform experience.
- Familiarity with AI governance, responsible AI practices, NIST AI Risk Management Framework concepts, model risk management, and third-party AI oversight.
- Experience with prompt engineering, retrieval-augmented generation concepts, knowledge source curation, application testing, access controls, and lifecycle management.
- Experience developing metrics, dashboards, reports, and management-ready status updates.
- ITIL, Microsoft, Power Platform, AI, data analytics, cybersecurity, or business process improvement certification is a plus.
Conditions of Employment
- Must be able to pass a criminal background & credit check
FLSA Status: Exempt
Supervisory Responsibility
This position does not manage employees
Working Environment and Physical Demands
This job operates in a professional office environment. The role routinely uses standard office equipment such as computers, phones, copy machines, and printers.
Physical requirements: sedentary, climbing, standing, stooping, or typing
Position requires schedule flexibility to work evenings and weekends as needed.
This position requires up to 50% travel.
Position Type
This is a full-time position
Other
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.
Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Pay Range
USD $60,466.00 - USD $93,119.00 /Yr.