Company: 1011 United Overseas Bank Ltd
About UOB
United Overseas Bank Limited (UOB) is a leading bank in ASEAN with a global network in Southeast Asia, Asia Pacific, Europe and North America. Operating through our head office in Singapore and banking subsidiaries in China, Indonesia, Malaysia, Thailand and Vietnam, we have a global network of about 430 branches and offices in 19 markets. At the heart of UOB is our culture, shaped by the UOB Way and anchored on our four values – Honourable, Enterprising, United and Committed. For more than 90 years, these values have guided how we do right by our customers, collaborate with one another and create long-term value for the communities we operate in. As One Bank, we are committed to helping our colleagues build sustainable careers grounded in purpose, supported by strong values, and enriched with meaningful opportunities to grow.
Job Description
The team is responsible for driving operational excellence and governance in the adoption of agentic applications across the bank. This role ensures the successful implementation and maintenance of agent-based solutions by defining roadmaps, managing evaluation processes, and embedding responsible AI practices. The position partners with cross-functional teams to deliver secure, efficient, and compliant agentic operations.
Key Responsibilities
Service Operations
- Grow the agent impact through improvement in performance, growth in capabilities and design, build, and roll out for additional users.
- Run the operational processes for agent lifecycle management, including onboarding, configuration, and retirement of agents.
- Monitor agent performance, uptime, and compliance with SLAs.
- Coordinate with business, technology, and innovation teams to integrate agent workflows into incidents, problems, and change management processes.
- Ensure robust logging, audit trails, and reporting agent actions to support transparency and regulatory requirements.
- Drive continuous improvement of service operations through root cause analysis, automation opportunities, and performance optimization.
- Develop and maintain SOPs, FAQs, and user guides to support agentic workflows and ensure clarity for end-users.
Agent Evaluation & Issue Triage
- Apply evaluation frameworks for agent performance, reliability, and compliance.
- Lead issue of triage and resolution processes for agent-related incidents.
- Collaborate with business, technology, and innovation teams to implement corrective actions and improvements.
- Prompt Fine-Tuning
- Craft and optimize prompts, system messages, and few-shot examples to maximize model relevance, accuracy, and cost efficiency.
- Monitor performance metrics (e.g., latency, token usage, output quality) and refine prompts or pipelines as needed.
- Ensure prompt tuning aligns with business objectives and ethical guidelines.
- Constantly monitor and evaluate impacts from regulatory, policy or business-directed changes and update roadmap / prompts accordingly.
Key Skills Required
Core Functional Skills
- Performance Monitoring
- Process Improvement
- Service Lifecycle Management
Technical Skills
- Strong Data Science fundamentals: Experimental design, measurement, error analysis, statistical thinking, evaluation methodology. Hands-on Python experience for prototyping and production-grade experimentation.
- Experience with LLM & Agentic AI systems: Fine-tuning, RAG, prompt optimization, evaluation frameworks
- Applied NLP skills: embeddings, retrieval methods, classification/extraction, calibration, and reliability concepts.
- Responsible AI: bias testing, privacy leakage checks, audit artifacts
Qualifications
- Bachelor’s degree in Data Science, Statistics, Computer Science, Information Systems, or related field
- 5 to 10 years of hands on experience designing, building, and operationalizing end to end AI/ML systems, including data preparation, model development, deployment, and post production monitoring.
- A minimum of 1 to 2 years of dedicated experience working on generative AI and large language model projects.
- Hands-on experience designing prompts, tuning outputs, and integrating large language models (Claude Sonnet 3.5, GPT-class, etc.) into end-user applications.
- Familiarity with AI Agent model evaluation techniques.
- Ability to articulate complex technical concepts to non-technical stakeholders.
- Experience in the banking or financial services industry is a plus.
Additional Requirements
Be a Part of the UOB Family
UOB is an equal opportunity employer. UOB does not discriminate on the basis of a candidate's age, race, gender, color, religion, sexual orientation, physical or mental disability, or other non-merit factors. All employment decisions at UOB are based on business needs, job requirements and qualifications. If you require any assistance or accommodations to be made for the recruitment process, please inform us when you submit your online application.
Apply now and make a Difference