Use case #0003

Regulatory quiz delivery: how AI tests staff on every new bulletin

A Fed / OCC bulletin that is distributed to staff via email has been communicated. It has not been understood. The difference between communication and comprehension is the gap that produces compliance failures — a collections officer who received the bulletin about permitted contact hours but did not understand that the restriction applies to all forms of contact, not just phone calls, may send a WhatsApp message to a borrower at 9 PM and believe they are compliant. The Training & Certification Agent AI converts every significant regulatory bulletin into a targeted knowledge assessment — a 5 to 8 question quiz delivered to the specific staff roles the bulletin affects, within 10 days of the bulletin's publication, with results that tell the compliance team exactly which staff understood the change and which did not.

Why communication without testing is not staff training — and what the difference reveals

When an Fed / OCC bulletin is distributed, most institutions consider the training obligation met: the bulletin was forwarded, the email went out, the policy update was distributed. This is the minimum standard. The question the institution has not answered is: did staff actually understand what changed and what they are now required to do differently? The answer to this question is materially important because regulatory examination findings on staff training are not about whether bulletins were forwarded — they are about whether staff are operating in accordance with the regulatory changes. An institution can demonstrate communication without demonstrating comprehension. Only a knowledge assessment demonstrates comprehension.

The Training & Certification Agent AI converts the Policy & Ops Manual Agent AI's bulletin analysis — which already identifies the specific operational changes each bulletin requires — into quiz questions targeted at the staff roles who must change their behavior. A bulletin about KFS disclosure requirements generates questions for RMs and credit staff, not for the accounts team. A bulletin about collections conduct generates questions for collections staff and branch managers, not for the KYC / CIP team. The targeting ensures the quiz is relevant to the recipient, which improves completion rates and produces more actionable knowledge gap data.

"Forwarding a bulletin proves that the compliance team read it. A quiz that 84% of collections staff pass proves that the collections team understands what it requires of them. These are different evidence types with different regulatory value."

The regulatory quiz: Fed / OCC/DOR/2025-26/84 — Digital Lending Framework Amendment

Circular Knowledge Quiz — Fed / OCC/DOR/2025-26/84 · Delivered Nov 18, 2025
Target audience: RMs, Credit Officers, Operations · 8 questions · 10-day completion window · Pass score: 70%
CircularFed / OCC/DOR/2025-26/84
Effective dateDecember 1, 2025
Staff targeted284 staff (RMs, Credit, Ops)
Completion deadlineNovember 28, 2025
Question 1 of 8
From December 1, 2025, when must you disclose the existence of an FLDG (First Loss Default Guarantee) arrangement to a borrower?
A. After the loan is sanctioned, in the approval letter
B. Before the loan is accepted, as part of the Key Fact Statement (KFS) ✓
C. Only if the borrower asks about the arrangement
D. At disbursement, in the loan agreement
The bulletin requires FLDG disclosure before loan acceptance, in the KFS. Not after sanction, not on borrower request, not at disbursement. Pre-acceptance disclosure is the requirement. [Fed / OCC/DOR/2025-26/84, Para 3.2]
Question 2 of 8
The updated KFS template (effective December 1) must now include two new mandatory fields. What are they?
A. Recovery agent contact details AND a grievance escalation contact ✓
B. Processing fee and documentation charges only
C. Co-lending partner name and the FLDG percentage
D. Total interest payable over the loan tenor and the APR
Para 4.1 of the bulletin requires two specific additions to the KFS: (1) recovery agent contact details, and (2) a grievance escalation contact. These are distinct from other existing KFS fields. [Fed / OCC/DOR/2025-26/84, Para 4.1]
Question 3 of 8
How frequently must LSP (Loan Service Provider) performance reviews now be conducted under the updated guidelines?
A. Annually — once per year
B. Bi-annually — twice per year
C. Quarterly — four times per year ✓
D. Monthly — every month
The previous requirement was annual. The bulletin upgrades this to quarterly (4 times per year). This affects Operations and Compliance staff who manage the LSP review process. [Fed / OCC/DOR/2025-26/84, Para 5.4]
Question 4 of 8
A borrower takes a digital loan under an FLDG arrangement with a co-lending partner. What must the KFS disclose about the co-lending partner?
A. The co-lending partner's name only
B. The FLDG percentage and the co-lending partner's credit rating
C. That an FLDG arrangement exists, the co-lending partner's identity, AND that the arrangement does not change the borrower's rights or loan terms ✓
D. Nothing — FLDG arrangements are confidential commercial arrangements
The disclosure has three required elements: (i) that an FLDG arrangement is in place; (ii) the co-lending partner's identity; and (iii) that the arrangement does not alter the borrower's rights or the loan terms. All three must be disclosed. [Digital Lending Policy v4.3, Section 8.3(d)]
Institution-wide results (284 staff, Nov 18–26)
81.4% average score · 88.7% pass rate
Question 4 scored lowest (68.2%) — many staff did not know all 3 disclosure elements · Remediation briefing sent
Knowledge gap identified
Q4 (3-element FLDG disclosure) — 32 staff
scored below 60% on this question
→ Targeted WhatsApp re-brief sent Nov 27
● 284 staff targeted · 252 completed (88.7% in window) · 81.4% avg score · Q4 knowledge gap → remediation brief sent · Quiz completion counts toward staff training record

What the quiz results reveal — and how the compliance team acts on them

Result categoryStaff countWhat it meansTraining AI action
Passed (≥70%) · All 8 questions above threshold 224 of 252 who completed Staff understood the bulletin's operational requirements · Behavior change likely · Compliance risk: low Certificate of bulletin completion issued · Logged in training record · No further action
Failed (<70%) but above 50% · Partial understanding 18 of 252 Staff understood some but not all changes · Risk that specific provisions they missed will not be applied correctly Re-sit of failed sections · Targeted explanation for missed questions · Re-assessment within 5 days
Failed (<50%) · Poor understanding 10 of 252 Staff did not adequately understand the bulletin · High compliance risk for their specific role Mandatory 1:1 session with compliance officer or branch compliance designate · Full re-assessment · Supervisor notified
Did not complete quiz in window 32 of 284 Communication received but not engaged with · Training obligation not met Same escalation sequence as module non-completion: +1 day reminder, +3 day supervisor alert · Circular quiz completion is mandatory same as modules
Question-level knowledge gap (Q4 across all staff) 32 staff below 60% on Q4 Specific provision (3-element FLDG disclosure) not understood broadly — systemic training gap on this provision Targeted WhatsApp re-brief with visual explanation of 3 disclosure elements · Not a full re-quiz · Sent to all staff, not just those who scored low on Q4
10 daysCircular to quiz delivery — 8 days after bulletin publication · Staff tested before effective date · Understanding confirmed before December 1
88.7%First-attempt pass rate — 224 of 252 who completed · Targeted quiz for relevant roles produces higher engagement than institution-wide email
Q4: 68%Lowest scoring question — 3-element FLDG disclosure · 32 staff below 60% on this question · Targeted re-brief sent · Systemic gap identified
EvidenceQuiz completion logs in training record — not just "bulletin was forwarded" · Examination team sees pass rates and question-level gaps · Higher evidentiary value

The quiz that identifies 32 staff who did not understand the 3-element FLDG disclosure is the most valuable compliance output the institution produced this week — because it found the gap before December 1, not after the first FDCPA conduct complaint

Without the quiz, the institution would have forwarded the bulletin, updated the policy, and assumed that staff understood the new disclosure requirement. On December 2, an RM would have issued a KFS that included the FLDG existence and the co-lending partner's name but omitted the statement that the borrower's rights are not affected — missing one of the three required elements. The borrower would have had grounds for a complaint, the complaint would have reached the Ombudsman, and the institution would have had a regulatory finding on a provision it believed it had trained staff on. The quiz identified the gap on November 26. The targeted re-brief reached all 284 staff on November 27. The December 1 effective date arrived with staff who knew all three elements — because the quiz proved they did not know all three, and the institution fixed the gap before the regulation took effect. Testing is not the training. It is the evidence that the training worked — and the mechanism that identifies when it did not.

← Back to Training & Certification Agent AI