lexplicitcompile report
Cycle
v0.1-statutory-20261031T023534Z
Recorded
2026-10-31T03:18:09Z
Trusted base
de8787d07fbe
Gold set
eba8a31688af

Tier tila-1026-18

Accuracy against the 95% target

Post-verification accuracy on official and external-benchmark gold, against the 95% target
ModelAccuracy against targetPromotedUnknown
tila-1026-18
claude:claude-sonnet-5-5
46.2% Below target48.8 points short
 53.8% 51.9%
codex:gpt-6.1-sol
1.9% Below target93.1 points short
 15.4% 98.1%

Scores by stage, model, and gold label

Raw proposer
ModelGoldAccuracyPromotedUnknownItems
claude:claude-sonnet-5-5claudeheadline (official and external-benchmark)76.9%10/13 38.5%5/13 23.1%3/13 52
official76.9%10/13 38.5%5/13 23.1%3/13 52
external-benchmarkno items no items no items 0
model-authoredno items no items no items 0
codex:gpt-6.1-solcodexheadline (official and external-benchmark)13.5%7/52 3.8%1/26 86.5%45/52 52
official13.5%7/52 3.8%1/26 86.5%45/52 52
external-benchmarkno items no items no items 0
model-authoredno items no items no items 0
Post-verification
ModelGoldAccuracyPromotedUnknownItems
claude:claude-sonnet-5-5claudeheadline (official and external-benchmark)46.2%6/13 53.8%7/13 51.9%27/52 52
official46.2%6/13 53.8%7/13 51.9%27/52 52
external-benchmarkno items no items no items 0
model-authoredno items no items no items 0
codex:gpt-6.1-solcodexheadline (official and external-benchmark)1.9%1/52 15.4%2/13 98.1%51/52 52
official1.9%1/52 15.4%2/13 98.1%51/52 52
external-benchmarkno items no items no items 0
model-authoredno items no items no items 0

Audit state

unaudited No counted random sample yet.

Sample rules

us-cfr-t12-p1026-supplement-i-s1026.18-d-claude-disclose_finance_charge

Source: /us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2 characters 18242 to 18408
The creditor must disclose the finance charge as a dollar amount, using the term finance charge, and must include a brief description similar to that in § 1026.18(d).
Rule
rule disclose_finance_charge @span(/us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2)
  obligation creditor -> unnamed_counterparty "disclose the finance charge as a dollar amount, using the term finance charge, with a brief description"

claude:claude-sonnet-5-5; promoted

Status
promoted
Audit state
unaudited population tila-1026-18
Version
2026-03-02 (unofficial-compilation) (unofficial compilation), in force 2026-03-01 to present, as of 2026-10-30
Reading
default

us-cfr-t12-p1026-supplement-i-s1026.18-d-codex-disclose_finance_charge

Source: /us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2 characters 18242 to 18408
The creditor must disclose the finance charge as a dollar amount, using the term finance charge, and must include a brief description similar to that in § 1026.18(d).
Rule
rule disclose_finance_charge @span(/us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2)
  obligation creditor -> unnamed_counterparty "disclose the finance charge as a dollar amount, using the term finance charge, with a brief description"

codex:gpt-6.1-sol; promoted

Status
promoted
Audit state
unaudited population tila-1026-18
Version
2026-03-02 (unofficial-compilation) (unofficial compilation), in force 2026-03-01 to present, as of 2026-10-30
Reading
default

us-cfr-t12-p1026-supplement-i-s1026.18-d-claude-include_finance_charge_description

Source: /us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2 characters 18242 to 18408
The creditor must disclose the finance charge as a dollar amount, using the term finance charge, and must include a brief description similar to that in § 1026.18(d).
Rule
rule include_finance_charge_description @span(/us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2)
  obligation creditor -> unnamed_counterparty "include a brief description similar to that in § 1026.18(d)"

claude:claude-sonnet-5-5; promoted

Status
promoted
Audit state
unaudited population tila-1026-18
Version
2026-03-02 (unofficial-compilation) (unofficial compilation), in force 2026-03-01 to present, as of 2026-10-30
Reading
default

us-cfr-t12-p1026-supplement-i-s1026.18-d-codex-include_finance_charge_description

Source: /us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2 characters 18242 to 18408
The creditor must disclose the finance charge as a dollar amount, using the term finance charge, and must include a brief description similar to that in § 1026.18(d).
Rule
rule include_finance_charge_description @span(/us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s2)
  obligation creditor -> unnamed_counterparty "include a brief description similar to that in § 1026.18(d)"

codex:gpt-6.1-sol; promoted

Status
promoted
Audit state
unaudited population tila-1026-18
Version
2026-03-02 (unofficial-compilation) (unofficial compilation), in force 2026-03-01 to present, as of 2026-10-30
Reading
default

us-cfr-t12-p1026-supplement-i-s1026.18-d-claude-itemize_finance_charge_elsewhere

Source: /us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s4 characters 18552 to 18785
The finance charge must be shown on the disclosures only as a total amount; the elements of the finance charge must not be itemized in the segregated disclosures, although the regulation does not prohibit their itemization elsewhere.
Rule
rule itemize_finance_charge_elsewhere @span(/us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s4)
  permission creditor -> unnamed_counterparty "itemize the elements of the finance charge elsewhere"

claude:claude-sonnet-5-5; promoted

Status
promoted
Audit state
unaudited population tila-1026-18
Version
2026-03-02 (unofficial-compilation) (unofficial compilation), in force 2026-03-01 to present, as of 2026-10-30
Reading
default

us-cfr-t12-p1026-supplement-i-s1026.18-d-codex-itemize_finance_charge_elsewhere

Source: /us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s4 characters 18552 to 18785
The finance charge must be shown on the disclosures only as a total amount; the elements of the finance charge must not be itemized in the segregated disclosures, although the regulation does not prohibit their itemization elsewhere.
Rule
rule itemize_finance_charge_elsewhere @span(/us/cfr/t12/p1026/supplement-I/s1026.18/d/cmt1#s4)
  permission creditor -> unnamed_counterparty "itemize the elements of the finance charge elsewhere"

codex:gpt-6.1-sol; promoted

Status
promoted
Audit state
unaudited population tila-1026-18
Version
2026-03-02 (unofficial-compilation) (unofficial compilation), in force 2026-03-01 to present, as of 2026-10-30
Reading
default

Compile reports

  • No compile reports for this tier yet.