The completion of the 2014 validation process for VantageScore 3.0, the first validation since the model was introduced in March 2013, affirms the model’s value as an extremely effective risk management tool for lenders. Validations for the VantageScore 1.0 and 2.0 models also confirmed their ongoing effectiveness as risk-management tools.
Validation is a process for testing the effectiveness of a credit scoring model’s primary function: predicting the likelihood that a borrower will default (go 90 days or more overdue on a loan payment within 24 months). Validation entails looking at actual consumer data (minus any personal information such as names, addresses, social security numbers, and account numbers) for a 24-month period and comparing the model’s default predictions to actual consumer default behavior recorded for that period.
The VantageScore 3.0 validation used the time period from June 2011 to June 2013, providing an accurate representation of recent consumer behaviors in the current credit environment. The validation methodology followed recommendations issued in 2011 by the U.S. Office of the Comptroller of the Currency in an update to its “Supervisory Guidance on Model Risk Management.”
The validation looked at three distinct populations in terms of credit risk:
Results were benchmarked against those of generic credit scoring models from each of the three national credit reporting companies (CRCs) — Equifax, Experian and TransUnion — and against earlier versions — VantageScore 1.0 and 2.0 — of the VantageScore model.
Among the highlights of the results:
“We are extremely pleased with the results of our model validations. Today, more than ever, lenders need assurances that the credit score model they use delivers the highest level of performance possible,” said VantageScore Solutions CEO Barrett Burns. “This information is particularly important from a model governance and transparency standpoint, as regulators are keen to see for themselves how a lender’s risk models perform.”
Detailed results of the validation are available via white papers posted at VantageScore.com.