New categories

​

Definition

The new categories test checks if there are new categories in the validation set which are not present in the training set for the categorical features.

​

Taxonomy

• Category: Consistency.
• Task types: Tabular classification, tabular regression.
• Availability: development.

​

Why it matters

• If the validation set contains new categories, the model is not prepared to make good predictions for them.

​

Test configuration examples

If you are writing a tests.json, here are a few valid configurations for the character length test:

​

Related

• New labels test.