Input Validation

Mon, 01 Jan 0001 00:00:00 +0000

The Classification service in Data Discovery offers an input validation security feature that rejects invalid input data. Data that is malformed, non-normalized, containing homoglyphs, hieroglyphs, mixed Unicode variants, or control characters is considered as unsanitized or invalid data. These are rejected and will not be classified.

The following are few examples of data that will be rejected:

Ⅷ
𝓉𝑒𝓍𝓉
Ｐｅｐ

Before invoking the Classification endpoint, ensure that the input text is normalized. Replace invalid characters by their corresponding normalized plaintext characters. If the input text contains any invalid character, a status code of 422 and a message Untrusted input is returned.

Harmonization

Tue, 20 Feb 2024 00:00:00 +0000

Based on the detection logic, the Pattern and Context classification providers might classify the same data in different labels. The classification service standardizes provider outputs into a unified response.

Consider the example, You can visit our office located in New York City.

Context provider might categorize New York City as CITY.
Pattern provider might categorize New York City as LOCATION.

This can cause an inconsistency in the outputs generated across the providers.

Supported Classification Entities

Mon, 01 Jan 0001 00:00:00 +0000

Supported Entity Types

PII entities supported by Data Discovery with their Harmonized Categories.

Harmonized Category	Entity Name	Description
ACCOUNT_NAME	ACCOUNTNAME	Name associated with a financial account.
ACCOUNT_NUMBER	ACCOUNTNUMBER	Bank account number used to identify financial accounts.
AGE	AGE	Age information used to identify individuals.
AMOUNT	AMOUNT	Specific amount of money, which can be linked to financial transactions.
BANK_ACCOUNT	BIC	Bank Identifier Code used to identify financial institutions.
BANK_ACCOUNT	IBAN	International Bank Account Number used to identify bank accounts globally.
BANK_ACCOUNT	IBAN_CODE	International Bank Account Number used to identify bank accounts globally.
BANK_ACCOUNT	US_BANK_NUMBER	Bank account number used to identify financial accounts in the United States.
BANK_ROUTING_CODE	ABA_ROUTING_NUMBER	It identifies a bank/branch for routing payments, not an individual bank account.
BANK_ROUTING_CODE	BIC	SWIFT/BIC is a bank identifier, not an account number.
CREDIT_CARD	CCN	Credit card number used for financial transactions.
CREDIT_CARD	CREDIT_CARD	Credit card number used for financial transactions.
SECURITY_CODE	CREDIT_CARD_CVV	CVVs are security codes for payment authentication, not passwords.
CRYPTO_ADDRESS	BITCOINADDRESS	Bitcoin wallet address used for digital transactions.
CRYPTO_ADDRESS	CRYPTO	Cryptocurrency wallet address used for digital transactions.
CRYPTO_ADDRESS	ETHEREUMADDRESS	Ethereum wallet address used for digital transactions.
CRYPTO_ADDRESS	LITECOINADDRESS	Litecoin wallet address used for digital transactions.
CURRENCY_CODE	CURRENCYCODE	Code representing currency used in financial transactions.
CURRENCY_NAME	CURRENCY	Currency information used in financial transactions.
CURRENCY_NAME	CURRENCYNAME	Name of currency used in financial transactions.
CURRENCY_SYMBOL	CURRENCYSYMBOL	Symbol representing currency, sometimes linked to financial transactions.
DATETIME	DATE	Specific date that can be linked to personal activities.
DATETIME	DATE_TIME	Specific date and time that can be linked to personal activities.
DATETIME	TIME	Specific time that can be linked to personal activities.
DRIVER_LICENSE	DRIVERLICENSE	Driver’s license number used to identify individuals.
DRIVER_LICENSE	IT_DRIVER_LICENSE	Driver’s license number used to identify individuals in Italy.
DRIVER_LICENSE	US_DRIVER_LICENSE	Driver’s license number used to identify individuals in the United States.
EMAIL_ADDRESS	EMAIL	Email address used for communication and identification.
EMAIL_ADDRESS	EMAIL_ADDRESS	Email address used for communication and identification.
GENDER	GENDER	Gender information used to identify individuals.
HEALTH_CARE_ID	AU_MEDICARE	Medicare number used to identify individuals for healthcare services in Australia.
HEALTH_CARE_ID	MEDICAL_LICENSE	License number used to identify medical professionals.
HEALTH_CARE_ID	UK_NHS	National Health Service number used to identify individuals for healthcare services in the United Kingdom.
IN_VEHICLE_REGISTRATION	IN_VEHICLE_REGISTRATION	Vehicle registration number used to identify vehicles in India.
IN_VOTER	IN_VOTER	Voter ID number used to identify registered voters in India.
IP_ADDRESS	IP	Internet Protocol address used to identify devices on a network.
IP_ADDRESS	IP_ADDRESS	Internet Protocol address used to identify devices on a network.
LOCATION	BUILDING	Building information used to identify specific locations.
LOCATION	CITY	City information used to identify geographic locations.
LOCATION	COUNTRY	Country information used to identify geographic locations.
LOCATION	COUNTY	County information used to identify geographic locations.
LOCATION	GEOCOORD	Geographic coordinates used to identify specific locations.
LOCATION	LOCATION	Specific location or address that can be linked to an individual.
LOCATION	ADDRESS	Information used to uniquely identify a physical location.
LOCATION	SECADDRESS	Additional address information used to identify locations.
LOCATION	SECONDARYADDRESS	Additional address information used to identify locations.
LOCATION	STATE	State information used to identify geographic locations.
LOCATION	STREET	Street address used to identify specific locations.
LOCATION	ZIPCODE	Postal code used to identify specific geographic areas.
MAC_ADDRESS	MAC	Media Access Control address used to identify devices on a network.
BUSINESS_ID	AU_ACN	ACN is an Australian company identifier, not a personal national ID.
BUSINESS_ID	SG_UEN	UEN is a company/entity registration number, not a personal national ID.
NATIONAL_ID	ES_NIE	Foreigner Identification Number used to identify non-residents in Spain.
NATIONAL_ID	FI_PERSONAL_IDENTITY_CODE	Personal identity code used to identify individuals in Finland.
NATIONAL_ID	IDCARD	Identity card number used to identify individuals.
NATIONAL_ID	IN_AADHAAR	Unique identification number used to identify residents in India.
NATIONAL_ID	IT_IDENTITY_CARD	Identity card number used to identify individuals in Italy.
NATIONAL_ID	PL_PESEL	Personal Identification Number used to identify individuals in Poland.
NATIONAL_ID	SG_NRIC_FIN	National Registration Identity Card number used to identify residents in Singapore.
ORGANIZATION	COMPANYNAME	Name of a company used to identify businesses.
PASSWORD	CREDITCARDCVV	Card Verification Value used to secure credit card transactions.
PASSWORD	PASSWORD	Password used to secure access to personal accounts.
SECURITY_CODE	PIN	PINs are short numeric codes for authentication, not passwords.
PASSPORT	IN_PASSPORT	Passport number used to identify individuals in India.
PASSPORT	IT_PASSPORT	Passport number used to identify individuals in Italy.
PASSPORT	PASSPORT	Passport number used to identify individuals.
PASSPORT	US_PASSPORT	Passport number used to identify individuals in the United States.
PERSON	NAME	Name or identifier used to identify an individual.
PERSON	PERSON	Name or identifier used to identify an individual.
PHONE_NUMBER	PHONE	Number used to contact or identify an individual.
PHONE_NUMBER	PHONE_NUMBER	Number used to contact or identify an individual.
SOCIAL_SECURITY_ID	SSN	Social Security Number used to identify individuals.
SOCIAL_SECURITY_ID	UK_NINO	National Insurance Number used to identify individuals in the United Kingdom.
SOCIAL_SECURITY_ID	US_SSN	Social Security Number used to identify individuals in the United States.
BUSINESS_TAX_ID	AU_ABN	ABN is used for tax and business registration, specific to organizations.
BUSINESS_TAX_ID	IT_VAT_CODE	VAT codes are business tax identifiers, not personal tax IDs.
TAX_ID	AU_TFN	Tax File Number used to identify taxpayers in Australia.
TAX_ID	ES_NIF	Tax Identification Number used to identify taxpayers in Spain.
TAX_ID	IN_PAN	Permanent Account Number used to identify taxpayers in India.
TAX_ID	IT_FISCAL_CODE	Fiscal code used to identify taxpayers in Italy.
TAX_ID	US_ITIN	Individual Taxpayer Identification Number used to identify taxpayers in the United States.
TITLE	TITLE	Title or honorific used to identify individuals.
URL	URL	Web address that can sometimes contain personal information.
USER_NAME	USERNAME	Username used to identify individuals in online systems.
KR_RRN	KR_RRN	The Korean Resident Registration Number (RRN) is a 13-digit number issued to all Korean residents.
IN_GSTIN	IN_GSTIN	The Indian Goods and Services Tax Identification Number (GSTIN) is a 15-character identifier with state code (01-37), PAN, registration number, ‘Z’, and checksum.
DATE_OF_BIRTH	DOB	Date of Birth. Standard personal-identification detail that specifies the exact day, month, and year a person was born.
TH_TNIN	TH_TNIN	The Thai National ID Number (TNIN) is a unique 13-digit number issued to all Thai residents.
IP_ADDRESS	IPV4	Internet Protocol address identifies a device on a network and providing its location, enabling proper routing of data
IP_ADDRESS	IPV6	Internet Protocol address identifies a device on a network and providing its location, enabling proper routing of data

Classify on

Input Validation

Harmonization

Supported Classification Entities