Data Discovery is currently in Private Preview and is not available for General Availability (GA). It should not be used in production environments, as features and functionality may change before the final GA release.

What's New

Features introduced in this version for Data Discovery.

Data Discovery 2.0

Major changes

Standardized API Endpoints

  • Updated Classify and Transform APIs:

  • Added new Endpoints:

    • http://{Host Address}/pty/data-discovery/doc – Provides the API documentation for the Data Discovery. For more information see API Specification.
    • http://{Host Address}/pty/data-discovery/log – Gets/Sets the log level for the Data Discovery. For more information see Log level API.
    • http://{Host Address}/pty/data-discovery/version – Retrieves the current version of the Data Discovery. For more information see Version API.

Enhancements

  • Updated Context Provider AI model for improved contextual accuracy.
  • Updated Pattern Provider model for better pattern recognition.
  • Updated the default score threshold for the Classify API from 0.0 to 0.7, aligning it with the Transform API which already defaults to 0.7. Low-confidence classifications below the threshold are filtered out. The legacy v1.1 classification endpoint retains a threshold of 0.0 for backward compatibility.
  • Added usage metrics logging to the Classification Service for improved analytics and visibility, see Usage Metrics for more details.
  • Added per-language accuracy metrics to improve visibility into multilingual performance, see Language Metrics for more details.
  • Added PII detection in multiple Markdown dialects.
  • Bug Fixes.
Last modified : March 10, 2026