Making Searching and Curating Data Assets in Microsoft Purview easier.

1. Introduction.

Current IT infrastructure stores and maintains data assets even if IT does not own or use the data.

There is a disconnect between how data is retrieved and maintained within a business and the teams that maintain it.

Without standardized procedures for data governance, data processing often relies on manual processes, leading to inefficiencies, data loss, insufficient data protection, and high operational costs.

microsoft furview It is designed to help businesses get the most value from their existing information assets.

that inventory Make it easy for people managing data to discover and understand data sources.

Purview allows organizations to gain insight into: Data lineage, data usage, and data linkingHelps you comply with regulations such as GDPR, CCPA, and more.

Microsoft Purview provides the following cloud-based services: Register data source. During registration, your data remains in its existing location, but a copy of its metadata is added to Microsoft Purview with a reference to the data source location.

After you register your data sources, you can scan them and enrich their metadata.

Discovering and understanding data sources and their uses is the primary purpose of source registration.

This article describes smart features that allow you to retrieve previously scanned data assets using: natural language queriestogether Automated metadata enrichment It is used to screen these assets.

2. Data catalog.

that data catalog A data governance solution that enables business experts and technical data owners to collaborate and contribute to a shared understanding of their data.

Among other features, Data Catalog allows you to: data retrieval Search for data assets from multiple data sources, including Microsoft Fabric items and workspaces. Exploring the relationship between Microsoft Fabric and Microsoft Purview: What you need to know

Smart data discovery with Microsoft Purview It primarily works with scanned data assets. For uninspected data assets, you can perform manual classification and tagging, but you may not be able to fully utilize smart data discovery capabilities. Real-time or “live view” data typically requires that you first scan the data source before it can be searched by Microsoft Purview.

2.1 Smart data search.

Once metadata is collected in a Microsoft Purview data map, it can be searched using Microsoft Purview’s smart data search in the data catalog.

Now you can use: Natural language explanation For data assets you retrieve from the Microsoft Purview catalog.

Go to the new Microsoft Purview portal.https://purview.microsoft.com

selectdata catalogAfter finding a solution,data retrieval.

When you enter search terms, Microsoft Purview returns a list of data assets and glossaries that match the keywords you enter if you have data reader permissions.

In the example below, the search term was “I want to know data related to Latam’s disease.”

It’s important to note that a search returns all data assets in the collection that best match the query. If the collection contains data assets that match the phrase, all scanned items are returned, even if some do not match exactly.

The match between search results and the desired results depends on the data map design, registered data sources, and scope covered by the scan, which helps narrow down the most common searches in your business.

for example Multi-region and business concept as data map design.

The Microsoft Purview relevance engine sorts all matches and ranks them based on how useful they are to you.

Many factors determine an asset’s relevance score, and the Microsoft Purview search team is constantly tweaking its relevance engine to ensure the best search results are valuable to you.

2.2 Apply filters to find.

Enter your search phrase, wait a few seconds, and a filter window will appear where you can apply the following filtering criteria:

• asset type
• data source type
• collection
• classification
• contact
• endorsement
• assigned term
• Sensitivity Label
• evaluation

The following figure shows asset type filtering.

Filtering criteria “data”, You can refine your search by selecting one or more pieces of data. legacy Type depending on referenced data source:

The following figure shows an asset of type “Report”.

Then select the filter category you want to narrow down your results. and Select a value to narrow your results. For some filters, you can choose between an AND condition or an OR condition by selecting the ellipsis.As shown in the following picture:

2.3 Curation process.

procedure Contribute to the catalog by tagging, documenting, and annotating already registered data sources. Metadata curation [Metadata curation in Microsoft Purview | Microsoft Learn].

The curation process is facilitated by selecting one or more data assets returned from a search that are considered the curator’s responsibility.

For example, the following figure shows two data assets selected:

Clicking “View Selected” will access a screen where you can add properties to the metadata of your data asset.

Click ‘Bulk Edit’.

When you select a property, you can add new values, replace existing values ​​with different values, or remove values.

You can add as many properties as you need.

Depending on the property, you can manage appropriate values.

of furview Copilot can help you enrich your metadata by suggesting: additional Context, classification and annotation based on the content and purpose of data assetsfurthermore Ensure consistency of metadata definitions and standards across your organization, reducing inconsistencies and improving data quality.

If you select ‘Proposals’, you can observe various proposals derived according to your business concept.

It’s important to note that the AI ​​model uses data from the general Internet knowledge base and therefore does not return company-specific or custom definitions or terms. All terms must be moderated before publication to ensure terms and definitions are consistent with company usage and specific knowledge of those terms. Microsoft Purview Data Catalog Responsible AI FAQs (Preview) | microsoft run

All terms and definitions provided through your proposal must be reviewed and adjusted to suit your company’s specific language standards. Once you select and create a term, it goes into draft status, allowing you to complete and finalize the term before an administrator decides to publish it.

conclusion.

Smart data discovery and automated metadata enrichment significantly improve the cataloging process, making it more efficient, comprehensive, and insightful.

These advanced capabilities not only improve data discoverability and governance, but also provide users with richer, more contextual information so they can make more informed and effective decisions.

Learn more:

Microsoft Purview Collection Architecture and Best Practices | microsoft run

Scan & Collect | microsoft run

How to search the data catalog | microsoft run

Search data with natural language search – YouTube

Metadata Curation in Microsoft Purview | microsoft run.

Best Practices for Describing Data in Microsoft Purview | microsoft run

How to create and manage glossary terms (preview) | microsoft run

Managing data as a business concept (youtube.com)

How to configure and manage data catalog access policies (Preview) | microsoft run