Making Searching and Curating Data Assets in Microsoft Purview easier. by info.odysseyx@gmail.com September 30, 2024 written by info.odysseyx@gmail.com September 30, 2024 0 comment 1 views 1 1. Introduction. Current IT infrastructure stores and maintains data assets even if IT does not own or use the data. There is a disconnect between how data is retrieved and maintained within a business and the teams that maintain it. Without standardized procedures for data governance, data processing often relies on manual processes, leading to inefficiencies, data loss, insufficient data protection, and high operational costs. microsoft furview It is designed to help businesses get the most value from their existing information assets. that inventory Make it easy for people managing data to discover and understand data sources. Purview allows organizations to gain insight into: Data lineage, data usage, and data linkingHelps you comply with regulations such as GDPR, CCPA, and more. Microsoft Purview provides the following cloud-based services: Register data source. During registration, your data remains in its existing location, but a copy of its metadata is added to Microsoft Purview with a reference to the data source location. After you register your data sources, you can scan them and enrich their metadata. Discovering and understanding data sources and their uses is the primary purpose of source registration. This article describes smart features that allow you to retrieve previously scanned data assets using: natural language queriestogether Automated metadata enrichment It is used to screen these assets. 2. Data catalog. that data catalog A data governance solution that enables business experts and technical data owners to collaborate and contribute to a shared understanding of their data. Among other features, Data Catalog allows you to: data retrieval Search for data assets from multiple data sources, including Microsoft Fabric items and workspaces. Exploring the relationship between Microsoft Fabric and Microsoft Purview: What you need to know Smart data discovery with Microsoft Purview It primarily works with scanned data assets. For uninspected data assets, you can perform manual classification and tagging, but you may not be able to fully utilize smart data discovery capabilities. Real-time or “live view” data typically requires that you first scan the data source before it can be searched by Microsoft Purview. 2.1 Smart data search. Once metadata is collected in a Microsoft Purview data map, it can be searched using Microsoft Purview’s smart data search in the data catalog. Now you can use: Natural language explanation For data assets you retrieve from the Microsoft Purview catalog. Go to the new Microsoft Purview portal.https://purview.microsoft.com selectdata catalogAfter finding a solution,data retrieval. When you enter search terms, Microsoft Purview returns a list of data assets and glossaries that match the keywords you enter if you have data reader permissions. In the example below, the search term was “I want to know data related to Latam’s disease.” It’s important to note that a search returns all data assets in the collection that best match the query. If the collection contains data assets that match the phrase, all scanned items are returned, even if some do not match exactly. The match between search results and the desired results depends on the data map design, registered data sources, and scope covered by the scan, which helps narrow down the most common searches in your business. for example Multi-region and business concept as data map design. The Microsoft Purview relevance engine sorts all matches and ranks them based on how useful they are to you. Many factors determine an asset’s relevance score, and the Microsoft Purview search team is constantly tweaking its relevance engine to ensure the best search results are valuable to you. 2.2 Apply filters to find. Enter your search phrase, wait a few seconds, and a filter window will appear where you can apply the following filtering criteria: asset type data source type collection classification contact endorsement assigned term Sensitivity Label evaluation The following figure shows asset type filtering. Filtering criteria “data”, You can refine your search by selecting one or more pieces of data. legacy Type depending on referenced data source: The following figure shows an asset of type “Report”. Then select the filter category you want to narrow down your results. and Select a value to narrow your results. For some filters, you can choose between an AND condition or an OR condition by selecting the ellipsis.As shown in the following picture: 2.3 Curation process. procedure Contribute to the catalog by tagging, documenting, and annotating already registered data sources. Metadata curation [Metadata curation in Microsoft Purview | Microsoft Learn]. The curation process is facilitated by selecting one or more data assets returned from a search that are considered the curator’s responsibility. For example, the following figure shows two data assets selected: Clicking “View Selected” will access a screen where you can add properties to the metadata of your data asset. Click ‘Bulk Edit’. When you select a property, you can add new values, replace existing values with different values, or remove values. You can add as many properties as you need. Depending on the property, you can manage appropriate values. of furview Copilot can help you enrich your metadata by suggesting: additional Context, classification and annotation based on the content and purpose of data assetsfurthermore Ensure consistency of metadata definitions and standards across your organization, reducing inconsistencies and improving data quality. If you select ‘Proposals’, you can observe various proposals derived according to your business concept. It’s important to note that the AI model uses data from the general Internet knowledge base and therefore does not return company-specific or custom definitions or terms. All terms must be moderated before publication to ensure terms and definitions are consistent with company usage and specific knowledge of those terms. Microsoft Purview Data Catalog Responsible AI FAQs (Preview) | microsoft run All terms and definitions provided through your proposal must be reviewed and adjusted to suit your company’s specific language standards. Once you select and create a term, it goes into draft status, allowing you to complete and finalize the term before an administrator decides to publish it. conclusion. Smart data discovery and automated metadata enrichment significantly improve the cataloging process, making it more efficient, comprehensive, and insightful. These advanced capabilities not only improve data discoverability and governance, but also provide users with richer, more contextual information so they can make more informed and effective decisions. Learn more: Microsoft Purview Collection Architecture and Best Practices | microsoft run Scan & Collect | microsoft run How to search the data catalog | microsoft run Search data with natural language search – YouTube Metadata Curation in Microsoft Purview | microsoft run. Best Practices for Describing Data in Microsoft Purview | microsoft run How to create and manage glossary terms (preview) | microsoft run Managing data as a business concept (youtube.com) How to configure and manage data catalog access policies (Preview) | microsoft run Source link Share 0 FacebookTwitterPinterestEmail info.odysseyx@gmail.com previous post Comprehensive Nvidia GPU Monitoring for Azure N-Series VMs Using Telegraf with Azure Monitor next post Java on Azure with JHipster You may also like From Zero to Hero: Building Your First Voice Bot with GPT-4o Real-Time API using... October 12, 2024 A Guide to Responsible Synthetic Data Creation October 12, 2024 Capacity Template – MGDC for SharePoint October 11, 2024 Using Azure NetApp Files (ANF) for data- and logfiles for Microsoft SQL Server in... October 11, 2024 Microsoft Community – Do you love stickers?! Do you want to be a part... October 11, 2024 Advanced Alerting Strategies for Azure Monitoring October 11, 2024 Leave a Comment Cancel Reply Save my name, email, and website in this browser for the next time I comment.