Concept, Classification and Function of Metadata
Many people are not very clear about the concept, classification and function of metadata. If you’re in a similar situation, congratulations, you’ve come to the right place. In today’s article, we will try to answer the above questions one by one, so that you can have a comprehensive understanding of metadata. Before going any further, let’s figure out what metadata is.
Definition of Metadata:
Metadata is usually defined as: data about data, or data describing data, descriptive information about data and information resources. Metadata is the most important data of all and the basis of data and computer software throughout the banking industry.
For example, “age”, “height”, “weight”, and “character” in the medical report are metadata, because they are data/information used to describe specific data/information. Another example is the library’s book collection information card. The video description in the video website, the web page address in the network, etc. are all metadata. There are also attribute fields in the “Financial Status Table”, such as: institution name, project name, currency, balance information, etc. are the metadata information of this table.
Types of Metadata:
Metadata can be divided into three categories according to the different objects they describe: technical metadata, business metadata and management metadata.
1. Technical Metadata:
Technical metadata is mainly used to describe data entities and technical details and processing rules in data processing. For example, the well-known table structure, ETL mapping relationship, etc., such metadata are mainly used by technical personnel of system construction.
In the banking industry, technical metadata solves the data definition, acquisition, storage, exchange and application functions of business systems (such as integrated counter system, credit business system, network banking system, telephone banking system, etc.) and management systems (customer relationship management system, audit management system, financial management system, etc.).
Business systems are systems responsible for transactions between banks and customers. These systems have the characteristics of large amount of data and strong timeliness. Take the “integrated counter system” as an example, the “integrated counter system” needs to manage hundreds of millions of customer information and account statements, and process hundreds of millions of transactions in real time every day. Most of the technical metadata exists in these systems in the form of database definitions, which are the basis for various data processing.
2. Business Metadata:
Business metadata is mainly a business description of the data entities and data processing of the IT system, including business rules, business terms, statistical caliber, information classification, etc. The frequently mentioned KPI definitions and report statistics rules belong to this kind of metadata. The main users of business metadata are business personnel and corporate decision makers.
- Description of the business itself. For example, at present, the banking industry can be divided into three categories: assets, liabilities, and intermediary business. Assets can be further divided into short-term credit, long-term credit, discount and so on. The descriptions and definitions of these services form the basis of the service metadata.
- Description of the state of the business. It includes a general reflection on the operation of banking products, banking institutions, and banking customers. Each branch has different business operations for each product or business in each time period and time point.
- Description of business management situation. This includes various business management rules and regulations, business cases, business points and difficulties, etc. Business metadata also plays a role in defining management indicators and standards in business management. It is the basic function of metadata to describe the content and attributes of resources in detail and comprehensively, and to fully reflect the basic overview of information resource objects.
3. Manage Metadata:
Management metadata is mainly a description of relevant information such as project management, IT operation and maintenance, IT resource equipment, etc. This type of metadata is mainly used by managers of the enterprise IT department. Using this metadata, work assignments, network resources, etc. can be performed. aspect management. Here, management metadata is also included in the scope of business metadata research, that is, metadata is only divided into technical metadata and business metadata in this paper.
Function of Metadata:
1. Data asset map:
Data map is generally used to organize information at the macro level, merge and sort out information from a global perspective, show data volume, data changes, data storage, overall data quality and other information, and provide reference for data management departments and decision makers.
2. Quick search:
Quickly search and locate data assets of various information systems for query and use.
3. Flexible perspectives:
Support user-defined multi-view data search, find the location of the required data in the way the user expects, and provide rapid presentation of data assets.
4. Data labels:
Users can quickly find the desired data location through data tag association.
5. Insights into data assets:
Provides data asset distribution and data asset assessment self-assessment functions to gain an in-depth understanding of the overall situation of data assets.
6. Lineage analysis:
Through metadata lineage analysis, the relationship between different data can be understood.
7. Impact analysis:
By analyzing the relationship between data tables, it shows the impact of fluctuations in data sources.
8. Mapping display:
Help users master and understand the mapping relationship between business calibers and data calibers, and “translate” them in the way users need.
The Role of Metadata:
1. Help understand data and build data thinking:
Metadata can effectively help technical and business personnel to understand, monitor and manage data sources, transformation rules, and data change management.
2. Improve work efficiency:
The centralized metadata management mode effectively improves the work efficiency of technical developers and data analysts.
3. Self-service usage data:
Provides a good view of metadata query management, enabling business personnel to locate and use data independently and accurately.
It is beneficial to construct metadata management organization, metadata standards and processes, define the scope of metadata accurately, and ensure the integrity and correctness of metadata in IT business systems of provincial association.
5. Interconnection across systems:
Effectively support the compatibility of data conversion between various IT systems, and realize data sharing and interconnection.
Conclusion:
Metadata is an application dictionary and operational guide for enterprise data resources. Metadata management helps to unify data caliber, indicate data orientation, analyze data relations, manage data changes, and provide support for enterprise-level data strategic planning, data model design, data standard management, master data management, data quality management, data safety management and data life cycle management. It is a feasible route for enterprises to realize data self-service and promote enterprise data operation.
Enterprises use metadata as a starting point for data governance to help enterprises better manage data assets, clarify the relationship between data, and achieve accurate and efficient analysis and decision-making.