Data Virtualization - Revision history

User at 19:28, 15 March 2023

2023-03-15T19:28:58Z

User at 19:27, 15 March 2023

2023-03-15T19:27:50Z

User at 19:05, 15 March 2023

2023-03-15T19:05:49Z

User at 18:09, 15 March 2023

2023-03-15T18:09:47Z

User at 07:06, 16 October 2022

2022-10-16T07:06:36Z

User at 23:17, 15 October 2022

2022-10-15T23:17:42Z

User: Created page with "'''Content Coming Soon'''"

2018-12-19T19:05:16Z

Created page with "'''Content Coming Soon'''"

New page

'''Content Coming Soon'''

@@ Line 53: / Line 53: @@
-*Abstraction layer: The cornerstone of the whole virtualization framework is the abstraction (sometimes referred to as virtual or semantic) layer that acts as the bridge between all data sources on one side and all business users on the other. This tier itself doesn’t store any data: It only contains logical views and metadata needed to access the sources. With the abstraction layer, end users only see the schematic data models whereas the complexities of the bottom data structures are hidden from them. So, once the data attributes are pulled in, the abstraction layer will allow you to apply joins, business rules, and other data transformations to create logical views on top of the physical views and metadata delivered by the connection layer. These integration processes can be modeled with the help of a drag-and-drop interface or a query language like SQL, depending on the data virtualization tool. Usually, there are various prebuilt templates and components to do all the modeling, matching, converting, and integration jobs. The essential components of the virtual layer are
+*'''Abstraction layer''': The cornerstone of the whole virtualization framework is the abstraction (sometimes referred to as virtual or semantic) layer that acts as the bridge between all data sources on one side and all business users on the other. This tier itself doesn’t store any data: It only contains logical views and metadata needed to access the sources. With the abstraction layer, end users only see the schematic data models whereas the complexities of the bottom data structures are hidden from them. So, once the data attributes are pulled in, the abstraction layer will allow you to apply joins, business rules, and other data transformations to create logical views on top of the physical views and metadata delivered by the connection layer. These integration processes can be modeled with the help of a drag-and-drop interface or a query language like SQL, depending on the data virtualization tool. Usually, there are various prebuilt templates and components to do all the modeling, matching, converting, and integration jobs. The essential components of the virtual layer are
 **Metadata management — to import, document, and maintain metadata attributes such as column names, table structure, tags, etc.
 **Dynamic data catalog — to organize data by profiling, tagging, classifying, and mapping it to business definitions so that end-users can easily find what they need.
@@ Line 60: / Line 60: @@
 **Data security and governance — to provide different security levels to admins, developers, and consumer groups as well as define clear data governance rules, removing barriers for information sharing.
-*Consuming layer: Another tier of the data virtualization architecture provides a single point of access to data kept in the underlying sources. The delivery of abstracted data views happens through various protocols and connectors depending on the type of consumer. They may communicate with the virtual layer via SQL and all sorts of APIs, including access standards like JDBC and ODBC, REST and SOAP APIs, and many others. Most data virtualization software enables access for a wide range of business users, tools, and applications including such popular solutions as Tableau, Cognos, and Power BI.
+*'''Consuming layer''': Another tier of the data virtualization architecture provides a single point of access to data kept in the underlying sources. The delivery of abstracted data views happens through various protocols and connectors depending on the type of consumer. They may communicate with the virtual layer via SQL and all sorts of APIs, including access standards like JDBC and ODBC, REST and SOAP APIs, and many others. Most data virtualization software enables access for a wide range of business users, tools, and applications including such popular solutions as Tableau, Cognos, and Power BI.
 As mentioned above, such a structure produces self-service capabilities for all consumers. Instead of making queries directly, they interact with the software used in their day-to-day operations, and that software, in turn, interacts with the virtual layer, getting the required data. In this way, consumers don’t need to care about the format of the data or its location as these complexities are masked from them.

@@ Line 3: / Line 3: @@
 Data virtualization presents a modern approach to data integration. Unlike ETL solutions, which replicate data, data virtualization leaves the data in source systems, simply exposing an integrated view of all the data to data consumers. As business users drill down into reports, data virtualization fetches the data in real-time from the underlying source systems. Data virtualization proves that connecting to data is far superior to collecting it.
@@ Line 55: / Line 63: @@
 As mentioned above, such a structure produces self-service capabilities for all consumers. Instead of making queries directly, they interact with the software used in their day-to-day operations, and that software, in turn, interacts with the virtual layer, getting the required data. In this way, consumers don’t need to care about the format of the data or its location as these complexities are masked from them.
@@ Line 61: / Line 95: @@
 Data virtualization may also be considered as an alternative to ETL and data warehousing but for performance considerations, it's not really recommended for a very large data warehouse. Data virtualization is inherently aimed at producing quick and timely insights from multiple sources without having to embark on a major data project with extensive ETL and data storage. However, data virtualization may be extended and adapted to serve data warehousing requirements also. This will require an understanding of the data storage and history requirements along with planning and design to incorporate the right type of data virtualization, integration, storage strategies, and infrastructure/performance optimizations (e.g., streaming, in-memory, hybrid storage)

@@ Line 1: / Line 1: @@
 '''Data Virtualization''' is a software approach that allows organizations to access and manipulate data from multiple sources as if it were a single, unified data source. It enables users to access data in real-time, without having to physically move or replicate the data, thus reducing data redundancy and enhancing data consistency. This approach provides a virtual layer that integrates data from various sources and allows users to interact with it through a unified interface, providing seamless access to the data they need. Data virtualization helps to optimize data management and analysis, which ultimately leads to better decision-making and improved business outcomes.
@@ Line 4: / Line 5: @@
-== Capabilities Needed in a Data Virtualization System<ref>[https://www.tibco.com/reference-center/what-is-data-virtualization Required Data Virtualization Components for Business Needs]</ref>
+== Capabilities Needed in a Data Virtualization System<ref>[https://www.tibco.com/reference-center/what-is-data-virtualization Required Data Virtualization Components for Business Needs]</ref> ==
 Four components are needed to meet urgent business needs with data virtualization
 *Agile design and development: You need to be able to introspect available data, discover hidden relationships, model individual views/services, validate views/services, and modify as required. These capabilities automate difficult work, improve time to solution, and increase object reuse.
@@ Line 22: / Line 23: @@
-== How data virtualization works: Main architecture layers
+== How Data Virtualization Works<ref>[https://www.altexsoft.com/blog/data-virtualization/ How data virtualization works: Main architecture layers]</ref> ==
 In a nutshell, data virtualization happens via middleware which is nothing but a unified, virtual data access layer built on top of many data sources. This layer presents information, regardless of its type and model, as a single virtual (or logical) view. It all happens on demand and in real-time. Let’s elaborate on the data virtualization architecture to get the complete picture of how things work here. Typically, there are three building blocks comprising the virtualization structure, namely
 *Connection layer — a set of connectors to data sources in real time;
@@ Line 39: / Line 40: @@
 **big data systems like Hadoop, and many more.
 When connecting, data virtualization loads metadata (details of the source data) and physical views if available. It maps metadata and semantically similar data assets from different autonomous databases to a common virtual data model or schema of the abstraction layer. Mappings define how the information from each source system should be converted and reformatted for integration needs.
 *Abstraction layer: The cornerstone of the whole virtualization framework is the abstraction (sometimes referred to as virtual or semantic) layer that acts as the bridge between all data sources on one side and all business users on the other. This tier itself doesn’t store any data: It only contains logical views and metadata needed to access the sources. With the abstraction layer, end users only see the schematic data models whereas the complexities of the bottom data structures are hidden from them. So, once the data attributes are pulled in, the abstraction layer will allow you to apply joins, business rules, and other data transformations to create logical views on top of the physical views and metadata delivered by the connection layer. These integration processes can be modeled with the help of a drag-and-drop interface or a query language like SQL, depending on the data virtualization tool. Usually, there are various prebuilt templates and components to do all the modeling, matching, converting, and integration jobs. The essential components of the virtual layer are

@@ Line 1: / Line 1: @@
-'''Content Coming Soon'''
+'''Data Virtualization''' is a software approach that allows organizations to access and manipulate data from multiple sources as if it were a single, unified data source. It enables users to access data in real-time, without having to physically move or replicate the data, thus reducing data redundancy and enhancing data consistency. This approach provides a virtual layer that integrates data from various sources and allows users to interact with it through a unified interface, providing seamless access to the data they need. Data virtualization helps to optimize data management and analysis, which ultimately leads to better decision-making and improved business outcomes.
-== See Also ==
 == References ==
 <references />

@@ Line 3: / Line 3: @@
 == See Also ==
-*[[Data]]
-*[[Business_Strategy|Business Strategy]]
-*[[IT_Strategy_(Information_Technology_Strategy)|IT Strategy]]
-*[[E-Strategy|e-Strategy]]
-*[[IT_Governance|IT Governance]]
+== References ==
-*[[Enterprise_Architecture|Enterprise Architecture]]
+<references />

← Older revision		Revision as of 23:17, 15 October 2022
Line 1:		Line 1:
	'''Content Coming Soon'''		'''Content Coming Soon'''
		+
		+
		+	== See Also ==
		+	*[[Data]]
		+	*[[Business_Strategy\|Business Strategy]]
		+	*[[IT_Strategy_(Information_Technology_Strategy)\|IT Strategy]]
		+	*[[E-Strategy\|e-Strategy]]
		+	*[[IT_Governance\|IT Governance]]
		+	*[[Enterprise_Architecture\|Enterprise Architecture]]
		+	*[[IT_Sourcing_(Information_Technology_Sourcing)\|IT Sourcing]]
		+	*[[IT Operations_(Information_Technology_Operations)\|IT Operations]]
		+	*[[Chief_Information_Officer_(CIO)\|CIO]]