Search This Blog

About Data Integration And Its Techniques

By Peggie K. Lambert


The basic concept behind data integration is that it combines data in several sources and puts it forward to an application or user as coming from a single source. This can be achieved using different methods. The range of applications, including marketing, corporate mergers and research, is just as broad.

Ideally, this is not something to be done just as an IT initiative to lower costs or improve the system. The main reason should be to help improve business processes or to solve a problem. Such systems based on integrated information collected from different sources have indeed been developed, and are quite commonly used in many industries.

One such example is a CRM system, which integrates information from different departments such as customer service, social media and sales/marketing. This enables the sales and marketing people in targeting an existing customer based on previous purchasing history and other contacts with the company that are listed in the profile. Another case where integrating an information storage system becomes essential is when two companies enter into a merger.

It is possible to accomplish this process on both the application and middleware layers. It may also be done by physical warehousing in a completely new system, or through virtual integration where no new repository is actually created. Let's consider these choices one by one, so that it becomes clear how each one works and where it can be used.

If the application has the built-in logic to extract and combine information stored in different sources, there is no need to create a new centralized database. The same applies for a solution on a middleware layer. In this case, the logic in the middleware will provide every application with whatever information it needs from any and all sources at the back end.

Virtual integration is the simplest method to create an integrating tool which does require creation of a new storage system. Under this method, a set of pre-defined queries will access required information from separate sources. For instance, consider a case where a customer profile needs to be seen. The query extracts records from all the sources based on the main index field, which is usually a customer ID. The extracted information is then presented to the user in a single and unified view.

Physical warehousing involves creating a separate storage system which collects information from all sources. This is an enterprise-level process, where information flows in from all of a company's locations and departments into a single data center. This is a centralized system which facilitates enterprise-wide reporting and analysis. It also helps integrate applications by providing all of them access to the pooled data.

The choice of data integration method and the scope of the project is a critical decision. The basic deciding factors are the number of sources and their type, along with the business benefits that are expected. The project cost is important, and so are the security and backup systems impacted. Other similar projects which are likely to have some impact are ongoing migrations and synchronization, along with MDM or master data management.




About the Author:



0 comments:

Post a Comment

 
Powered By Blogger | Portal Design By Trik-tips Blog © 2009 | Resolution: 1024x768px | Best View: Firefox | Top