Data Integration Funnel
The integration funnel view is where we have data in more than one format or more than one source or both and we integrate them with one destination. (We also do the reverse, but that’s not very funnel like.) To do this effectively we don’t do a unique integration for each format and source of data.
There are two versions of the funnel. First is where we pick a format and map that data to our internal system. Then other formats we modify to be in this preferred format, and then map then through the original process.
Second, we create a intermediary format of all of the required data, and them translate all external data to this format of convenience. Using a convenient dataset as our intermediate format, we can apply mapping logic in the external translation, and business logic on the importation of the convenient data.
I prefer using the convenient dataset, but either way we are able to reuse the mapping logic and using that as leverage are able to do more rapid integrations.
Subscribe to "The Integration Engineer" by Email
Find out about the tools and services available at The Integration Engineer's Consulting site.
