Defining the data Target is the First Step
This is like the Covey proverb, “Begin with the end in mind.” In an integration project, the first step is always to define the target of where your data is going to end up. This is true for a document conversion like XSLT or a EDI or Flat File transformation to XML or another version. It is also true for ETL tasks where we are getting data in and out of a Database or repository.
Starting the work of transforming data or files without a well defined target for the data will cause you to do extra and unnecessary work, and to repeat some steps when the true destination is known. It may seem obvious, but many many people fall into this trap, and then don’t understand why their projects keep exceeding their time budgets.
Now it is time to take a look at the processes that you use in your integration projects and see if you are starting by defining your target. To help you with this, you can take a look at the target based mapping posts on this site as well.
Subscribe to "The Integration Engineer" by Email
Find out about the tools and services available at The Integration Engineer's Consulting site.
January 29th, 2010 at 12:41 pm
I have been greatly enjoying your site! (I noticed a slight typo on this one (it reads “in and integration” should be in an integration). Have you considered covering the topic of open source EDI, open source ETL, etc… it seems to be right on track. http://michaelellerbeck.com/2010/01/08/open-source-edi/
January 29th, 2010 at 12:54 pm
Michael,
Thanks for pointing out my typo. I have corrected it.
Early in my career in integration and EDI the companies I worked for were reluctant to adopt any Open-Source technology solutions. But in a few short years many have discovered the power and savings that can be gained by bringing quality Open-Source solutions into the fold.
Roy