Product Reviews

Clean Up Those Databases!

Customizable filtering from DataPipe

DataPipe is built on top of Crystal Software's TextPipe Pro (which I reviewed in the previous issue of Developer Central), and indeed, it includes a bundled copy of TextPipe Pro. It uses TextPipe filters to perform the same variety of tasks as TextPipe, for example:

  • Add new text at the start or end of a line
  • Reverse selected text
  • Change case
  • Strip out HTML markup
  • Search and replace
  • Word wrap or center text
  • Number lines
  • Extract e-mail addresses
  • Transform text using a scripting language

The difference between DataPipe and TextPipe is that DataPipe applies these changes to database files instead of text files. Specifically, it can connect to any database for which you have an OLE DB provider (which these days is just about everything). You can either choose an entire table to work with, or supply a query that retrieves only the rows that you want to alter. Then you can select, on a field-by-field basis, which TextPipe filters to apply. You can preview the results on sample data, and when you're happy, send the program off to modify the live data. It does this a row at a time so as to minimize locking issues.

If you haven't worked with TextPipe you may find the whole process a tad confusing. But once you've worked through the TextPipe tutorial it's obvious how it all fits together. For huge databases I'd still want to use a tool like SQL Server DTS, but for everyday data scrubbing this is a strong contender.

About the Author

Mike Gunderloy, MCSE, MCSD, MCDBA, is a former MCP columnist and the author of numerous development books.


comments powered by Disqus

Subscribe on YouTube