Product Reviews

Clean Up Those Databases!

Customizable filtering from DataPipe

DataPipe is built on top of Crystal Software's TextPipe Pro (which I reviewed in the previous issue of Developer Central), and indeed, it includes a bundled copy of TextPipe Pro. It uses TextPipe filters to perform the same variety of tasks as TextPipe, for example:

  • Add new text at the start or end of a line
  • Reverse selected text
  • Change case
  • Strip out HTML markup
  • Search and replace
  • Word wrap or center text
  • Number lines
  • Extract e-mail addresses
  • Transform text using a scripting language

The difference between DataPipe and TextPipe is that DataPipe applies these changes to database files instead of text files. Specifically, it can connect to any database for which you have an OLE DB provider (which these days is just about everything). You can either choose an entire table to work with, or supply a query that retrieves only the rows that you want to alter. Then you can select, on a field-by-field basis, which TextPipe filters to apply. You can preview the results on sample data, and when you're happy, send the program off to modify the live data. It does this a row at a time so as to minimize locking issues.

If you haven't worked with TextPipe you may find the whole process a tad confusing. But once you've worked through the TextPipe tutorial it's obvious how it all fits together. For huge databases I'd still want to use a tool like SQL Server DTS, but for everyday data scrubbing this is a strong contender.

About the Author

Mike Gunderloy, MCSE, MCSD, MCDBA, is a former MCP columnist and the author of numerous development books.


  • Gears

    Top 10 Microsoft Tips and Analyses of 2018

    Here are the year's most popular explainers and how-to columns -- along with some plain, old "Why did Microsoft do that?" musings thrown in.

  • Sign

    2018 Microsoft Predictions Revisited

    From guessing the fate of Windows 10 S to predicting Microsoft's next big move with Linux, Brien's predictions from a year ago were on the mark more than they weren't.

  • Microsoft Recaps Delivery Optimization Bandwidth Controls for Organizations

    Microsoft expects organizations using its Delivery Optimization peer-to-peer update scheme will optimally see 60 percent to 70 percent improvements in terms of network bandwidth use.

  • Getting a Handle on Hyper-V Virtual NICs

    Hyper-V usually makes it easy to configure virtual network adapters within VMs. That is, until you need to create a VM containing multiple virtual NICs.

comments powered by Disqus
Most   Popular

Office 365 Watch

Sign up for our newsletter.

Terms and Privacy Policy consent

I agree to this site's Privacy Policy.