Microsoft Taps SQL Server PDW To Boost Security Forensics

Microsoft published details this month about how it used its own Parallel Data Warehouse (PDW) edition of SQL Server 2008 R2 to improve the performance of its company-wide security monitoring system.

The PDW edition is scheduled for release on HP's hardware appliance next month, which Microsoft announced last week. PDW features massive parallel processing capacity, which represents a step up in performance over other relational database management systems in the SQL Server 2008 R2 product line. With PDW, each node on the machine runs its own instance of SQL Server and has dedicated memory, storage and CPU power.

Microsoft began testing the PDW system during the Technology Adoption Program (TAP) stage to see if it could improve the performance of its proprietary network security monitoring solution, which is called Information Security Consolidated Event (ICE) 4.0.

ICE is used for Microsoft's forensic security analysis and research. However, Microsoft also deploys it as part of its efforts to secure its worldwide networks, consisting of more than 250,000 computers across more than 100 countries, according to a TechNet library article.

The aim of the TAP deployment was to scale ICE's capacity upward from its existing 60 terabytes of server log data. Microsoft also wanted to extend data retention times of the ICE data and improve overall system performance.

Microsoft claims in the TechNet article that it achieved all of those goals with the PDW deployment. Under the TAP program testing, the log data retention time was extended from 60 days to 90 days. The extract, transform and load handling increased from 1 terabyte per day to 4 terabytes per day. Complex queries ran an average of 20 times faster than they ran before Microsoft used PDW, the articles states. Microsoft had previously run its ICE solution on the 64-bit version of SQL Server 2008 R2.

More details about the Microsoft's internal PDW case study can be found in an October video presentation by Pete Loveless, a senior program manager for the Microsoft trustworthy computing group, who describes the TAP deployment. He said that query times had improved with PDW, even during peak loads. One query that took over one hour to complete with the earlier system took just four minutes with the PDW deployment, Loveless said.

About the Author

Kurt Mackie is senior news producer for 1105 Media's Converge360 group.


  • Microsoft Warns IT Pros on Windows Netlogon Fix Coming Next Month

    Microsoft on Thursday issued a reminder to organizations to ensure that their systems are properly patched for a "Critical"-rated Windows Netlogon vulnerability before next month's "update Tuesday" patch distribution arrives.

  • Microsoft Nudging Skype for Business Users to Teams

    Microsoft on Thursday announced some perks and prods for Skype for Business unified communications users, with the aim of moving them to the Microsoft Teams collaboration service instead.

  • How To Improve Windows 10's Sound and Video Quality

    Windows 10 comes with built-in tools that can help users get the most out of their sound and video hardware.

  • Microsoft Offers More 'Solorigate' Advice Using Microsoft 365 Defender Tools

    Microsoft issued yet another article with advice on how to use its Microsoft 365 Defender suite of tools to protect against "Solorigate" advanced persistent threat types of attacks in a Thursday announcement.

comments powered by Disqus