The Schwartz Cloud Report

Blog archive

Microsoft Explains Recent Cloud Outage

Wondering what caused the outage that brought down some of Microsoft's cloud services two weeks ago? While Microsoft attributed it to a DNS error, that was all the company was saying at the time.

The three-hour outage occurred on the evening of Sept. 8 and affected Windows Live services such as SkyDrive, MSN and Hotmail for three hours. Also affected was Microsoft's Office 365 service.

Arthur de Haan, VP of Windows Live test and service engineering at Microsoft, elaborated on the incident in a blog post on Tuesday night, explaining a corrupt file in the company's DNS service was to blame.

Microsoft was in the process of updating a tool that helps balance network traffic and the update went awry, he noted. Consequently, the configurations were corrupted, resulting in the outage, he said.

"The file corruption was a result of two rare conditions occurring at the same time," de Haan said.  "The first condition is related to how the load balancing devices in the DNS service respond to a malformed input string (i.e., the software was unable to parse an incorrectly constructed line in the configuration file). The second condition was related to how the configuration is synchronized across the DNS service to ensure all client requests return the same response regardless of the connection location of the client. Each of these conditions was tracked to the networking device firmware used in the Microsoft DNS service."

He said Microsoft intends to further harden the DNS service to by providing greater redundancy and failover capability.

Posted by Jeffrey Schwartz on 09/21/2011 at 1:14 PM


Featured

  • Old Stone Wall Graphic

    Microsoft Addressing 36 Vulnerabilities in December Security Patch Release

    Microsoft on Tuesday delivered its December bundle of security patches, which affect Windows, Internet Explorer, Office, Skype for Business, SQL Server and Visual Studio.

  • Microsoft Nudging Out Classic SharePoint Blogs

    So-called "classic" blogs used by SharePoint Online subscribers are on their way toward "retirement," according to Dec. 4 Microsoft Message Center post.

  • Datacenters in Space: OrbitsEdge Partners with HPE

    A Florida-based startup is partnering with Hewlett Packard Enterprise in a deal that gives new meaning to the "edge" in edge computing.

  • Windows 10 Hyper-V vs. Windows Server Hyper-V: Which Platform for Which Workloads?

    The differences between these two Hyper-V versions are pretty significant, depending on what you plan to use them for. Here's a quick rundown of each platform, from their features to licensing quirks to intended use cases.

comments powered by Disqus

Office 365 Watch

Sign up for our newsletter.

Terms and Privacy Policy consent

I agree to this site's Privacy Policy.