Xbox’s Chief Technology Officer Offers Transparency and Explanation

Xbox’s Chief Technology Officer, Scott Van Vliet, has provided a detailed explanation for the recent system and service outage that affected game libraries, sign-in, and game launching for many players. The outage occurred from late Sunday night and well into Monday, causing widespread disruptions and frustration among gamers.

According to Van Vliet, the issue was caused by a failure of a licensing service that sits outside of Xbox, but which Xbox depends upon. This service, an internal Microsoft system shared across multiple products, failed to perform its intended function, leading to a cascade of errors and failures. The outage affected various aspects of the Xbox service, including sign-in scenarios, game launching, and entitlement checks.

Root Cause and Impact

The Xbox CTO attributed the outage to a single point of failure in the licensing service, which had a ripple effect on the entire system. The service was critical to the functioning of Xbox, as it enabled users to access their game libraries, launch games, and perform various other tasks. The failure of this service resulted in a significant number of users experiencing issues with sign-in, game launching, and other related services.

The outage also affected several publishing and store partners who depend on the same systems, leading to issues in specific games and not others. Van Vliet acknowledged that this was an unacceptable situation and that Xbox must do better to support its users.

Response and Recovery

Van Vliet explained that Xbox’s on-call teams caught the first signals of the outage through automated monitoring and declared a major incident. The team worked quickly to isolate the failing infrastructure and shift traffic onto the healthy parts of the system. However, the recovery process was uneven across regions, with some users recovering hours before others.

Van Vliet emphasized that the company is committed to learning from this experience and improving its services. He stated that a full post-incident review is underway to identify the root cause of the failure and to implement changes to prevent such outages in the future.

The review will focus on several key areas, including hardening the dependencies underneath sign-in and game launch, improving how the company detects and contains this class of failure, and being faster and clearer with users when something breaks. Van Vliet expressed his commitment to doing better and thanked Xbox gamers for their patience.

Next Steps

Xbox is preparing for the launch of Halo: Campaign Evolved, a highly anticipated remake and 25th-anniversary celebration of the original Xbox’s killer app. The company is committed to delivering a high-quality experience for its users and is taking steps to prevent similar outages in the future.

Van Vliet’s statement serves as a reminder that even the most well-established companies can experience technical difficulties. However, it is the response and commitment to improvement that truly matter.