Write what you are looking for and press enter to begin your search!

Logo
live-news-icon

Live News

Corpse Party II: Darkness Distortion to Launch in Fall 2024: In an intense match, the Lone Wolves came out victorious. Read all about the big night here // HBO GO April 2024: Our Picks & Highlights: In an intense match, the Lone Wolves came out victorious. Read all about the big night here // Godzilla X Kong Sighted At Dataran Merdeka In KL, Malaysia: In an intense match, the Lone Wolves came out victorious. Read all about the big night here
post-16 post-13

Epic Games: Server Overload Causes Fortnite Outage Last Weekend

Fortnite developers, Epic Games has attributed last weekend’s outtage to severe overload of their servers, which caused recurring interruptions for players. It was reported that the game hit a peak of 3.4 million concurrent users which mainly led to the disruption – definitely a problem other companies would kill to have. Official announcement and description which was released on the dev’s website read (in case you’re into these things) :

The extreme load caused 6 different incidents between Saturday and Sunday, with a mix of partial and total service disruptions to Fortnite.

“… Fortnite has a service called MCP (remember the Tron nemesis?) which players contact in order to retrieve game profiles, statistics, items, matchmaking info and more. It’s backed by several sets of databases used to persistently store this data. The Fortnite game service is our largest database to date.

The primary MCP database is comprised of 9 MongoDB shards, where each shard has a writer, two read replicas, and a hidden replica for redundancy. At a high level user specific data is spread across 8 shards, whereas the remaining shard contains matchmaking sessions, shared service caches, and runtime configuration data.

The MCP is architected such that each service has a db connection pool to a sidecar process that in turn maintains a connection pool to all of our shards. At peak the MCP handles 124k client requests per second, which translates to 318k database reads and 132k database writes per second with a sub 10ms average database response time. Of that, matchmaking requests account for roughly 15% of all db queries and 11% of all writes across a single shard. In addition our current matchmaking implementation requires data to be in a single collection.

At peak we see an issue where the matchmaking shard begins queuing writes waiting on available writer resources. This can cause db update times to spike in the 40k+ ms range per operation causing MCP threads to block. Players experience unusually long wait times not just attempting to matchmake, but with all operations.  We have investigated this in detail and it is currently unclear to us and support why our writes are being queued in this way but we are working towards a root cause.

This issue does not recover and the db process soon becomes unresponsive, at which point we need to perform a manual primary failover in order to restore functionality. During these outages this procedure was being repeated multiple times per hour. Each failover causing a brief window of matchmaking instability followed by recovery.”

TL;DR – Our system could not handle so many players at once.

However, Epic did not disclose how many percent of these players logged-in were playing the free-to-play version of Fortnite, PUBG rival, Battle Royale mode and whether they purchased the the full game. Regardless, expect improvements on Epic Games’ end as they sought to put full focus on the game having shut down its MOBA, Paragon, and moving the team to work on Fortnite.


Related News

post-07
Forza Horizon 5 Player Given 8,000 Year Ban For Kim Jong-Un Livery

Liveries are what makes Forza Horizon 5's paint jobs all the more interesting, especially custom-made ones from creative fans. One particular fan has ...

post-07
XDefiant Might Be The Refinement Call of Duty Players Are Looking For

The closed beta for Ubisoft's new multiplayer shooter has done something no other game in its catalogue has done in years: garnered actual interest am...

post-07
Ex-Aeon Must Die! Developers Released Public Statement About Upcoming Game

Mishura Games, the former developers of the then-cancelled-but-now-on-Steam-again indie game Aeon Must Die!, just released a public statement about th...

Write a comment

Your email address will not be published. Required fields are marked *

Tournament Tool Kit

Kakuchopurei Community