Wayfinder Server Data Issue: August 6th 2020

[Severlin]

Wayfinder experienced a significant issue during our data center work today that caused character data to be corrupted going back to the morning hours Eastern of July 15th. In order to correct this issue, we have had to roll Wayfinder back to about 7:30 AM Eastern on July 15th. This means that all character progress made since July 15th has been lost, and is not able to be restored.

We are currently working to capture and refund any points spent on character-based purchases made on Wayfinder during that time, and we will provide further information when it becomes available. That work is not expected to be completed this evening. All Account-based purchases remain intact. We will be providing more information in the coming days.

We deeply apologize to players on Wayfinder for this issue. We will be announcing make good gifts for affected players in the coming days. This is the first time in the game's history we have had to do this kind of rollback, and we intend to make sure we take steps to prevent a similar situation from happening in the future.

[Belzidar]

Wayfinder experienced a significant issue during our data center work today that caused character data to be corrupted going back to the morning hours Eastern of July 15th. In order to correct this issue, we have had to roll Wayfinder back to about 7:30 AM Eastern on July 15th. This means that all character progress made since July 15th has been lost, and is not able to be restored.

We are currently working to capture and refund any points spent on character-based purchases made on Wayfinder during that time, and we will provide further information when it becomes available. That work is not expected to be completed this evening. All Account-based purchases remain intact. We will be providing more information in the coming days.

We deeply apologize to players on Wayfinder for this issue. We will be announcing make good gifts for affected players in the coming days. This is the first time in the game's history we have had to do this kind of rollback, and we intend to make sure we take steps to prevent a similar situation from happening in the future.

Not really sure how to respond to that. Speechless actually.

[Nuvem]

Khyber players sweating like crazy right now. Myself included.


edit: I was joking but jesus. please, PLEASE tell us if something similar's happening with Khyber.

please.

[Cordovan]

Khyber players sweating like crazy right now. Myself included.


edit: I was joking but jesus. please, PLEASE tell us if something similar's happening with Khyber.

please.

No, this was specific to Wayfinder.

[MorsDeimos]

Wayfinder experienced a significant issue during our data center work today that caused character data to be corrupted going back to the morning hours Eastern of July 15th. In order to correct this issue, we have had to roll Wayfinder back to about 7:30 AM Eastern on July 15th. This means that all character progress made since July 15th has been lost, and is not able to be restored.

We are currently working to capture and refund any points spent on character-based purchases made on Wayfinder during that time, and we will provide further information when it becomes available. That work is not expected to be completed this evening. All Account-based purchases remain intact. We will be providing more information in the coming days.

We deeply apologize to players on Wayfinder for this issue. We will be announcing make good gifts for affected players in the coming days. This is the first time in the game's history we have had to do this kind of rollback, and we intend to make sure we take steps to prevent a similar situation from happening in the future.

I was definity affected. Character(s) lost level / gear.... I will try and make the best of it. That's pretty good that this is the first time in the game's history. I remember playing everquest and my guild just lost all it's raid loot due to a server crash. Happened at least twice with us.

[Spl1tz]

A minute of silence for the players on Wayfinder.


F

[clashjunky]

Wayfinder experienced a significant issue during our data center work today that caused character data to be corrupted going back to the morning hours Eastern of July 15th. In order to correct this issue, we have had to roll Wayfinder back to about 7:30 AM Eastern on July 15th. This means that all character progress made since July 15th has been lost, and is not able to be restored.

We are currently working to capture and refund any points spent on character-based purchases made on Wayfinder during that time, and we will provide further information when it becomes available. That work is not expected to be completed this evening. All Account-based purchases remain intact. We will be providing more information in the coming days.

We deeply apologize to players on Wayfinder for this issue. We will be announcing make good gifts for affected players in the coming days. This is the first time in the game's history we have had to do this kind of rollback, and we intend to make sure we take steps to prevent a similar situation from happening in the future.

I am sure noone is happy about this and I appreciate that our toons were not deleted entirely but we just lost about 3 weeks of Progress. Not Good, this is not Good.

Lost: 20 character levels, 144k Rexp on Karisan and around 40k on Ramasa, estimated 6k sentient exp, mythic 4 loot, time spent emptying the TR cache, 2 flametouched heavy Xbows(one with a red slot), a cold iron heavy repeater(no slot), a flametouched heavy repeater(no slot), great sword, long sword and heavy mace with a red and purple slot, and more stuff i can't think of right now. Still reeling from the situation.

[Nuvem]

No, this was specific to Wayfinder.

Okay, phew. That's good to hear.


Still, really sad situation. I don't wanna pile up on what's about to become a probably very angry/frustrated mob, but yeah... wow. sucks big time. wish you all the best, and that you manage to get Wayfinder players whatever should feel fair to compensate.

as a suggestion, I have been farming Ravenloft like crazy for the fast few weeks since I don't actually own it, and would be devastated if I lost all my RL loot from the last three weeks and had only three more to get them all again and still farm for the rest.

[seldarin]

Wayfinder experienced a significant issue during our data center work today that caused character data to be corrupted going back to the morning hours Eastern of July 15th. In order to correct this issue, we have had to roll Wayfinder back to about 7:30 AM Eastern on July 15th. This means that all character progress made since July 15th has been lost, and is not able to be restored.

We are currently working to capture and refund any points spent on character-based purchases made on Wayfinder during that time, and we will provide further information when it becomes available. That work is not expected to be completed this evening. All Account-based purchases remain intact. We will be providing more information in the coming days.

We deeply apologize to players on Wayfinder for this issue. We will be announcing make good gifts for affected players in the coming days. This is the first time in the game's history we have had to do this kind of rollback, and we intend to make sure we take steps to prevent a similar situation from happening in the future.

Wow. I mean, I am not familiar with the gaming environment backend, but I am familiar with the concept of servers and backups. In all my years of working on servers, we ran backups every night, of varying sorts and verified them for successful completion each day. Does that not occur with gaming servers? How is it possible to lose three weeks worth of data and have no means of restoring it?

[Annex]

I am sorry for everyone on Wayfinder. That really sucks.

[Belzidar]

Just so I'm sure here. Everything we have done in the past 2 weeks or so is gone? Xp, lvls gained, rxp, tr's, gear.etc.....Gone?

[Memnir]

...wow.

[Loromir]

Just so I'm sure here. Everything we have done in the past 2 weeks or so is gone? Xp, lvls gained, rxp, tr's, gear.etc.....Gone?

I'm thinking a couple a free otto's boxes per account that logged on during that time would be reasonable. Maybe throw in a couple of raiders boxes as well.

[Acrisius]

Now, what would *really* suck is if a player had transferred a character from another world to Wayfinder during that lost period. They would be *GONE*. I doubt very much that anyone is in that situation, but...
This is what my coworkers would call a "resume-generating event". I hope it doesn't turn out that way, as we've all been there (literally lost data, or a similar catastrophe).

Thanks for the open communication, SSG. A lesser company might have tried to whitewash the situation. I know you folks will do your best to make it right. Shake it off, learn from it, and move forward.

[Michaelaz2]

I'm thinking a couple a free otto's boxes per account that logged on during that time would be reasonable. Maybe throw in a couple of raiders boxes as well.

I was waiting for the first "Gimme gimme" post , you didnt disappoint

#RIPWayfinder

[Ganak]

Things go bump in the night; what matters is how you respond.


Please postpone further maintenances until RCA and corrective actions are complete. This is a big deal.

[Loromir]

I was waiting for the first "Gimme gimme" post , you didnt disappoint

#RIPWayfinder

Not for me...I don't play on wayfinder. My server is just fine (Cannith). I'm thinking about those poor lonely souls on wayfinder.

[Vulkoorex]

Utterly ridiculous.

That's like month time of play gone. Just like that.

[GrilloPanda]

Wayfinder experienced a significant issue during our data center work today that caused character data to be corrupted going back to the morning hours Eastern of July 15th. In order to correct this issue, we have had to roll Wayfinder back to about 7:30 AM Eastern on July 15th. This means that all character progress made since July 15th has been lost, and is not able to be restored.

We are currently working to capture and refund any points spent on character-based purchases made on Wayfinder during that time, and we will provide further information when it becomes available. That work is not expected to be completed this evening. All Account-based purchases remain intact. We will be providing more information in the coming days.

We deeply apologize to players on Wayfinder for this issue. We will be announcing make good gifts for affected players in the coming days. This is the first time in the game's history we have had to do this kind of rollback, and we intend to make sure we take steps to prevent a similar situation from happening in the future.

I Am Groot mode: ON.

Rest In Pepperoni.

[Belzidar]

Just so I'm sure here. Everything we have done in the past 2 weeks or so is gone? Xp, lvls gained, rxp, tr's, gear.etc.....Gone?

Finally could log on and see the damage. My lvl 25 is back to 16. All the rxp that toon had earned is gone, lost a reaper point not to mention the levels. My lvl 16 that I had tr'd is back to lvl 16 from his previous life. Still reeling a bit.
I understand it's a game and yes I did get entertainment value from the last 2 weeks but still...this will be hard to take I think.