Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

Hey everyone,

You'll have noticed a lot of server errors - 500s and 404s today.

This is because I'm hitting memory caps on my shared hosting and their procwatch daemon is literally killing of processes from barrens.chat all the time.

I am currently in the process of moving the site to a managed VPS with more RAM for the moment to give some breathing room whilst I debug where this high memory usage is coming from.

The site may go down completely for a bit and I don't really know when this will happen either - but don't worry - I have everything backed up including the database.

Really sorry it's been a shitty experience for you today, doing my best to bring things back under control.

Your boy Teeb
Update:

We're on the VPS now.

There's hundreds of 35.x.x.x Google Cloud IP addresses hitting the site a lot at the moment which is what may have caused the spike in memory leading to the failures earlier. So not really a RAM issue due to real traffic, more to do with whatever the fuck this bot or person is trying to do to the site. It's not a security concern because I've talked with the sysadmins and they say they'd see that and haven't yet.

If they're still there tomorrow morning I'll consider block IP banning that range (have been advised that if it is a google managed IP range this won't affect anyone legitimate trying to access the site).

Anyway it's 2am here so I have to go to sleep.

Please guys if you carry on experiencing any issues LET ME KNOW HERE so that I can look into it more tomorrow. Any 500 errors 'page not found' or any of that crap from earlier today let me know.
Another update, looks like a DDoS attack. Why someone would want to deny service to this place is beyond me, really.

Going to get some sleep now (I mean it this time lol), hosts are aware. Might have to get cloudflare up tomorrow or something.

Mulgore
User avatar
donator Posts: 184
Likes: 136
Tauren
5 years ago (Beta)
 •  Unread

Ha! Was just about to report this.

I have nothing fancy to add here, but if you've never played Binary Domain, you should.
User avatar
US Smolderweb
donator Posts: 165
Likes: 164
Orc
Warrior
5 years ago (Beta)
 •  Unread

The requested post could not be found.

Warsong Gulch
User avatar
donator Posts: 34
Likes: 40
Undead
Rogue
5 years ago (Beta)
 •  Unread

We need a custom 5XX error-page. Something that says/looks like the wow login-queue.

   Dolamite
Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

Welp, looks like we're hitting memory limits. I've been expecting this - may have to move to a new server boys.

Dreamhost wrote:Thank you for reaching out to us on Twitter, I wanted to follow up with
you here.

I took a look at your server and see what was causing the 500, 404 and
latency issues you are reporting. Looking into your error logs, I'm
showing a bunch of premature end of script headers, specifically for
viewtopic.php.

[Wed May 29 10:23:36 2019] [error] [client 34.90.112.229] Premature end
of script headers: viewtopic.php

After further investigation, your site is hitting procwatch for excessive
memory usage for a total of 14730 times.

Wed May 29 11:04:24 2019 procwatch3 INFO: PID 20079 (php71.cgi)
thobru14:pg9280716 - 44.7MB ram, 3.66 sec cpu: killed for uid ram (total
1148.8 exceeds limit 500.0; score -44.66)

The below information is the number of times the files or directories are
being called/visited the most:

<lots of blablabla>

Since it appears that you have a significant amount of traffic to your
site, I would highly suggest moving your site to a VPS to help with
performance and stability. I would recommend at least a 2GB RAM VPS.

https://www.dreamhost.com/hosting/vps/

User avatar
US Smolderweb
donator Posts: 165
Likes: 164
Orc
Warrior
5 years ago (Beta)
 •  Unread

Time to start running ads, teebs!

Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

Escalotes wrote:
5 years ago
Time to start running ads, teebs!
Ewww... never.

Feralas
User avatar
donator Posts: 71
Likes: 53
Horde
Hunter
5 years ago (Beta)
 •  Unread

Check out Scaleway. They have the simplicity of DigitalOcean but the prices are much better.

https://www.scaleway.com/en/pricing/

Full bore!
Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

Alright guys I'm trialling a month of VPS with Dreamhost to see if 1GB RAM is enough. You may see a blackout as the transfer happens (and when this happens I don't know).

If not I'm going to have to do some serious debugging for memory usage.

   Dolamite
Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

Update:

We're on the VPS now.

There's hundreds of 35.x.x.x Google Cloud IP addresses hitting the site a lot at the moment which is what may have caused the spike in memory leading to the failures earlier. So not really a RAM issue due to real traffic, more to do with whatever the fuck this bot or person is trying to do to the site. It's not a security concern because I've talked with the sysadmins and they say they'd see that and haven't yet.

If they're still there tomorrow morning I'll consider block IP banning that range (have been advised that if it is a google managed IP range this won't affect anyone legitimate trying to access the site).

Anyway it's 2am here so I have to go to sleep.

Please guys if you carry on experiencing any issues LET ME KNOW HERE so that I can look into it more tomorrow. Any 500 errors 'page not found' or any of that crap from earlier today let me know.

   Dolamite Minorou
Tirisfal Glades
User avatar
donator Posts: 176
Likes: 131
Undead
Priest
5 years ago (Beta)
 •  Unread

Thanks for working your ass off so the rest of us can continue to argue :P ... but seriously, get some rest man. You've earned it.

<Extreme>
Council Chairman
US-Horde
Blaumeux
Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

Another update, looks like a DDoS attack. Why someone would want to deny service to this place is beyond me, really.

Going to get some sleep now (I mean it this time lol), hosts are aware. Might have to get cloudflare up tomorrow or something.

Feralas
User avatar
donator Posts: 71
Likes: 53
Horde
Hunter
5 years ago (Beta)
 •  Unread

teebling wrote:
5 years ago
Another update, looks like a DDoS attack. Why someone would want to deny service to this place is beyond me, really.

Going to get some sleep now (I mean it this time lol), hosts are aware. Might have to get cloudflare up tomorrow or something.
Are you positive it isn't just Googlebot or something else crawling the site?

Full bore!
Hillsbrad Foothills
User avatar
US Sulfuras
donator Posts: 177
Likes: 141
5 years ago (Beta)
 •  Unread

@teebling Have a donation page with special ranks. like 4 tiers. $5 Tier 1, $10 Tier 2 and so on. I'd gladly donate to help keep this site a float and to get a cool rank/image near my name.

   teebling Empyrean IronBrutzler Selexin neofrag Merode Minorou
Warrior Protection
User avatar
EU Hydraxian Waterlords
donator Posts: 1325
Likes: 2548
Orc
Warrior
5 years ago (Beta)
 •  Unread

acrmojt wrote:
5 years ago
teebling wrote:
5 years ago
Another update, looks like a DDoS attack. Why someone would want to deny service to this place is beyond me, really.

Going to get some sleep now (I mean it this time lol), hosts are aware. Might have to get cloudflare up tomorrow or something.
Are you positive it isn't just Googlebot or something else crawling the site?
Yep - Googlebot has a unique IP and even has an account in barrens chat. It crawls conservatively as per robots.txt - this is certainly not google’s web crawler it’s someone abusing their commercial cloud like a botnet.

Alterac Valley
User avatar
donator Posts: 281
Likes: 104
Human
Paladin
5 years ago (Beta)
 •  Unread

Knoxtane wrote:
5 years ago
@teebling Have a donation page with special ranks. like 4 tiers. $5 Tier 1, $10 Tier 2 and so on. I'd gladly donate to help keep this site a float and to get a cool rank/image near my name.
Yeah if you need Help with the Cost i and i think some others will help.

   Merode
My Classic Chars:
Manofwar
Kampfzwerg
Mojo
Rogue Assassination
User avatar
donator Posts: 7
Likes: 11
Human
Priest
5 years ago (Beta)
 •  Unread

Maybe a Patreon page to alleviate monthy server / maintenance cost. I think ot would be fair if community could contribute to keeping this site functional and ad-free.

   Escalotes
One unbreakable shield against the coming darkness
One last blade forged in defiance of fate
Let them be my legacy to the galaxy I conquered
And my final gift to the species I failed
Arathi Highlands
User avatar
donator Posts: 27
Likes: 12
Gnome
Mage
5 years ago (Beta)
 •  Unread

Throw us some ads!

User avatar
donator Posts: 30
Likes: 31
Troll
Hunter
5 years ago (Beta)
 •  Unread

Glad to see its fixed, had the issue other day. Wasn't sure if had to clean cookies/cache cause i remember seeing a thread mention we have to do that for here iirc

Priest Holy
User avatar
EU Wyrmthalak
donator Posts: 32
Likes: 10
Troll
Priest
5 years ago (Beta)
 •  Unread

Looks like the website had its own type of 'stress test' :confused:

| Casp - Troll Priest | <Zandalar Tribe> |
Similar topics
to 'Server issues today'
Posts ViewsLast post