Forum Activity for @claygordon

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Brian - sent. However, once the disk filled again the system was unreachable.

We ended up doing a complete backup from the terminal, downloaded everything, wiped the disk, and then did a reinstall. Things appear to be looking good and the response is very fast.

However, I did notice some critical errors in the activity log. I am not sure if these are a remnant of something from the install.

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Can I send you credentials to the support email? There is still an account for you – I need to refresh the password.

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Also see attached

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

I have turned off slow query logging and query logging but they are still being logged.

developer: slow query took 422ms

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Brian:

The slow query log is disabled. I don’t think it has ever been set to a time.

I will get the admin log and email it to you.

Thanks!

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

I don’t know how many pages there are in the Activity Log there is no indicator – just the number of posts/page – but there appear to be LOTS of pages in the activity log. 100GB in a week?

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Many developer: slow query took
core: 404 Page not found: that look to be spiders (favicon.ico e.g.)

The debug log is not that huge but there is this:


ACP
Dashboard
Users Online
Pending
Activity Log
Data Browser
Recycle Bin
Queue Viewer
MailGun
Activity Log
Debug Log
Error Log
Debug Log

(2024-04-29T15:24:03-06:00.0.40908500 : 0.036)-(mem: 4MB)-(pid: 3213661)-(ip: 51.222.253.3)-(sid: vri82g7q5npe7iudedn3djhilj)-(url: https://archive.thechocolatelife.com/angela-pettypiece/timeline/3219)
|core: recursive module trigger detected for jrCore/db_get_item|

and this:
(2024-04-29T15:24:03-06:00.0.40908500 : 0.036)-(mem: 4MB)-(pid: 3213661)-(ip: 51.222.253.3)-(sid: vri82g7q5npe7iudedn3djhilj)-(url: https://archive.thechocolatelife.com/angela-pettypiece/timeline/3219)
Array
(
[event] => db_get_item
[module] => jrCore
[trace] => Array

And this one

(2024-04-30T21:07:54-06:00.0.75795900 : 0.03)-(mem: 2MB)-(pid: 3912950)-(ip: 52.14.8.34)-(sid: g4kpt4f0880q8qu4svmeifhk9q)-(url: https://archive.thechocolatelife.com/jack-meyer/timeline/514)

With hundreds of lines after this – but not a huge file.

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Oops - forgot this screenshot. The DB is now 149GB. Did I flip a toggle somehow?

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

Taking a look at the server, I see that my disk is now 99% full.

I am kind of wondering what might NOW be consuming 182 of 194GB of disk. When I reported this a couple of days ago the disk was showing 62GB in use.

I turned of the INF and DBG logging and put all the logs on a 3-day purge cycle. My developer tells me that most of the uptick in space usage is the DB.

Suddenly very slow performance – SLOOOOOW database performace

Installation and Configuration

After making a bunch of changes, system performance feels much more responsive even though running the Performance Check still returns an absurdly big result (greater than 50). Looking at the activity log I see a lot of the following entries – most of them from the same IP addresses:

developer: slow query took 276ms (associated with AWS)
developer: slow query took 450ms (associated with Google)

Slow db query logging is turned off in Global Config

I am also getting the following when trying to take a look at the Error Log from the Dashboard:

Unable to process your request
The system has encountered an unrecoverable error - please try again shortly

AND I found a typo in a help message in Global Config • Developer Settings in the Developer Settings tab, Developer is misspelled:

If this option is enabled, additional tools for rebasing and resetting the system will appear in the Develope Tools -- Tools menu
Default: off