Troubleshooting workers
Using Jamroom
DannyA:
You need to do something about these names. too confusing.
Why is the conversion worker not called the conversion client like everything else?
Because it is the WORKER process that is doing the actual work on a worker server. The Conversion CLIENT runs on the front end and submits jobs to the SERVER, as well as receives updates from the WORKER. It is a 3 module setup - not just 2 like other cloud modules.
Quote:
And now you are calling them queue workers instead of clients.
Queue Workers - functions that execute jobs based on queues. These can be part of any module.
Queue Client - the Cloud Queue Client module that sends/receives queue entries from the Queue SERVER.
Quote:
At some point you had something called a master.
I tend to use "master" for the server host name that will run the following modules:
Cloud Conversion Server
Cloud Queue Server
Cloud Log Server
Cloud Cron Server
But you can call it whatever you want.
Also - I believe I understand the root cause of processes building up - go into your Cron Server and make sure it is pinging servers every 30 seconds instead of every 10 seconds. With a 30 second network timeout, if there is a network issue, there's going to be process buildups as new ones are going to be added every 10 seconds, but timeout after 30. I will change the default in the cloud modules to use 10 second timeouts instead of 30.
updated by @brian: 05/10/15 10:13:31AM