Stores queue consumes too much CPU and memory

Issue #328 resolved
Ed McDonagh created an issue

Need to work out why, and if using a celery task/queue is really the right thing to do...

Comments (15)

  1. Ed McDonagh reporter

    I don't know. I don't think it is that. It might just be that running a long task like that is inappropriate for Celery. Maybe I should just run it without Celery, with a loop to check if we've asked it not to run anymore, and Celery Beat to start and restart it if it stops.

  2. Ed McDonagh reporter

    StoreSCP from web interface no longer starts a celery task. Starts and stops successfully from the web interface. TODO: command line start and rethink logging. Refs #328

    → <<cset 42f4742b33c0>>

  3. Ed McDonagh reporter

    Added basic logging configuration, with override of key values in the example Only applies to web_store function so far. Refs #328

    → <<cset ecb74cf3b743>>

  4. Ed McDonagh reporter

    Changed all of qrscu to use the new log. Seems to work, and continues to log to the celery log too, but for some reason that is at DEBUG level. Refs #328

    → <<cset 0c0e30119246>>

  5. Ed McDonagh reporter

    Store SCP no longer uses Celery, so this task should be closed. Ref #337 takes on the new problems that have arisen as a consequence!

  6. Log in to comment