search.go: limit media searches to prevent exceeding appengine memory limit

When stress testing the search page, we found that searching for an hour or more of audio crashed the instance of vidgrind. This was the error:

{
  "textPayload": "Exceeded hard memory limit of 384 MiB with 390 MiB after servicing 108 requests total. Consider setting a larger instance class in app.yaml.",
  "insertId": "651e49a2000a2e23b984b064",
  "resource": {
    "type": "gae_app",
    "labels": {
      "module_id": "default",
      "zone": "australia-southeast1-3",
      "version_id": "9",
      "project_id": "vidgrind"
    }
  },
  "timestamp": "2023-10-05T05:29:06.667171Z",
  "severity": "INFO",
  "labels": {
    "clone_id": "00fd0ee57bd1d826001e45472156ef451203cc334f07a021d9aa81639ffb812e9bb81ab9fe46b703c43b19ae5e9d34509c64453f591ad597444061c99bdf0c1f6e6351"
  },
  "logName": "projects/vidgrind/logs/varlog%2Fsystem",
  "receiveTimestamp": "2023-10-05T05:29:07.000207086Z"
}

Searches should not exceed this limit so we should check the results' size in the search handler.

Comments (1)