rspamd 100% cpu usage

[David Andlinger]

RSpamd freezes daily after 24 hours with 100% CPU usage.

‌

The log file of RSpamd becomes huge.

The last lines von rspamd.log

2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1271: Unable to get DMARC domain
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1068: Failed to schedule redis request
2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1271: Unable to get DMARC domain
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) rspamd_log_reset_repeated: Last message repeated 9 times
2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1068: Failed to schedule redis request
2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1271: Unable to get DMARC domain
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1068: Failed to schedule redis request
2020-06-19 15:24:35 #10605(controller) rspamd_redis_pool_new_connection: cannot connect to redis 127.0.0.1 (port 6379): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) rspamd_lua_redis_prepare_connection: cannot connect to redis (OS error): Cannot assign requested address
2020-06-19 15:24:35 #10605(controller) lua; lua_redis.lua:1071: cannot execute redis request
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1271: Unable to get DMARC domain
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed out
2020-06-19 15:24:35 #10605(controller) <44xbgf>; lua; dmarc.lua:1081: Lookup error [nil._report._dmarc.qq.com]: query timed

‌

[David Andlinger]

Disabling ‘Send DMARC reports’ fixes the problem. But that shouldn't be the solution to the problem.

[SH]

Try latest version, there was multiple internal changes which might solve the issue. If it doesn't help please reopen

Also sending DMARC reports generates a lot of emails which might not get accepted and generates bounce - you should use email box which discards all incoming emails for sending (introduced in latest version)