Retrieving RDSRS from Agfa Enterprise Imaging for Radiology PACS interrupted

[wens]

We encountered much trouble retrieving RDSRs from our new PACS,

Movescu accepted associations get interrupted.

@Luuk has solved this problem.

Also covers incorrect removal of responses if StudyDescription or StationName filtering is used and values are missing or blank.

Also covers need for TypeError when checking for numeric values

[Ed McDonagh]

How was it solved @wens , @Luuk ?

Is it something we can learn from?

I have an AGFA PACS that I have inconsistent responses from, but I don’t know if it is a local config issue or something in our code.

[Luuk]

Is it Agfa Enterprise Imaging for Radiology? We are having that one now and we get inconsistent responses and associations that are being aborted by the PACS. I think Wens will push the fix (work-around).

Just requesting a new association (if needed) and retrying the c-move request, seems to “solve” the issue.

I now get (sometimes) the following error in the celery worker log (but I don’t know if it is related, it seems it is):

[2020-10-07 01:06:49,788: ERROR/Worker-1] Error -5 while decompressing data: incomplete or truncated stream
Traceback (most recent call last):
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\association.py", line 1995, in _wrap_get_move_responses
transfer_syntax.is_deflated
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\dsutils.py", line 61, in decode
zlib.decompress(bytestring.getvalue(), -zlib.MAX_WBITS)
zlib.error: Error -5 while decompressing data: incomplete or truncated stream

And the main issue with that is that it also seems that RabbitMQ is crashing on that (but we might try upgrading, we are (still) running the 3.7 branch):

2020-10-07 01:06:52.131 [error] <0.439.0> ** Generic server rabbit_mgmt_external_stats terminating
** Last message in was emit_update
** When Server state == {state,8192,[{{io_file_handle_open_attempt,count},10396},{{io_file_handle_open_attempt,time},16000},{{io_read,bytes},1},{{io_read,count},9},{{io_read,time},0},{{io_reopen,count},0},{{io_seek,count},2071},{{io_seek,time},530998},{{io_sync,count},2093},{{io_sync,time},4854989},{{io_write,bytes},1309459},{{io_write,count},2093},{{io_write,time},1279992},{{mnesia_disk_tx,count},25},{{mnesia_ram_tx,count},267},{{msg_store_read,count},0},{{msg_store_write,count},0},{{queue_index_journal_write,count},6180},{{queue_index_read,count},0},{{queue_index_write,count},5}],{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},undefined,5000}
** Reason for termination ==
** {eacces,[{erlang,open_port,[{spawn,"C:\Windows\system32\cmd.exe /c handle.exe /accepteula -s -p 3956 2> nul"},[binary,stderr_to_stdout,stream,in,hide]],[{file,"erlang.erl"},{line,2122}]},{os,cmd,2,[{file,"os.erl"},{line,250}]},{rabbit_mgmt_external_stats,get_used_fd,1,[{file,"src/rabbit_mgmt_external_stats.erl"},{line,133}]},{rabbit_mgmt_external_stats,get_used_fd,0,[{file,"src/rabbit_mgmt_external_stats.erl"},{line,61}]},{rabbit_mgmt_external_stats,'-infos/2-lc$^0/1-0-',2,[{file,"src/rabbit_mgmt_external_stats.erl"},{line,175}]},{rabbit_mgmt_external_stats,emit_update,1,[{file,"src/rabbit_mgmt_external_stats.erl"},{line,364}]},{rabbit_mgmt_external_stats,handle_info,2,[{file,"src/rabbit_mgmt_external_stats.erl"},{line,351}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,616}]}]}
2020-10-07 01:06:52.131 [error] <0.439.0> CRASH REPORT ……..

‌

[Ed McDonagh]

I don’t know the specific AGFA PACS version name.

Is it feasible to setup a 1.0 docker release to mimic the same QR? Both pynetdicom and Celery have changed a fair bit since the versions you will be relying on I think.

[Ed McDonagh]

@wens - did you commit some changes to a new branch early this afternoon, but then delete them or something? I have an email alert and can link to them from there, but I can’t find the changes or branch if I browse or search for them!

[wens]

If move didn't succeed, try to make new association, if needed. Refs #858

→ <<cset 1691db80a10d>>

[wens]

Hi Ed, I had to unclutter many many versions of openrem on my computer. I have pushed the work-around

[Ed McDonagh]

Converting line endings to Unix from Windows, among other reasons so that the diff views work on Bitbucket! Refs #858

→ <<cset 13c5ab6c945a>>

[Ed McDonagh]

Removing all the unicode markers before modifying tests to show incorrect behaviour as per ref #858

→ <<cset a5d041511fe7>>

[Ed McDonagh]

THIS WILL FAIL. Adding in two responses without populated station name or study descriptions to demonstrate failure reported in ref #858

→ <<cset d83d0eab484c>>

[Ed McDonagh]

Tests now run, responses with no or blank StationName or StudyDescription will now always be kept for both inc and exc. Refs #858

→ <<cset 62f30e877dfa>>

[Ed McDonagh]

Adding in the TypeError that is returned for NoneType values, as per Pull Request #414. Refs #858

→ <<cset bb815bc0be0f>>

[Ed McDonagh]

Updated Description to include the changes covered.

[Ed McDonagh]

@wens , @Luuk - do you know what the specific error is when the move is interupted?

[Luuk]

The C-Move connection is aborted by the SCP. I think the SCP has some time-out that aborts the association after nn seconds. The error in OpenREM is “Move of study 187, series 1: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 194, failed: 0, warning: 0.”

[Ed McDonagh]

Thanks Luuk. Do you have the error that is returned by your code before restarting the connection?

[Ed McDonagh]

Attempt to reimplement @LuukO and @wens solution to move requests aborting mid-move. Needs testing. Refs #858

→ <<cset a0a2829a5b8a>>

[Luuk]

@Ed McDonagh , To reply on your question of 23-10. I see the following errors in the celery log, before I get the above message in the qr-log:

[2020-11-08 01:06:12,339: ERROR/Worker-1] Failed to decode the received Identifier dataset
[2020-11-08 01:06:12,418: ERROR/Worker-1] Error -5 while decompressing data: incomplete or truncated stream
Traceback (most recent call last):
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\association.py", line 1995, in _wrap_get_move_responses
transfer_syntax.is_deflated
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\dsutils.py", line 61, in decode
zlib.decompress(bytestring.getvalue(), -zlib.MAX_WBITS)
zlib.error: Error -5 while decompressing data: incomplete or truncated stream
[2020-11-08 01:06:43,246: ERROR/Worker-1] DIMSE timeout reached while waiting for message response
[2020-11-08 01:07:19,543: ERROR/Worker-1] DIMSE timeout reached while waiting for message response
[2020-11-08 01:08:18,153: ERROR/Worker-1] Failed to decode the received Identifier dataset
[2020-11-08 01:08:18,153: ERROR/Worker-1] Error -5 while decompressing data: incomplete or truncated stream
Traceback (most recent call last):
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\association.py", line 1995, in _wrap_get_move_responses
transfer_syntax.is_deflated
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\dsutils.py", line 61, in decode
zlib.decompress(bytestring.getvalue(), -zlib.MAX_WBITS)
zlib.error: Error -5 while decompressing data: incomplete or truncated stream
[2020-11-08 01:08:21,762: INFO/Worker-1] Study PK 340452: No irradiation event x-ray data found. Quiting skin dose calculation.
[2020-11-08 01:08:48,184: ERROR/Worker-1] DIMSE timeout reached while waiting for message response
[2020-11-08 01:08:51,653: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection...
Traceback (most recent call last):
File "c:\program files\python36\ve_openremprd\lib\site-packages\celery\worker\consumer.py", line 280, in start
blueprint.start(self)
File "c:\program files\python36\ve_openremprd\lib\site-packages\celery\bootsteps.py", line 123, in start
step.start(parent)
File "c:\program files\python36\ve_openremprd\lib\site-packages\celery\worker\consumer.py", line 884, in start
c.loop(*c.loop_args())
File "c:\program files\python36\ve_openremprd\lib\site-packages\celery\worker\loops.py", line 103, in synloop
connection.drain_events(timeout=2.0)
File "c:\program files\python36\ve_openremprd\lib\site-packages\kombu\connection.py", line 288, in drain_events
return self.transport.drain_events(self.connection, **kwargs)
File "c:\program files\python36\ve_openremprd\lib\site-packages\kombu\transport\pyamqp.py", line 95, in drain_events
return connection.drain_events(**kwargs)
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\connection.py", line 303, in drain_events
chanmap, None, timeout=timeout,
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\connection.py", line 366, in _wait_multiple
channel, method_sig, args, content = read_timeout(timeout)
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\connection.py", line 337, in read_timeout
return self.method_reader.read_method()
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\method_framing.py", line 189, in read_method
raise m
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\method_framing.py", line 107, in _next_method
frame_type, channel, payload = read_frame()
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\transport.py", line 154, in read_frame
frame_header = read(7, True)
File "c:\program files\python36\ve_openremprd\lib\site-packages\amqp\transport.py", line 277, in _read
s = recv(n - len(rbuf))
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
[2020-11-08 01:09:26,700: ERROR/Worker-1] DIMSE timeout reached while waiting for message response <== LO: this it the exact time that the qr-log gives the connection aborted message
[2020-11-08 01:09:32,544: ERROR/Worker-1] Failed to decode the received Identifier dataset
[2020-11-08 01:09:32,544: ERROR/Worker-1] Error -5 while decompressing data: incomplete or truncated stream
Traceback (most recent call last):
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\association.py", line 1995, in _wrap_get_move_responses
transfer_syntax.is_deflated
File "c:\program files\python36\ve_openremprd\lib\site-packages\pynetdicom\dsutils.py", line 61, in decode
zlib.decompress(bytestring.getvalue(), -zlib.MAX_WBITS)
zlib.error: Error -5 while decompressing data: incomplete or truncated stream
[2020-11-08 01:10:02,591: ERROR/Worker-1] DIMSE timeout reached while waiting for message response

[Luuk]

@EdMcDonagh Just had a second look. The only error that always seem to occur is the “DIMSE timeout reached while waiting for message response”.

‌

[Ed McDonagh]

@Luuk have you got the qr-log that corresponds to the celery log you have shared?

[Luuk]

@Ed McDonagh , see below (the more quiet version already):

[08/Nov/2020 01:06:13] WARNING [remapp.netdicom.qrscu:1870] Move of study 150, series 1: Out of resources: unable to calculate number of matches. Sub-ops completed: None, failed: None, warning: None.
[08/Nov/2020 01:06:13] INFO [remapp.netdicom.qrscu:2040] retrying move 1/3
[08/Nov/2020 01:06:43] ERROR [remapp.netdicom.qrscu:1896] Move of study 150, series 1: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 164, failed: 0, warning: 0.
[08/Nov/2020 01:06:43] INFO [remapp.netdicom.qrscu:2040] retrying move 2/3
[08/Nov/2020 01:06:43] INFO [remapp.netdicom.qrscu:2046] Move assocation was aborted / released, created new association
[08/Nov/2020 01:06:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 151 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 152 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 153 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 154 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 155 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 156 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 157 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 158 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 159 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 160 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 161 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 162 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 163 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 164 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:06:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 165 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:19] ERROR [remapp.netdicom.qrscu:1896] Move of study 165, series 1: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 179, failed: 0, warning: 0.
[08/Nov/2020 01:07:19] INFO [remapp.netdicom.qrscu:2040] retrying move 1/3
[08/Nov/2020 01:07:19] INFO [remapp.netdicom.qrscu:2046] Move assocation was aborted / released, created new association
[08/Nov/2020 01:07:19] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 166 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:20] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 167 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:20] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 168 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:20] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 169 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:20] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 170 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:20] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 171 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:21] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 172 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:21] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 173 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:21] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 174 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:21] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 175 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:21] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 176 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:22] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 177 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:22] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 178 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:22] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 179 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:22] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 180 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:22] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 181 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:23] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 182 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:23] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 183 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:23] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 184 (of 671) series 1 (of 2). Series contains 1 objects
[08/Nov/2020 01:07:24] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 184 (of 671) series 2 (of 2). Series contains 1 objects
[08/Nov/2020 01:07:24] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 185 (of 671) series 1 (of 4). Series contains 1 objects
[08/Nov/2020 01:07:24] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 185 (of 671) series 2 (of 4). Series contains 1 objects
[08/Nov/2020 01:07:25] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 185 (of 671) series 3 (of 4). Series contains 1 objects
[08/Nov/2020 01:07:25] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 185 (of 671) series 4 (of 4). Series contains 1 objects
[08/Nov/2020 01:07:25] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 186 (of 671) series 1 (of 2). Series contains 1 objects
[08/Nov/2020 01:07:26] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 186 (of 671) series 2 (of 2). Series contains 1 objects
[08/Nov/2020 01:07:26] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 187 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:26] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 188 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:27] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 189 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:27] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 190 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:28] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 191 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:29] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality DX, study 192 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:29] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 193 (of 671) series 1 (of 2). Series contains 1 objects
[08/Nov/2020 01:07:29] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 193 (of 671) series 2 (of 2). Series contains 1 objects
[08/Nov/2020 01:07:30] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 194 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:31] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 195 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:31] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 196 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:31] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 197 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:32] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 198 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:32] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 199 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:32] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 200 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:33] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 201 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:33] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 202 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:34] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 203 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:34] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 204 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:35] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 205 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:35] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 206 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:35] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 207 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:36] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 208 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:36] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 209 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:36] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 210 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:37] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 211 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:37] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 212 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:37] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 213 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:38] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 214 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:38] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 215 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:38] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 216 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:38] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 217 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:39] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 218 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:39] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 219 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:39] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 220 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:40] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 221 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:40] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 222 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:41] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 223 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:41] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 224 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:41] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 225 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:42] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 226 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:42] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality FL, study 227 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:42] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 228 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:43] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 229 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:43] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 230 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:43] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 231 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:43] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 232 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:44] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 233 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:44] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 234 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:44] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 235 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 236 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 237 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 238 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:45] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 239 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 240 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 241 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:46] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 242 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 243 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 244 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 245 (of 671) series 1 (of 3). Series contains 1 objects
[08/Nov/2020 01:07:47] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 245 (of 671) series 2 (of 3). Series contains 1 objects
[08/Nov/2020 01:07:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 245 (of 671) series 3 (of 3). Series contains 1 objects
[08/Nov/2020 01:07:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 246 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 247 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:48] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 248 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 249 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 250 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 251 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 252 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:49] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 253 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:50] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 254 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:50] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 255 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:50] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 256 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:50] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 257 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:51] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality MG, study 258 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:51] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 259 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:51] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 260 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:51] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 261 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:52] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 262 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:52] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 263 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:52] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 264 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:52] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 265 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 266 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 267 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 268 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 269 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:54] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 270 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:54] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 271 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:54] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 272 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:54] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 273 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:54] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 274 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 275 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 276 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 277 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 278 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 279 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:56] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 280 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:56] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 281 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:56] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 282 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:56] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 283 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:57] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 284 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:57] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 285 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:57] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 286 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:57] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 287 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:58] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 288 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:58] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 289 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:58] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 290 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:58] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 291 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:59] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 292 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:07:59] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 1 (of 7). Series contains 1 objects
[08/Nov/2020 01:07:59] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 2 (of 7). Series contains 1 objects
[08/Nov/2020 01:07:59] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 3 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:00] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 4 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:00] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 5 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:00] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 6 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:00] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 293 (of 671) series 7 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:01] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 294 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:01] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 295 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:01] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 296 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:01] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 297 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:02] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 298 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:02] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 299 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:02] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 300 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:02] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 301 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:03] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 302 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:03] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 303 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:03] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 304 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:03] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 305 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:03] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 306 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:04] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 307 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:04] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 308 (of 671) series 1 (of 4). Series contains 1 objects
[08/Nov/2020 01:08:04] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 308 (of 671) series 2 (of 4). Series contains 1 objects
[08/Nov/2020 01:08:04] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 308 (of 671) series 3 (of 4). Series contains 1 objects
[08/Nov/2020 01:08:05] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 308 (of 671) series 4 (of 4). Series contains 1 objects
[08/Nov/2020 01:08:05] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 309 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:05] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 310 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:05] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 311 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:06] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 312 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:06] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 313 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:06] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 314 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:06] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 315 (of 671) series 1 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:07] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 315 (of 671) series 2 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:07] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 315 (of 671) series 3 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:07] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 315 (of 671) series 4 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:07] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 315 (of 671) series 5 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:08] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 315 (of 671) series 6 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:08] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 316 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:08] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 317 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:08] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 1 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:09] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 2 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:09] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 3 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:09] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 4 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:09] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 5 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:10] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 6 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:10] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 318 (of 671) series 7 (of 7). Series contains 1 objects
[08/Nov/2020 01:08:10] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 319 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:11] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 320 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:11] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 321 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:11] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 322 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:12] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 323 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:12] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 324 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:12] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 325 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:18] WARNING [remapp.netdicom.qrscu:1870] Move of study 325, series 1: Out of resources: unable to calculate number of matches. Sub-ops completed: None, failed: None, warning: None.
[08/Nov/2020 01:08:18] INFO [remapp.netdicom.qrscu:2040] retrying move 1/3
[08/Nov/2020 01:08:48] ERROR [remapp.netdicom.qrscu:1896] Move of study 325, series 1: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 367, failed: 0, warning: 0.
[08/Nov/2020 01:08:48] INFO [remapp.netdicom.qrscu:2040] retrying move 2/3
[08/Nov/2020 01:08:49] INFO [remapp.netdicom.qrscu:2046] Move assocation was aborted / released, created new association
[08/Nov/2020 01:08:52] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 326 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:52] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 327 (of 671) series 1 (of 2). Series contains 1 objects
[08/Nov/2020 01:08:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 327 (of 671) series 2 (of 2). Series contains 1 objects
[08/Nov/2020 01:08:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 328 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 329 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:53] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 330 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:54] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 331 (of 671) series 1 (of 1). Series contains 1 objects
[08/Nov/2020 01:08:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 332 (of 671) series 1 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 332 (of 671) series 2 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:55] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 332 (of 671) series 3 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:56] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 332 (of 671) series 4 (of 6). Series contains 1 objects
[08/Nov/2020 01:08:56] INFO [remapp.netdicom.qrscu:2014] Requesting move: modality CT, study 332 (of 671) series 5 (of 6). Series contains 1 objects
[08/Nov/2020 01:09:26] ERROR [remapp.netdicom.qrscu:1896] Move of study 332, series 5: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 379, failed: 0, warning: 0.
[08/Nov/2020 01:09:26] INFO [remapp.netdicom.qrscu:2040] retrying move 1/3
[08/Nov/2020 01:09:29] INFO [remapp.netdicom.qrscu:2046] Move assocation was aborted / released, created new association
[08/Nov/2020 01:09:32] WARNING [remapp.netdicom.qrscu:1870] Move of study 332, series 5: Out of resources: unable to calculate number of matches. Sub-ops completed: None, failed: None, warning: None.
[08/Nov/2020 01:09:32] INFO [remapp.netdicom.qrscu:2040] retrying move 2/3
[08/Nov/2020 01:10:02] ERROR [remapp.netdicom.qrscu:1896] Move of study 332, series 5: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 379, failed: 0, warning: 0.
[08/Nov/2020 01:10:02] INFO [remapp.netdicom.qrscu:2040] retrying move 3/3
[08/Nov/2020 01:10:06] INFO [remapp.netdicom.qrscu:2046] Move assocation was aborted / released, created new association

[Ed McDonagh]

Reducing logging, refs #858

→ <<cset a34ec6646a50>>

[Ed McDonagh]

Experimenting with log config for Celery logging, refs #858

→ <<cset c372ce0832d2>>

[Ed McDonagh]

Black. Refs #858

→ <<cset d397f1b96e89>>

[Ed McDonagh]

Fixing inconsistent return statements error from Codacy. Refs #858

→ <<cset 5195d795f6b2>>

[Ed McDonagh]

Moved imports to top. Refs #858. Haven't added the retry required yet.

→ <<cset bdec85c8a5b0>>

[Ed McDonagh]

Codacy: import positions Refs #858

→ <<cset bae0df237883>>

[Ed McDonagh]

If not statement can never be reached; else part is duplicate. Refs #858

→ <<cset debc18cd1345>>

[Ed McDonagh]

Move should now retry (once) if any of the failure status messages are returned. Refs #858

→ <<cset af83fc46fa8a>>

[Ed McDonagh]

Abbreviated query_id in qrscu to first 8 characters, used more f-strings, added some translation strings. Needs reformatting. Refs #858

→ <<cset a69b335799d9>>

[Ed McDonagh]

Naming format values in translatable strings. Needs reformatting. Refs #858

→ <<cset 37abb56c3adb>>

[Ed McDonagh]

Updated _query_for_each_modality to use 8 char uuid in logs, distinguished between main query and study level query and log both. Refs #858

→ <<cset 6ce4195af415>>

[Ed McDonagh]

Updated query_study to use 8 char uuid in logs, added main query uuid. Added _which modality matching is complete. Refs #858

→ <<cset 9a011caf6549>>

[Ed McDonagh]

Updated _query_series to use 8 char uuid in logs, added main query uuid. Refs #858

→ <<cset 853e17b159b5>>

[Ed McDonagh]

Updated _query_images to use 8 char uuid in logs, added main query uuid. Corrected missing hex. Refs #858

→ <<cset a3b0e31981a6>>

[Ed McDonagh]

Updated _check_sr_type_in_study to use 8 char uuid in logs, added main query uuid. Refs #858

→ <<cset 5bbc9dc4e493>>

[Ed McDonagh]

Updated _prune_study_responses to use 8 char uuid in logs. Refs #858

→ <<cset 850aa4f06f36>>

[Ed McDonagh]

Updated _get_toshiba_dose_images to use 8 char uuid in logs. Refs #858

→ <<cset d0a79a618144>>

[Ed McDonagh]

Updated _get_philips_dose_images to use 8 char uuid in logs. Refs #858

→ <<cset 534bde68b7b8>>

[Ed McDonagh]

Updated _prune_series_responses to use 8 char uuid in logs. Refs #858

→ <<cset b3be0b3d7844>>

[Ed McDonagh]

Updated _filter to use 8 char uuid in logs. Refs #858

→ <<cset fe5f0a4bd662>>

[Ed McDonagh]

Updated _remove_duplicates, _generate_modalities_in_study to use 8 char uuid in logs. Refs #858

→ <<cset 97879a181dba>>

[Ed McDonagh]

Black. Refs #858

→ <<cset a125d885ec89>>

[Ed McDonagh]

Tidying up imports. Refs #858

→ <<cset 77fe2f793ad8>>

[Ed McDonagh]

Fixing mistakes and tests. Refs #858

→ <<cset 63c7c52aaf9d>>

[Ed McDonagh]

Refactoring a bit of duplicated code into a new function. Refs #858

→ <<cset 45a5593bafef>>

[Ed McDonagh]

Added checking association and reconnecting during each query. Need to fix tests. Refs #858

→ <<cset ecf5ed9218ec>>

[Ed McDonagh]

Hopefully fixed all the tests appropriately. Refs #858

→ <<cset e906e658fed9>>

[Ed McDonagh]

Black, extra line removed. Refs #858

→ <<cset 4deb13c8eeba>>

[Ed McDonagh]

Addressing a couple of the Codacy issues. Refs #858

→ <<cset b23302f147eb>>

[Ed McDonagh]

Fixed hex error, improved logging further. Refs #858

→ <<cset 5a85179b81fd>>

[Ed McDonagh]

Models in netdicom.tools need to be imported with the remapp namespace when called from command line. Refs #858

→ <<cset 36d02f3c9022>>

[Ed McDonagh]

Improved display and log message grammar if no filtering and with some filtering. Refs #858

→ <<cset 0e0efe6ec169>>

[Ed McDonagh]

Log and display message format tweak. Refs #858

→ <<cset 4d190b0dee87>>

[Luuk]

Yesterday, I performed some testing in conjunction with Agfa using debug-logging at both sides. It seems that Agfa EI (dcm4chee) is a rather quiet DICOM node and it can take more than 30 seconds to get a new DIMSE message. However the default DIMSE time-out in pynetdicom is set at 30 seconds. If this time-out is reached, pynetdicom assumes that the association is lost (which is not the case).
See the log of last night:
[03/Feb/2021 02:11:17] DEBUG [remapp.netdicom.qrscu:1885] Move of study 243, series 1: Match returned, further matches are continuing. Sub-ops completed: 0, failed: 0, warning: 0.
[03/Feb/2021 02:11:48] ERROR [remapp.netdicom.qrscu:1898] Move of study 243, series 1: Connection timed out, was aborted without reason given or received an invalid response. Check remote server logs Cumulative sub-ops completed: 277, failed: 0, warning: 0.

I tested also with another DICOM tool (movescu from Offis DCMTK) and that confirmed that it can take very long before a new message is received. DCMTK has no time-out for DIMSE messages by default (infinite waiting time).

This seems especially the case if large datasets (breast tomosynthesis objects) are sent in uncompressed format. This happens if no rdsr in that study is available and so the image data is sent.

This morning I set the dimse_timeout at 300 s and retried the retrieval of rdsr-data. This ran smoothly. As you can see it took almost 3 minutes in between 2 DIMSE messages:
[03/Feb/2021 08:59:36] DEBUG [remapp.netdicom.qrscu:1885] Move of study 15, series 4: Match returned, further matches are continuing. Sub-ops completed: 0, failed: 0, warning: 0.
[03/Feb/2021 09:02:30] DEBUG [remapp.netdicom.qrscu:1885] Move of study 15, series 4: Match returned, further matches are continuing. Sub-ops completed: 1, failed: 0, warning: 0.

So to prevent this problem, I think:

1. We should not try to get such large objects (I think this is already done in the current dev branch, isn’t it?)

   1. And if we still want to. we might think of accepting compressed formats (we are not interested in the pixel data anyway)

2. We should enlarge the DIMSE time-out. I wouldn’t go to infinite as software can get stuck, but let’s set it to 300 s, that is a rather long waiting time, but it will not wait infinitely long.

3. For other reasons it might still be a good idea to retry if the association is aborted or a move failed.

   1. We are still having this “Out of resources: unable to calculate number of matches.” message sometimes.

‌

‌

[Ed McDonagh]

Adding dimse timeout as proposed by @LuukO. Default was 30 s, now 5 minutes. Refs #858

→ <<cset 79081739dd38>>

[Ed McDonagh]

Thanks @Luuk That is really useful.

I don’t think we’ve any way of avoiding the large tomo images if there is no RDSR, unless we don’t attempt to get the 2D mammo which wouldn’t be a good solution! We could look at whether we can remove the SOPClassUID from the Orthanc Store configuration to so they don’t get sent - I’m not sure if we can do that?

I think my branch issue858stnnamefilterfail should do the retry on both query or move stages - I’d love some more testing feedback!

Not sure what we should be doing with that last message - would that not indicate that the search needs to be more specific - maybe by using time windows?

[Luuk]

@Ed McDonagh I don’t think that adding time windows will help.The strange thing is that the error appears during move-requests and these are very specific. Regretfully I can’t reproduce it and it didn’t show up during the testing with Agfa.

[Ed McDonagh]

During the move? I assumed “unable to calculate number of matches” indicated find. I guess during move they still need to match the UIDs with objects in the database?

I’m not sure what we could do about that, except report the error.

[Ed McDonagh]

@Luuk , @wens - I’d like to merge pull request #424, and to reject pull request #414.

What do you think?

[Ed McDonagh]

Moving import up a few lines to satisfy Codacy. Refs #858

→ <<cset 62b521c4f9bc>>

[Ed McDonagh]

Adding ref #858 to changes.

→ <<cset b9c6b6411134>>

[Ed McDonagh]

Merged in issue858stnnamefilterfail (pull request #424)

Fixes #858 with improved handling of finds and moves being aborted, reduced logging in INFO mode and corrected handling of include/exclude station name where values are not populated at particular find levels.

Please reopen @wens if there is more work to be done when you have done more testing.

→ <<cset ead5e1e7b5e2>>