SSH hanging up unexpectedly

We're occasionally getting:

ssh_exchange_identification: Connection closed by remote host
fatal: The remote end hung up unexpectedly

Started sometime yesterday and we get them a few times every hour. Doesn't seem to be any particular repo, but they're always our own private repos.