Abyssal Cultist Bug in Whirl Island

[Former user]

Maybe it's just my game, but after I lost against Audrey in Whirl Island after the summoning, I returned to find one of the cultists, who blocks you from exiting before the battle, still there. He is the one on the left, tried refreshing the map, didn't help.