This seems like faulty behavior when creating pull request tasks:
- Create PR, and create tasks for said PR
- Complete the task
- Try and merge the PR
You'll see that the merge will not complete and it will still complain there are unresolved tasks, even though it shows as all tasks are resolved. The workaround is simply unchecking the task and re-checking it.