Bitbucket showing plan limit exceeded for fifth user despite having only five users

Steps

1. Had added five users before to a private repo (/foobazlabs/pipeline)
2. Deleted one of these five users
3. Added a new user
4. When the user signs up from the invite email and tries to access the repo, it shows a message stating that the plan limit of the repo has been exceeded