Docker cache does not seem to be working?

I've added the relevent section withit my pipeline config:

pipelines:
  default:
    services:
      - docker
    caches:
      - docker

However I'm not seeing any caching occurring - it still takes as long as it used to. How can I diagnose this issue?