What step should you take to remove an old debt from credit report?

I have paid off an old debt. It is still there on my credit report. I have asked the debt collection agency to remove it. They haven’t. What should be my next step?