Good question. It may help to consider various kinds and degrees of restitution:
- As you said, you could destroy/delete the illegal copies. Some may consider this insufficient because you have had the use of the music/films/games for some time without paying.
- You could legally purchase the items. This may be difficult or impossible if you pirated quite a lot and do not have enough money to pay for it all.
- You could perform some sort of service for the benefit of copyright owners, for example, encouraging others to cease pirating and obtain copyrighted material legally (purchase, library loan, legal transfers, etc.).
There may be other options.
I am not saying you should do one or the other, but think about it and follow the other advice you’ve obtained here.