Yeah that happened to me too and I was thinking maybe I'm paranoid. Similar problem is happening to me while installing games from disc; if I'm connected to internet copying process slows down by a lot but if I disconnect it copies the game in usual speeds.

When download slows I try to restart my PS5, delete the download and start again then it reaches normal speeds for a while then slows down.