I’ve never considered a package manager more than the cost of doing business on a particular distribution.
Fedora used to do DeltaRPMs. I don’t know if that is still a thing or if it is a failed technology from yesteryear. It was a way to minimize download sizes and times by comparing the old RPM and the new RPM and only downloading the difference. If it still exists, it might speed things up.
EDIT: Actually, I must have misremembered DeltaRPM tech because the Internet is telling me it is actually slower because you have to build the RPM. It was mainly designed for people on strict metered connections.