For getting it quieter, the natural thing would be some "filter" / sound absorber at the output side of the fan.
This is quite an expensive filter ! Depening on the climate (high humidity) one may have to change the filter after some time, even if not heavily used.