Just for chuckles, have you tried the 20dB attenuator alone, without the termination?
I have played around with these, & found that 20dB attenuators approximate a pretty good termination by themselves.
I didn't have the good equipment you have, just a Spec An with a tracking generator, a (salvaged) Seimens directional coupler, plus a limited number of other bits & pieces, which I had to characterise as well as I could, prior to the job on hand.
I found, with this gear, (at around 400MHz), that a 20dB attenuator with its output open circuit, delivered a return loss of 40dB, compared to a plain open circuit cable.
This seems anti-intuitive, with the impedance mismatch, but was completely repeatable.
I would often use two such attenuators in cascade to give 80dB return loss.
Due to the limitations of my equipment, it would be interesting to see if there are problems with this which would show up with a VNA.