I have had items that would just not be stable, and remaind that way. So in your case, I would just return it (unless turning th epot cahnges things substantially). Its not worth keeping one that is that unstable, in the end you need to rely on it, and how can you, even if it gets a little more stable. And if you try to repair it, you are not sure you can and in addition, the option to rertur it has gone.
These are very stable units, well below 1ppm/year drift usually, otherwise they are broken. Cal labs tell me they will keep their 732As instead of buying later and newer ones, because of their stability. And never turn the pots once stable.