FR4 Er not only changes with frequency, but also between manufacturers and batches. FR4 is just Flame Retardant type 4, which means it's a laminate made of woven glass reinforced epoxy resin. What weave design? How much epoxy? How much glass fiber? Who knows!
At high frequency, the losses are high and the weave makes the Er not constant along the surface. Better ask for 7628 and avoid 106 or 1080 weaves.
There are some better "premium" FR4 type laminates for RF. But your stackup must use cores on the RF layers instead of prepeg. RF layers are commonly routed on outer layers, and 4 layer boards are usually made of one core and two prepegs. You would have to use a 2 or 6 layer PCB, or order a custom stackup to have advantage of these laminates.
You can ask for controlled impedance too, but cost increases, and the high loss tangent is unavoidable. For certain applications it's sort of ok for 50ohm lines up to 6GHz, but forget about microstrip filters or impedance matchings.