IMHO the use of FR-4 for RF depends on the frequency it is to be used for.
I have successfully designed and implemented directional couplers on FR-4 on VHF and UHF frequencies up to 880 MHz provided that coupling gaps
are not to narrow due to manufacturing tolerances and also by requiering a specific brand and version of resin vs fiber glass mix.
It was some time ago, but then a specific ISOLA part number was specified together with the board manufacturer. It is also important that
if the coupler is instantiated as stripline (internal between two planes) on a multi-layer board that the pre-preg is not too old since the compressibility of it deteriorates with time
due to ageing which also affects the performance.
As the frequency increases, the dielectric losses increases and so the dimensions must be kept as small as possible. VHF, no problems. UHF, be careful,
above 1GHz, think twice if the structure is complex. If it is: Consider dedicated RF-laminates.
If you stay on FR-4, also consider the tolerances of the finalized design.