Your circuit drawing shows a 60 ohm generator connected to the output—that must be wrong. Your picoscope input is not a generator, and probably has a higher impedance (normal oscilloscope input impedance is 1 megohm).
I would suggest using diodes in parallel with your feedback resistor (start with 1N4148s back-to-back across the resistor). It’s not a good idea to force the op amp into saturation, since the output stage may take a surprisingly long time to recover.
If your source impedance is 50 or 60 ohms, then a BJT input device will have lower noise, but the 5000 ohm resistor will dominate the noise and drift calculation (until the diodes conduct). When the output voltage is close to zero, the voltage across the diodes will not result in diode current, and the circuit will have high voltage gain. With “high” output voltage, one diode conducts and the “incremental” gain goes to unity, until the input reaches approximately the maximum allowable output voltage minus the diode drop, above which the amplifier will saturate.
If your source impedance is really close to 50 ohms, the circuit would have lower noise if you reduce both resistors in the network, reducing the total resistance seen by the amplifier (before diode conduction).