All the grounds and the neutrals are connected anyways in the main panel, so i dont know why it would make much difference.
Hmm, nope. Neutrals are separated from PE for a very good reason: safety of people against shock (especially in case of loss of connection on a N wire...).
It also depends heavily on the country regulation.
in USA, the earthing scheme is TN-C-S or similar wit a PE<->N at the main breaker, other countries differ.
Just as a really opposite example: In France, for example, with a T-T earth, there is no connection at all between PE and N, and furthermore, all circuits are protected by a few panel-mounted 30mA RCDs, making the neutrals sensitive between different circuits, and furthermore again, neutrals are switched in each and every power breaker, making each neutral belonging to exclusively to a circuit specifically.
The big main breaker also has a 500mA RCD function (protection against fire and contact in panel before 30mA head RCDs.)
There is often a few volts between N and PE (AC and/or DC due to soil electrolytic effects)
No mixing of neutrals possible at all.
Any connection N-PE or between two different N would result in RCDs tripping.
A circuit is completely disconnected when the breaker is down, including N.
Very safe and clean wiring reg.