Yes, devices marked with the double insulated (concentric squares) symbol are typically designed to be Class II appliances, meaning they don't require a connection to earth ground because they have additional layers of insulation, ensuring that exposed conductive parts can't become live. This should result in the device having no reference to earth ground, making it "floating" in terms of electrical potential.
However, on many devices, Y-capacitors (between live/neutral and ground) are used for noise suppression. These capacitors create a capacitive connection between the power lines and the device's casing or GND, which can generate high-frequency AC voltages on the device's casing relative to ground, especially if it is floating.
Y-capacitors are designed to reduce electromagnetic interference and are often used in power supply filters. However, their capacitance, although small, can cause leakage of a small AC voltage onto the casing or GND of the device.
When connecting to a grounded device, this potential can quickly "discharge" to zero, accompanied by sparks, especially if the charge has accumulated on the capacitors.
The voltage between ground and such a "floating" GND is typically around 80-100 Volts AC. However, the maximum current under normal conditions is limited by safety requirements. Therefore, while this can lead to sparks, damage to devices, and even mild electric shocks, the current is usually within a safe range and should not be lethal, provided that the power supply is functioning correctly.