Not silly, but I'd certainly be cautious. Is it glued or maybe an ultrasonic weld?
First thing to check is the type of plastic (and any glue), and whether it might give off toxic fumes.
Second is that although the laser would follow an accurate and repeatable cutting path, the depth of cut with laser is somewhat uncontrolled and dependant on the material surface. You'd probably want to keep the laser at a low power and run multiple passes to just weaken the join enough to then manually crack it open. Personally, I'd probably do this with a jig and program on my benchtop CNC instead, as you can control the depth of cut much better.
The 18650s inside the outer case are likely covered in heatshrink and possibly other protective layers, and inside that is metal case. So (without seeing the item) I'd guess you'd have to be very unlikely to actually hit something flammable. The laser could reflect off the metal as well, so it must be behind something that blocks any reflected/scattered laser light to avoid eye damage.
Also keep in mind that you never leave a laser cutter alone when cutting, and always have a suitable (CO2) fire extinguisher handy.