If I go down that road again, I'm going to do the same thing - print out a set of printer test/calibration models and set them aside. After the conversion I will compare to the set I printed out. If the DD doesn't produce better quality prints, then why did I just waste my time?
I have done this, with prints of a Benchy of course. Neither are perfect. On the hull there are layer lines on both, and there are slight imperfection on one that are not on the other (the Hemera seems to have a 'stickier' nozzle and some filament is blobbing sometimes but I think that is a nozzle issue, not a direct drive issue) but overall I think the Hemera is producing better prints than the stock hotend with Bowden setup. In combination with slightly faster prints and eliminating the problem I had where the bowden tube would wear and then pop out of the fitting, I am quite satisfied.
Here are some images of the Benchies printed in white PLA, the stock bowden is on the left, the Hemera direct drive is on the right. Apologies for the quality of the images.
Some differences I have noticed, the bowden has a lumpy smoke stack on the roof, the Hemera has a brown blob next to the rear porthole, the base of the bowden does not look as good to me as the Hemera, the top surfaces look better with the Hemera, seams are less pronounced and the bow looks better with the Hemera, there is some banding on vertical surfaces with the Hemera.
I am of the opinion that some tweaking with my settings could eliminate most if not all the imperfections from either setup.
EDIT: It seems that the horizontal lines and blobbing are both caused by the same issue, that being something related to extrusion temperature or flow rate. I will play about with setting a bit more and see if I can improve this.