Latency will be determined by the packet routing and normal network stuff, maximum baud rate comes down to the end points, and how congested your links are, e.g. what happens when a packet goes missing, what happens when they arrive out of order, and if it responds differently to what you expect midway through you sending the next command, how do you handle this?