No, almost certainly it wouldn't. I imagine that the different delay is occurring at the Freeview decoders in (or connected to) the two TVs which are delaying the signal by slightly diffferent amounts. It's the price you pay for digital broadcast. Unless... the two TVs happen to be tuned to different transmitters, then another effect comes into play as well.
Long ago (long before digital) I could receive two ITV regions. I happened to have my VCR's tuner tuned to one ITV station and playing sound through my stereo, when I switched my TV over to the other ITV region, with the sound up. There was a noticeable time delay between the two: a fraction of a second, but long enough to be noticeable as slight reverb on the sound. Probably due to the different signal paths from the studio to the two transmitters, and then from the transmitters to my aerial, though you'd need a distance of 30,000 km to give a time difference of 100 msec, so maybe there was some sort of signal-processing delay in one of the transmitter feeds as well.