Just a thought. If the songs play ok on iTunes, but seems to add silence before starting to play the song on AppleTV, check whether the "Part of a gapless album" option is ticked on the Options tab for the properties (this is using iTunes on Windows, sorry if it's in a different place on the Mac). I ensure that
all my songs have this option ticked, however, when you rip a CD, this ...