Not true. Although new presidents have the power to remove and replace, with Senate confirmation, the chairman of the joint chiefs, presidents normally allow the chairman of the joint chiefs to serve the remainder of his term, even if he was appointed by another president from a different party.
That is exactly correct.