Middle English: from tit1 + obsolete mose 'titmouse'. The change in the ending in the 16th century was due to association with mouse, probably because of the bird's size and quick movements
titmouse in other Oxford dictionaries
Definition of titmouse in the US English dictionary