Ladder back chair scarf hanger