Not always... you could write ありがとう or 有り難う or 有難う