There is also 'между прочим', but they two (with кстати) are not fully interchangeable. The discussion could be longer than that:
differences - "On a side note" vs. "by the way" - English Language & Usage Stack Exchange