I'm not sure I totally understood every detail of the discussion, but I just thought I'd chip in:
'to go' can be used with distance, but also, totally illogically, with time:

'There are two hours...