Returned Moray MP Douglas Ross believes time to talk about referendums is over – telling country it’s time to ‘move on’