The couple couldn’t keep it quiet and had to be careful not to get caught