Infamous Cantab Charlie Gilmour must serve the rest of his prison sentence after a judge ruled against his appeal yesterday.