In his diaries, Lord Vallance wrote that ex-PM thought rules were not ruthless enough.