He got married to English actress Jennifer Kendal, who had been his co-star in most of the Merchant Ivory productions, in 1958.