Tom Selleck's cherished California avocado farm is a source of pride for the 79-year-old — but was not devoid of turmoil.