I'm sure he understood why you distanced yourself from him. Maybe you should visit his grave and say those things you are holding back. I hear the dead stay close to those they love. He might be waiting for that explanation he didn’t get.