Only after I - home, did I remember my doctor's appoinment.

Answer: 
went
Only after I - home, did I remember my doctor's appoinment.