Bugger I just found this thread and your trip is over!
I would have recommended Harris for dinner, expensive, but wonderful!
I also would have recomended going to Sutro baths. They are great ruins to walk down to and enjoy the surroundings with crashing waves on the coast. The Cliffhouse looked like a great restaurant, but we skipped it and went back to our hotel to rest after our major car accident with our rental car.

(Did I mention it was the Ramada Plaza on Market? LOL! We were there a month ago.)
The baths were on the coast at the end of Golden Gate Park. We did see the Tea Garden and even had tea there. The gardens in there are beautiful! I'm sorry you missed it.