All of the suggestions made have merit but the best food in town is at La Balena, a recently opened small Italian restaurant on Junipero Street. Reasonably priced and has a good atmosphere.
By all means go down to Big Sur and depending on the weather have lunch at Rockey Point, (newly re-opened), Ventana, or the Post Ranch, the latter somewhat pricey.
The back nine at PG is a must if you have the time for it.
If you are into wine drive out to Carmel Valley Village and try out the wine at any one of sixteen tasting rooms.
Clint's Mission Ranch is a hive of activity in the evening with a chap tickling the ivories and and would be singers joining in.
Depending on your religious persuasion you might want to take in the Carmel Mission. The Bach Festival is held in July and you could kill two birds with one stone by attending all things Bach including the Mass in, ;oops' I have forgotten the key.
Bob