Complete 100% agreement. The lunch at Rye is very much part of the whole experience, and if you have time a knock on the Jubilee Course (18 greens, about 14 fairways) is also recommended. Ditto a quick evening salvo around the Warren course at Littlestone, which isn't in the same league as the Jubilee but has some fun holes nonetheless.
The 'old' nautical part of Deal is very appealing, with some excellent pubs amidst the small townhouses. Rye is just a special place overall, and Sandwich has its charms. You will also see how much improvement has been undertaken at Prince's, both on the courses and in the clubhouse, even if the club flavour at Prince's is very different from that at both RCP and RSG: prior to WW2 Prince's was just as posh as its neighbours (as you can see from some of the old benches around the place that survived the war), but during the conflict (when the course was basically a firing range) membership fell from over 500 to barely 100, of whom (very interestingly) the majority were Ladies. It's all very different now!
Anyway this is one of the great trips in golf, so enjoy...