We have been there often. I really like the Challenge, it is very scenic, it is a good challenge (no pun intended), it tends to be pretty quiet so one can get around quickly, and it is in ok condition usually. The weather tends to be wonderful as it is protected, very Wailea like that. The dolphins come into the bay which is always very cool. It is a great place to reduce and eliminate any stress. We'll keep going back again and again in the future.
We have been here about 10 times over the years. It is very isolated. Which can be good and can be bad. For the spouse who might be a non-golfer and for kids it can be a bit too boring. It is not Wailea.
The hotel is fantastic, the people are terrific. It is a getaway from it all.
Koele is not my fave. The weather tends to be a bit iffy, the golf course is a bit boring to me, it is like being in the Pac Northwest or something with the pine trees. I haven't been back up there in years.
Make sure your spouse/family are prepared to be limited in activity while over there but as a golf focused individual it is awfully wonderful. The beach is a bit of a hike but not too bad and it is gorgeous while the pool is very nice. The service is great. It is pretty isolated so make sure you think about that. You may want to try it for 2 nights or something and see for next time if you like the isolation.
The golf at the Challenge offers some amazing shot like those on 12 and 17. Some great cliffside golf!! And the views from almost all of the course are just amazing.
Hope this helps, shoot me a message if you have any more questions.