Are you sure that will keep Google happy?
Yes. The FAQ was moved that way multiple times, and it never caused an issue. A redirect page, when visited directly, will simply pull the content of the destination page, while also notifying the client that the page has been moved. Google handles these quite well.
Do you think that a page with only the title as its contents, "Phases of the Moon" will outrank a website like that?
I think you're misunderstanding. The only page that Google will keep track of is the final page - while keeping any ranking data it's already collected in the past. Functionally, this is simply a URL change.
which is why I think combining the pages may not be the best idea.
Generally, the opposite is true. Larger informative pages rank better than small pages with plenty of links. Of course, there's is a point where pages become too long and splitting is desirable, but we're nowhere near that point yet. Each time we've merged a bunch of small pages (leaving appropriate redirects behind), the net result was more visits to the combined page, compared to prior traffic to smaller disjointed pages.
I have yet to see a redirect page show up as a high ranking in Google Search
That's because their positioning gets transferred to the destination page. The redirect only serves as a vehicle through which this occurs (and as a means of maintaining compatibility with external sites that may be linking to our articles). This is as intended - Google shouldn't be indexing the redirects, it should simply make sure that the final page is reached correctly.