Strangely, the easiest answer is to simply use a bigger screen. The screen capture file size is limited by the size of the desktop you are using. If you use a 30" Cinema Display at the highest resolution, you'll get a much larger image file (2560x1600 pixels) than if you use a 17" iMac. I'm not sure if there's an easy way to simulate an even bigger display size or higher resolution.
However, you may want to also adjust your screen fonts to something larger, so that text doesn't disappear on such a large desktop - but it's the easiest way to meet the need you describe. Simulating an image would allow you higher res, but would be a real pain to do well for most applications.
Kevin Cazabon / kevin.cazabon@kodak.com
Link on Facebook, Plaxo and LinkedIn. Twitter: PlatesAreUs