M-Audio has rebranded one of its existing audio interfaces and put together a bundle that's squarely aimed at all of the podcasters out there.
This one-stop solution includes the FastTrack USB audio interface, USB lead, microphone, mini-microphone stand and Audacity editing software. The only thing letting this package down is the price.
The bundled software here is all freeware so it seems fairly certain that you could piece together a higher quality package separately. However, if you're in need of a podcasting solution without the hassle of having to sort it all out yourself, and you can afford the price tag, then it does this and more very well.