Yeah I always like to listen while I work, so this would be good!
Why not just sign up to libsyn? It is reasonably priced and you'd might as well start as you mean to go on.
A tip I have is that if you make a mistake while recording, clap you hands loudly to put a spike in the wave audio image. It makes it easier to identify problem areas that need editing when you come to edit.
While audacity is good, it is inferior to some of the Sony audio products. I recommend Sony acid because not only is it GREAT for podcast editing (it has something called 'envelopes' which is something musicians will understand) you can use the tempo grid for adding in loops at whatever bpm (beats per minute, or tempo) you want.
I really do feel this will be better for you because while you might feel you are 'rambling' on YouTube (I don't think you are but I know you think you do sometimes) this long form style is ideal for podcasts. I like the nuances of any given subject and sometimes when I go for long walks to exercise and take breaks I'll gladly take you with me on my MP3 player.
I would like to do a podcast one day but it hinges on a good mic and good hosting, I think.
You have got me thinking now!