My favorite tool is the Olympus DS-30, which you can pick up on Amazon or eBay for about US$100. There are cheaper ones out there.
If you use a Symbian phone, try out the Best Dictaphone software from Smartphoneware: $6.95, and you can also record phone conversations with it (local laws may prohibit this without prior agreement of the interviewee.)