I have embedded my RSS feed from my blogs into my website using Simple Pie. It was really easy to do.
If you download the zip from their site you can simply copy the example from the documentation:
And have this working in now time at all. For a really helpful screen cast:
The project is hosted on github: