is there one place where I can find the current interest rates of all countries and their historical data as well?
I'm not sure about the historical data thing but you can find all the current global interest rates here:
Hope that helps!
Learn How to Trade Forex. BabyPips.com Is The Beginner's Guide to Forex Trading. Your Best Source for Forex Education on the Web.