Could anybody let me know where to find RSS icon on IE6 or IE7?

There is no RSS feed icons on IE 6. On IE 7 it is on the main bar next to the tabs. If the site you are on has a RSS feed then it will turn orange. If not, then it will be grayed out.