How can I remove a rust stain...

Make a paste of hydrogen peroxide and cream of tartar. Rub it onto the stain and let it sit for about ten minutes. Then wipe it away. You may need to apply it a second time, but it will work.