Yes. Rust can eat away at the can, resulting in the product leaking. It may also result in staining your sink or countertops if it rusts from the bottom, so be careful.