He has to skip the ice; it would make too much noise in the glass. While Tony is probably too self-absorbed at the moment to notice a sound like that, he'd just as soon not take the chance.

(It wouldn't be safe to leave Tony completely alone like this. They both know it. But it isn't very difficult right now to make Tony doubt what he knows just enough to add a little excitement.)