"I was, at any rate. I understand if you would rather not discuss them in public."

He doesn't explicitly point out that they are the sort of thing one doesn't want getting around. It would be one step closer to actual blackmail than Sherlock would like to go. That is not the point of this exercise.