What Obadiah meant was, more accurately: don't let it become his problem. Because there are entirely too many ways it could.

He puts that all aside to think about in more detail later, and takes a slow, deliberate swallow of whiskey.

Then he asks,

"So. What should we do to Tony?"