"Can we just assume I'm going to tell you to be careful on all of these conversations? Because I feel like you might get tired of me saying it." He knows Matt knows he worries, and he doesn't want to make Matt feel bad about it, doesn't want to make him resent Foggy.