He says I'm "a bit to juggle".....?

maybe he kind of wants you as a quieter friend but more a piece on the side so he is careful not to burn that bridge