Grounding vs. Compositionality: On the Non-Complementarity of Reasoning in Neuro-Symbolic Systems