Violation of Bell inequalities in larger Hilbert spaces: robustness and challenges