We investigate the spatial structure of stress and strain patterns in crystal plasticity. To this end, we combine theoretical arguments with plasticity simulations using three different models: (i) a generic model of bulk crystal plasticity with stochastic evolution of the local microstructure, (ii) a 2D discrete dislocation simulation assuming single-slip deformation in a bulk crystal, and (iii) a 3D discrete dislocation model for deformation of micropillars in multiple slip. For all three models we investigate the scale-dependent magnitude of local fluctuations of internal stress and plastic strain, and we determine the spatial structure of the respective auto- and cross-correlation functions. The investigations show that, in the course of deformation, nontrivial long range correlations emerge in the stress and strain patterns. We investigate the influence of boundary conditions on the observed spatial patterns of stress and strain, and discuss implications of our findings for larger-scale plasticity models.