The effect of void size on void growth in single crystals with uniformly distributed cylindrical voids is studied numerically using a finite deformation strain gradient crystal plasticity theory with an intrinsic length parameter. A plane strain cell model is analyzed for a single crystal with three in-plane slip systems. It is observed that small voids allow much larger overall stress levels than larger voids for all the stress triaxialities considered. The amount of void growth is found to be suppressed for smaller voids at low stress triaxialities. Significant differences are observed in the distribution of slips and on the shape of the deformed voids for different void sizes. Furthermore, the orientation of the crystalline lattice is found to have a pronounced effect on the results, especially for the smaller void sizes.