This really makes sense to me because if F-Number is low, aperture is high, resulting in shallower depth (blur-ier images). On the same hand, this means the size of circle of confusion must be high, as the area of out of focus image is larger.