For practical purposes, sampling with replacement and sampling without replacement are comparable as long as only a small fraction of the population is sampled,
In sampling with replacement, the two sample values are independent. In sampling without replacement, the two sample values aren't independent.