When the number of the population of individuals is small, even if it is not under natural selection, there is probability of one allele lost by chance. This is called genetic drift. This effect get stronger on the smaller population. When we protect the endangered species, we should save certain size of individuals not to get damaged by the effect of genetic drift. Once the allele lost, it is definitly difficult to attain it again.