Well… there’s a limit to how much diversity it can have … because 10,000 is 5,000 pairs… or 5000 x 46 chromsomes… that’s all the carrying capacity.
You need a big population going on for thousands of years… BEFORE you even arrive at the Sumerian civilization.