As you can see it seems there is not such difference in terms of population between wild/rough territories and fertile/plain ones. Should not be much more limitation in harsh territories in term of food and population ? Or maybe this is already in place but I have not noticed it ?

I don't think. Just to make an example inside Italy, I have Umbria (mountains) that reached level 23, more than Naples and a bit less of other plain regions.