I'm a little surprised in such a society the parents giving birth would raise their own children.

In that kind of setting, I would have thought they'd give babies to other couples so that the bonds do not get too strong between children and parents.
Then another swap or even collective upbringing from 3 to adulthood.