I don't think kids ever really lose out from spending time with their parents, so long as they are decent parents.
I suppose it comes down to the quality of the time, but I also think it's good for kids to be bored sometimes.
I think I saw a child psychologist say we only need to get it right 30-50% of the time to be good parents. I find that very reassuring 😊