Why can’t I remember my childhood? Here are 3 possible reasons ⬆️ While some people may have clear memories from their early years, it is not uncommon for others to have limited recollection or incomplete memories of their childhood. Difficulty recalling childhood memories does not indicate a problem. Memory is a complex process and various factors can impact how we recall our early experiences. Childhood memories are more susceptible to fading over time than more recent memories. So as we grow