He's really too small to remember whether you're there or not. These early memories will all fade into a general sense of "I had a grandmother who loved me". Photos will reinforce and eventually overwrite the existing memories. So no need to feel guilt. If you call, and tell him about the cool places you're seeing, he can imagine he's there with you. Even more so if you video chat.