When to visit a newborn

On May 1st I sent my brother a text message saying we could come visit his newborn son that same week if that would suit them. He called me back saying he was very happy I wanted to come so soon, but explaining that would be around the day they would come out of hospital and therefore not yet settled, so maybe another time.
As long as I heard his voice I was full of understanding, but as soon as we put the phone down I started to feel so sad and dejected.

Newborn-baby-sculpture-outside-St-Martins-in-the-Field-Church-London

May 6, I saw BambiEyes again. We talked about how this didn't mean it had to be as difficult as with his firstborn when it took me a year to go visit. How this time DP would be with me. That I could steer a middle course.
It appeared I deal slowly with rejection.... I think I watched almost 100 episodes of Grey's Anatomy.[trying to let go of the thought 'if he doesn't want me now I'm never going to visit'] This week my mother on the phone complaining how hard it was to find a date to visit my brother, how he wasn't available next weekend etc. etc. their agenda .. bla bla .. his schedule ... (Mam talks a lot)
So I sent this lame email to my brother with a list of dates including this weekend when DP and I could come visit. Next thing I know my father is on the phone saying how great it is we can all go together this Saturday! Oh well, now my brother asks all of us to come at the same time. It will both be easier and harder. My parents are desperate to hold their grandson, they will be all smiles and happiness. I'm afraid to feel like a failure for not having given them grandchildren. To feel excluded.
I'm also scared for all the unwritten rules.
It's always weird to visit with my SIL present. I mean, since she doesn't speak Dutch we all speak English. It is truly strange to speak with my parents in a foreign language, and it breaks my mother's heart to have to speak English to her son. I know, we are visiting their house and English is not her native language either and everyone is just being polite. It is just a pity that it is literally such a foreign affair to visit my brother. On the phone it still feels like my brother, but over there I just don't feel part of the family. I bet it is not easy for him either.