“Sister Wives”: Janelle Reveals Why Her Daughter Maddie Hid Her Third Pregnancy from Dad Kody

Kody and Janelle Brown share daughter Madison, who's a mom of three

Janelle Brown is opening up about why her daughter didn't tell Kody Brown about her third pregnancy.

During the Sunday, Nov. 3 episode of Sister Wives, Janelle, 55, tells her former husband, 55, that she's considering moving closer to their daughter Madison "Maddie" to be near their grandchildren. Kody then asks, "Why didn't she call me to tell me she was having a baby?"

"The kids are all feeling very estranged from you," Janelle replies.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Related: Sister Wives' Madison Brush Is Pregnant with Baby No. 4 amid Estrangement from Dad Kody Brown

In a confessional, Janelle shares that Maddie feels like her father "hasn't shown interest" in her children: son Axel, 7, and daughters Evie, 5, and Josephine, 21 months, whom she shares with husband Caleb Brush.

"Maddie has observed to me that Kody has not been out to see her kids since Evie was born, and Evie's 3," she explains. "Maddie's like, 'Why would I tell him that I'm having another one? He hasn't really shown that much interest in the other two.'"

Back in the scene, Kody can't seem to understand Maddie's logic, saying she's "talking like I've done some kind of evil to them. I'm missing something here."

He then blames the lack of relationship between himself and his daughter on "jealousy and gossip," which he discussed further earlier this season.

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!

During an argument with wife Robyn Brown, 45, on a previous episode, Kody told her, "You saw Madison take her kids and scuttle them away from me. She never told me she was pregnant. She never told me she was going to have a baby."

“They’re purposefully leaving me out of their lives to punish me for a crime I didn’t commit,” he continued. “I am only guilty of not falling madly in love with their mothers. Well, Madison actually called Janelle, saying ‘Dad said he didn’t love you.’”

“I know, but couldn’t you like reach out to her?” Robyn asked.

"Every time I talk to her, she spreads gossip about me to the rest of the family,” Kody alleged.

Sister Wives airs Sundays at 10 p.m. ET on TLC.