The twins, who were born 10 weeks early, recently left the neonatal intensive care unit for the hospital they were born at, bringing them a step closer to being able to go home.
In the photo, Bryce stands between two small hospital beds where his sons are laying down, with a hand on each of them.
The former reality star wrote, "Loved for the boys you are, the men you will become and the sons you will always be."
Bryce's followers were quick to comment with one user writing, "And the Dad and husband you are and will be. Success is the four of you remaining as one!"
"They will have such a strong bond. I absolutely love being a twin. The best friend from day one," another wrote.
"Awww, lovely statement," a third said.
"Awww now in open cots, they will thrive with the love you have for them," someone else wrote.
Fellow MAFS star Jason Engler couldn't resist taking a swipe at his friend, writing, "We need a tan on those legs bra they fluorescent!!"
Bryce responded, "7 weeks in hospital, don’t get much sun in there!"
Speaking with the Daily Mail this week, Bryce revealed the biggest regret he had about his time on Married At First Sight.
"My biggest regret is definitely allowing the producers to manipulate me and convince me things that were going to be received as 'being honest'," he said.
The reality star also added that he was deeply remorseful for making remarks about Melissa's appearance and placing Beck Zemek in first place when putting the women in order of how attractive they were. Bryce ranked Melissa in fourth place
"What I said to Liss at the beginning of the show I would never say to a female I’ve just met. Never in a million years," he said. "I eventually cottoned onto it and refused to do sh*t but yeah."
He added that he felt sick watching the show back earlier this year and very much regretted the comments he made about Melissa's eye and hair colour.
Early in the show, Melissa asked him if she was his type and he responded, "It's a tough question. I'll be completely honest. Not 100 per cent.
"I've always gone for the blonde hair, blue eyes, tanned kind of girl, and someone that's, like, usually taller."
Melissa was clearly heartbroken and was seen crying shortly after, however, the pair is happily still together.
Never miss a thing. Sign up to Yahoo Lifestyle’s daily newsletter.
Or if you have a story idea, email us at email@example.com.