Javier Bardem Says He 'Never' Wanted to Meet Erik and Lyle Menéndez While Working on “Monsters”

Bardem took on the role of José, Erik and Lyle's Menéndez's late father, in the Ryan Murphy-led series

When Javier Bardem's Monsters: The Lyle and Erik Menéndez Story costars visited Erik and Lyle Menéndez in prison, he wasn't very interested in tagging along.

The actor, 55, who portrays their late father, José, on the Ryan Murphy-led show, admitted that he "didn't want to" meet the brothers in prison ahead of his performance.

“First of all, I didn’t know much or more basically anything about the story when [series co-creator] Ryan Murphy talked to me, because it wasn’t that big in Spain," he told Variety. "And then once I dig in, I was like, ‘Wow, this is really, really sensitive material.'"

Related: Monsters' Nicholas Alexander Chavez Says 'I Sympathize' with Menéndez Brothers as He Talks Response to Series (Exclusive)

When Bardem tried to read and "search for material" so he could "see or understand" José, he couldn't find any. He only found information based on what others have said about him, "especially his children."

"I knew I had to trust the research Ryan and [co-creator] Ian Brennan did," he explained. "It was all there in the writing. So I said, ‘I don’t need to talk to anybody.’ And also I was very, very…the word is not scared, but I never felt for a second that I would be able to sit down with the murderers.”

Since the release of Monsters: The Lyle and Erik Menéndez Story, cast members like Cooper Koch have paid the brothers a visit in prison alongside sisters Kim and Khloé Kardashian, as well as their mom, Kris Jenner.

Related: Monsters' Cooper Koch Is 'Overwhelmed with Gratitude' After Menendez Brothers Resentencing: 'Hope to See Erik and Lyle Soon'

“I was so nervous before I got there,” Koch told PEOPLE of the visit. “I had spoken to both of them, so I knew we already kind of had a camaraderie, and they knew where I stood. I told them I supported them and I believed them. I had a feeling they were going to welcome me with open arms, but still so nerve-racking to meet someone who you've been listening to and are inspired by.”

When the moment came at the Richard J. Donovan Correctional Facility in San Diego, “there was an immediate connection,” he continued. “I got to hug both of them, and I sat next to Erik in this circle with all the other incarcerated individuals who were telling their stories, and they were both so kind. They're amazing people.”

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Koch also touched on the criticism the brothers had about the Ryan Murphy series — which Erik described as "disheartening slander" in a statement after the show's premiere.

"I get it. I understand that he would feel that way," he said. "This is really tough stuff. This is his life, and his life has a lot of trauma. It's a tragedy. And he's still in prison, so I understand how difficult it would be. I stand with him."