Josh Brolin Says He 'Almost Got Into a Fight' with Denzel Washington on “American Gangster” Set: 'This Is Crazy'

The actor clarified that he and Denzel Washington "get along very well now"

Josh Brolin said he and costar Denzel Washington nearly got physical while working on the set of 2007's American Gangster.

The actor, 56, appeared on the In Depth with Graham Bensinger podcast, at one point discussing his experience working with Washington, now 69, on director Ridley Scott's American Gangster.

"Denzel and I, by the way, get along very well now," he began when prompted to share the anecdote: "We almost got into a fight."

In American Gangster, Brolin played a detective investigating Washington's lead character Frank Lucas, a prominent New York City gangster in the '60s and '70s. For Brolin, the movie was an opportunity to work with "some of my favorite actors" — but he and Washington experienced trouble when Washington changed Brolin's lines for a scene last minute.

Related: Idris Elba Thought He Was Shot Making 'American Gangster', Says Ridley Scott: He 'Dropped to the Sidewalk'

"I was trying to remember the structure, and then we rehearsed. It wasn't that many lines, mostly mine. And I'm supposed to be super confident," Brolin said. "It’s Denzel Washington, man. It's, like, not easy. You're just this actor who they're trying out, seeing if he's the real thing or not. And I forgot a line."

"I put my hand on his shoulder and I said, ‘What's the line?’ and he hit my hand off and he said, ‘Don't ever f---ing put your hand on me,' " Brolin said. "And I was like, ‘Holy s---, I'm gonna scrap with Denzel Washington. This is crazy.’ We're not actors anymore … at least in my mind."

Related: Josh Brolin Recalls Barbra Streisand's Response When He Once Asked Her for a Glass of Wine: 'Aren't You a Drunk?'

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. 

Brolin said Washington seemed caught up in the persona of his character for much of their time on set.

"In his mind, he was just doing his job. He was that guy. He was Frank Lucas, period. But I didn't know," he said. "And then we got through that moment. I said, ‘Are you okay?’ He said, ‘Yeah. You?’ I said, ‘Yeah. Can I get my line?’ He said, ‘Go for it.’ It's like he'd said what he needed to say."

Brolin added during the interview that when he bumped into Washington at an event about a year after filming American Gangster, the two-time Oscar winner greeted him warmly. He also said A-list actors like Washington may view their time on movie sets differently than other actors who are excited to work with their own favorite performers.

Related: Denzel Washington Says There Were Rumors About Kevin Spacey Decades Ago: 'That's Between Him and God'

"You want to have an experience, and those guys are just trying to do their job. It makes sense to me that they would kind of narrow outside life in any way that they can," Brolin said, comparing Washington's on-set behavior to that of actors like Robert Duvall.

The American Gangster cast also included Russell Crowe, Chiwetel Ejiofor, John Hawkes, RZA, Ruby Dee, Carla Gugino, Cuba Gooding Jr., Joe Morton, Idris Elba, Common, T.I. and more.

Washington reunites with director Scott on Gladiator II, in theaters Nov. 22. Brolin's memoir From Under the Truck is out now wherever books are sold.