David Lascher Remembers Patrick Duffy in Robe and Slippers on 'Step by Step' Set

"He said to me, ‘I had clothes on under the robe,’ ” Lascher recalled on the 'Keanan and Lakin Give You Déjà Vu' podcast

Sony Pictures Studios

David Lascher’s fond memory of how “chill” Patrick Duffy was on the set of Step by Step led to a hilarious misunderstanding.

The Hey Dude star, 52, joined Staci Keanan and Christine Lakin on a recent bonus episode of their Step by Step rewatch podcast Keanan and Lakin Give You Déjà Vu to look back on his 1992 guest appearance on the beloved ’90s sitcom.

“The few things I remembered about being on Step by Step was being so nervous, so intimidated,” Lascher said. “And on show night, like, Patrick Duffy was walking around in a robe and slippers.”

“He came to the note session and I was like, ‘I can't believe how calm this guy is. Like, he's about to go out in front of a few hundred people,’ ” he continued. “I'm like, ‘This is awesome.’ ”

Hubert Vestil/Getty; Paul Archuleta/FilmMagic

Lascher had previously mentioned this to Keanan back in March when she guested on his and Christine Taylor’s podcast, Hey Dude…The ’90s Called. On Keanan and Lakin, Lascher went on to recall how Keanan recently reintroduced him to Duffy at ’90s Con and that she’d recounted his memory of the Dallas alumnus strolling around in a robe.

“And he said to me, ‘I had clothes on under the robe,’ ” Lascher recalled. “I'm like, ‘Dude, I didn't mean it like that! I meant I was in awe of how chill you were.’ But in this day and age, like, he thought I was, like, out of here …”

“You're trying to cancel him,” Keanan joked.

“I was, like, ‘No. I didn't mean it like that!’ ” Lascher responded. “That is my recollection of him. It was being so calm and chill and Zen, and, like, I was in a complete panic mode.”

Robin L Marshall/Getty

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Lascher explained that appearing on Step by Step was one of the first times he’d had to film in front of a live studio audience. But, he said, it wasn’t the first time his pre-show jitters got the better of him. In 1990, he briefly left Nickelodeon’s Hey Dude to star in the short-lived NBC sitcom A Family for Joe opposite Ben Savage, Juliette Lewis and Hollywood legend Robert Mitchum.

“My first episode, we were doing the cast intros. Right?” he recalled. “So, we did the cast intros, and I went backstage and threw up in a garbage can.”

Lascher shared other memories of Mitchum and Lewis from their short time costarring in the series, which only aired for nine episodes.

“She is not only one of the most talented actresses, but, like, she was dating Brad Pitt at the time,” he said of Lewis. “I remember him, like, hanging out in her dressing room, smelling like weed, you know? But he was a super cool dude. But, you know, Juliette was just like, ‘I can't believe I'm on a sitcom.’ And Robert Mitchum was the same way.”

Ron Galella Collection via Getty; Kypros/Getty

“The story that was told to me is that Robert Mitchum agreed to do a two-hour TV movie, which became like a backdoor pilot. He didn't know he'd end up on a sitcom,” Lascher recalled of the Oscar-nominated actor perhaps best known for playing the sinister preacher in 1955’s Night of the Hunter. “Looking back on it, I didn't realize how nuts it was that Robert Mitchum smoking like unfiltered Camels, you know, like, just, you know, cursing everybody out. And, and Juliette Lewis went on to do Cape Fear, like, very soon.”

“She was cool, but she kept telling me, like, ‘What are we doing here? Like, what is going on?’ ” he said of Lewis. “She did not have the comic precision for a sitcom like you guys did. You know? She would just wanna do her own pacing. She just didn't like it. You know? I think with half-hour comedy, you either have it or you don't.”