At the end of August, admitted sexual harasser Louis C.K. made his first steps toward a comeback by performing an impromptu set at The Comedy Cellar. Not surprisingly, a lot of people were none-too-happy with the ease with which C.K. seemed to slip back into his old stomping grounds after nine months in celebrity jail (live in nice apartment, eat nice food, spend nice time with family).

Since C.K. has not said anything about the set, Comedy Cellar owner Noam Dworman became the person everyone was talking to about it. Did he know ahead of time C.K. was going to perform? Did he think C.K. had been punished enough and deserved a second chance? Did he do anything to protect or warn female performers that C.K. would be there? All these questions apparently got to Dworman, who told Huffington Post this week that now he's upset with C.K.—not about all the sexual harassment stuff, but for thrusting his club into the center of this mess.

"I’m very upset with him because my life has been substantially affected and his life has not, and I’m not sure he’s aware of it. I’m not sure that he gave it sufficient thought," he said. "On the other hand, I think he’s been disconnected from the world and didn’t realize. I am upset." He added: "We were the place that never did that stuff ... And now I’m the national symbol of it. The very opposite of what I always stood for. The very fucking opposite!"

The "stuff" he's referring to, of course, is that C.K. admitted to masturbating in front of multiple unwilling women throughout his comedy career; he also used his power in the industry (and allegedly his former manager Dave Becky) to threaten and gaslight those women into silence for years, stifling or even destroying their careers.

Dworman added, as he stated in other interviews, that his biggest problem with C.K.'s set was that he didn’t address "the elephant in the room, and that’s what comedians do." He previously told The Hollywood Reporter, "I think that for a man who signed off from the public with this promise to, 'I've talked for a long time, now I'm going to listen,' he created the expectation of, 'Well, now you're back after nine months, what did you learn?'"

The problem with this is that Dworman continually focuses on and prioritizes C.K.'s words, on C.K.'s well being, and not that of the other performers or the people who have been affected by C.K.'s behavior. He cares about what C.K. says, but not necessarily about what his victims have said, which is clear from his Twitter feud with Chicago comedy duo Dana Min Goodman and Julia Wolov, two of the five women who accused C.K. of sexual misconduct.

HuffPost also spoke with some of the Cellar’s employees for their piece, including a comedian named Joyelle who asked her full name not be used to avoid professional ramifications. She said she felt a "subtle discomfort" about C.K.’s surprise set and the industry’s treatment of women in general.

“I honestly feel that way because so many men here are arguing that what [Louis C.K.] did wasn’t that bad. And I’m like, A, would you want him to do it to you? B, would you want him to do it to somebody you loved? And C, he just doesn’t seem to care about what he did,” Joyelle said.

“Yes, it was a long time ago,” she continued. “Yes, he didn’t rape anybody. But it just speaks to a level of underlying discomfort. It’s just a subtle discomfort. I’ve said this before ― I’ve said this to Noam ― as a black woman, I don’t always necessarily feel comfortable in the space because it’s dominated by white men. Now, there seems to be a white man who has been accepted after he’s an admitted sexual predator.”

In the wake of the C.K. incident and backlash, Dworman said the Cellar is going to institute a new policy: "Essentially 'swim at your own risk.' We don’t know who may pop in that’s not on the lineup. If someone does come in that you don’t want to see, you are free to leave, no questions asked and check completely on the house," he said. "Having said that, we don’t expect Louis back anytime soon."