Lester said the drinking was confined to starting pitchers who weren't in the game that day.
"It was a ninth-inning rally beer," he said. "We probably ordered chicken from Popeye's like once a month. That happened. But that's not the reason we lost.
"Most of the times it was one beer, a beer. It was like having a Coke in terms of how it affected you mentally or physically. I know how it looks to people and it probably looks bad. But we weren't up there just drinking and eating and nobody played video games. We watched the game."
Lester has not spoken to deposed manager Terry Francona, communicating with him only through text messages.
He said he was sorry to see Francona leave the team, but believes it might be for the best.
"I love Tito and he did a great job for us when he was here. On a personal level I was more than grateful for what he did for me and my family," Lester said. "But there comes a time when your authority is no longer there. You kind of run your course. People knew how Tito was and we pushed the envelope with it. We never had rules, we never had that iron-fist mentality. If you screwed up, he called you on it. That was how it worked.
"I never saw guys purposely breaking rules or doing the wrong thing in front of him and rubbing it in his face. But this particular team probably needed more structure. Tito was the perfect guy for this team for a long time but I think he got burnt out."
During a lengthy interview, Lester said he did not have permission to speak on behalf of Josh Beckett, John Lackey or the other starters, but felt he had to.
"Consider us a unit when it comes to these accusations," he said. "We either fall together or rise above it all together whether they like it or not. Things got magnified because we lost and sources started telling people what happened, which has me upset because if you're going to say something, be a man to put your name to it. But we're not bad people and we're not a bad group of guys.