McLeish played a full season at Shielfield Park last year, and as is so often the case, a former player came back to haunt his old club with the winning goal.
Little took charge of the first team squad with Jimmy Crease at Station Park after Wednesday's resignation of Allan McGonigal and assistant Martin Mooney, and was philosophical about his former team mate and drinking buddy inflicting a fifth straight defeat on his side.
Little said: "We had a couple of drinks later on - I don't grudge Kevin scoring a goal like that. It was a bit disheartening as we were more organised and the back four and goalkeeper did well. Overall I can't argue with the effort but it was disappointing to lose such a late goal - it was a real blow to the players."
With the take-over nearly completed, Little believes the news gave the players a timely boost to produce an improved performance.
"It is disheartening getting beaten every week but the take-over gave the players a little lift. We have been a bit divided from upstairs and downstairs but hopefully we can start to pull together.
"I just felt things weren't right at the club - you have got to look after the players."
Little and Crease took charge of training last Thursday after the departure of McGonigal and Mooney last Wednesday, and the experienced midfielder had some sympathy for the former management team.
He also hopes to return the enjoyment of playing football to the squad, which appears to have disappeared as defeats have mounted.
"They (McGonigal and Mooney) tried and worked hard," said the 33-year-old.
"If Allan had still been there on Saturday there would have been the same reaction as the players got a lift from the take-over - although they shouldn't have needed it.
"I said to the players if you don't enjoy playing football you shouldn't be here.
"I have played football for 20 years and still love playing.
"I don't see the point of coming to training if you are not going to work hard and enjoy it. I will try and make sure training is enjoyable," he said.
McGonigal had often complained of a lack of investment in the squad contributing to their current lowly status.
But Little was not so sure that the new board needs to dip too far into their pockets unless immediate success is demanded.
He said: "If they want to move forward very quickly then yes, they have to invest but if they want a gradual build up to decent success and reach the second division then that may not be the case.
"We have a big squad already of 21, with Andy McLean currently on loan.
"It really depends on what success they want but it is important to get Berwick back on a steady ship.
"You have to remember that two years ago we were top of the league and winning championships."
Little and Crease are expected to lead Berwick Rangers out against Cowdenbeath this Saturday at Shielfield Park.
Steven Bonar, Stuart Fraser and Little himself are all still out injured, while Gary Greenhill is still suspended for the match with the Blue Brazil.
And Little hinted that he may quit the game if his troublesome knee, which he had surgery on in September, does not respond well in the coming weeks.
"I can't keep going this way - it is time consuming and hard work and in the long term I don't want to be left with half a knee.
"We will see how it reacts in the next couple of weeks - my problem is I enjoy it too much. If I was not able to train or play it would be disappointing.
"We lost to Cowdenbeath up there earlier in the season but that was away and we have been good at home in recent years."
Berwick's last game against Cowdenbeath saw the Fifers win 2-1 at Central Park in September thanks to a Brian Fairbairn goal - another who played with Berwick last season.
Little and Crease will hope Saturday sees an end to Berwick's friendliness with old acquaintances.

l Names in the ring to become the new boss at Berwick Rangers - see page 31