A last-gasp Christian Benteke penalty handed Tim Sherwood his first win as Aston Villa manager and lifted his side out of the English Premier League relegation zone with a 2-1 home victory against West Bromwich Albion.
Sadio Mane struck late to rejuvenate Southampton's fading battle for Champions League qualification with a 1-0 home win against Crystal Palace to move them into sixth after the full round was completed on Thursday, while Sunderland came from behind to draw 1-1 at Hull City.
Aston Villa, who have never been relegated during the Premier League era, started the day second-from-bottom and on a seven-game losing streak, their worst run for 52 years.
In his third game in charge, Sherwood avoided equalling Dick Taylor's 1964 record of losing his opening three league matches in dramatic circumstances.
It was Villa's first win in 13 league games and lifted them into 17th place on 25 points, three above the relegation zone.
The two sides will meet again in the FA Cup quarter-final at Villa Park this weekend.
Southampton, who had won once and scored just one in their last five games prior to kick off, ended a wait of over six hours for a goal at St Mary's when Mane struck in the 83rd minute.