The Three Lions will face Sweden in the quarter-finals on Saturday following a dramatic last-16 win over Colombia on Tuesday night and expectation and optimism among the England fans has never been higher.
So much so, many will be expecting a safe passage through to the semi-finals and showdown against either Russia or Croatia for a place in the final.
Southgate was happy to revel in the penalty shootout win over Colombia, but quickly turned his attention to Sweden, pointing out England do not have a great record against them and will have to be at the top of their game once again.
"Fantastic," said Southgate after the win. "We deserved it as well. We played so well in the 90 minutes.
"We showed resilience to come back from huge disappointment and kept calm. It's huge credit to all our players and staff.
"Shootouts are tough. We had talked long and hard about owning the process of a shootout. They kept calm. The players have taken it all on board. It's a special moment for us.
"We looked at technique, how we needed to be as a team, the goalkeeper's role.
"But now I'm thinking about Sweden. They are another team we have a poor record against. We have underestimated them for years."
Meanwhile, Southgate was also keen to point out his players will not be 'bowed by the pressure of the past' as England teams have tried and failed to win the World Cup since 1966.
"We're trying to write our own history, and I've talked to the players about that," he added. "They write their own stories. We don't have to be bowed by the pressure of the past.
"This was special but I want us to go on. I don't want to go home yet."