City progressed to the semi-finals after a 4-2 aggregate triumph over Borussia Dortmund as they reached the last four for the first time under the former Barcelona boss and set up a tie with PSG.
Guardiola told BT Sport: "It feels incredible.
"This is the second time we have got to the semi-finals, so there is not much history for our club here, but we will start to build it.
"Semi-final, Champions League. For the second time in our history we are there with the real elite of Europe. Now, I don't want to think for one second about PSG. I want to celebrate. Dinner with the staff and the team. I don't know which wine, it will be with wine for sure."
The win over Dortmund ended a run of City being knocked out in the quarter-finals for three years running and Guardiola knows it was important to clear the psychological hurdle posed by reaching the last four.
He said: "It is a good moment for all of us, especially the players. We cannot forget, in the five years we are together, we have gone out of the Champions League four times.
"The players suffer the same as the backroom staff and all the people working in the club. They are huge competitors, and they want to make the next step - and they did.
"Psychologically, for all of us - the players, myself, the backroom staff, my chairman, CEO, to pass this moment of the quarter-finals to get to the semi-finals was necessary.
"Now, of course, we want more."