Patrick Roberts struck the post as the Hoops searched for a second goal just after the hour mark and they got the victor they fought so hard for in the first minute of added time as first-half substitute Tom Rogic took the ball through the penalty box and slotted past the diving Joe Lewis.
Gordon is also excited about the possibility of joining Celtic's treble-winning club, which now includes the teams from of 1967, 1969 and 2001.
Champions Celtic were 30 points ahead of them in the league table and are yet to lose a domestic game under Brendan Rodgers.
Celtic celebrated the 50th anniversary of their European Cup win over Inter Milan on Thursday.
"This is the best feeling ever".
"But I give credit to my players and credit to the Aberdeen players because I thought they worked tirelessly throughout the game".
"We had moments in the game when we could have got ourselves in front again".
I got promoted there with Swansea and it is 46 games of graft and commitment.
"This is my third season here and we have not managed to win it since I have been here". We know the importance of the game, what is on the line and at stake.
"My team feel ready and ready to take the opportunity and if we play like we can, we have a chance".
The Dons nearly profited while Celtic were trying to reorganise their back line with McGinn and Jack both testing Craig Gordon from distance.
Tom Rogic netted an injury time victor as Aberdeen's hopes of denying Celtic a domestic treble ended in disappointment. Second in the league is the best they can hope for but what a chance this is to really make a mark. What they've achieved and you see how hard it is.
"They are the second best team, there is no doubt about that".
"It doesn't take away from the professional aspect of the job and how much is focused on our vision which is to win titles and play with a charisma and quality which makes the supporters proud".