The Lions got off to a promising start when former Leeds United youngster Frank Mulhern found the back of the net inside five minutes.
Tadcaster levelled proceedings eight minutes later through Casey Stewart before Aiden Savory netted what turned out to be the match winning goal in the last minute of the first half.
The Brewers are looking to go one better than last year’s result of finalists as Selby Town, Pontefract Collieries and holders Farsley Celtic are left standing.
Michael Morton’s side had gone two and a half weeks without a fixture due to the freezing temperatures and they could have found themselves a goal behind after just fifteen seconds.
Tabeesh Hussain raced clean through on goal but the nippy winger pulled just wide of Michael Ingham’s right-hand upright.
It was a frenetic start to the quarter-final as Taddy themselves went close in the opening minutes as the returning Pete Davidson saw his effort tipped just wide by Declan Lampton.
However it was the visitors who opened the scoring as Frank Mulhern took over possession from Hussain and tapped into the net after taking round Ingham.
Guiseley threatened again soon after as Albert Ibrahimi let fly and forced the Taddy stopper to make a strong save.
Albion responded impressively though and weren’t behind for long, eight minutes to be precise.
Fierce pressure from both Corey Roper and Adam Baker led to exciting youngster Casey Stewart pouncing on a loose ball, driving in on goal and making no mistake sliding coolly into the net.
After scoring the equaliser, Taddy took full control of the cup tie with Sellars, Savory, Davidson and Stewart all at the heart of the action.
Casey Stewart had a good opportunity to net his 15th of the season shortly after the half hour mark when Adam Baker cut it back to the unmarked U21’s star but his side-footed effort was straight at Lampton.
Three of the four aforementioned players carved out the next chance and it was another glorious one for that man Stewart.
Sellars fizzed it in and got it back off Aiden Savory before clipping a perfect cross onto the foot of Casey Stewart who just couldn’t guide on target.
Nevertheless Albion got what they deserved right on the stroke of half-time as Conor Sellars showed off his outstanding delivery once again by picking out Aiden Savory at the back post and his header couldn’t be kept out by the young Guiseley keeper.
Half-Time: Taddy 2-1 Guiseley
The home side continued where they left off in the first half and were pushing to further establish their lead.
Commanding midfielder Pete Davidson was back in the starting eleven for the first time in several weeks after returning from injury and this was a welcomed boost for the Brewers as he bossed and dictated the play.
Casey Stewart was getting himself into the right positions time and time again and was unlucky on the hour mark as Aiden Savory’s whipped cross was sliced agonisingly beyond the forward by Darren Holden.
It was inevitable that Guiseley were going to fight their way back into the contest and press for an equaliser in the final part of the match.
Liam Hughes was the Lion who was looking the most likely to find the net as he headed and struck narrowly wide of the mark with the cup tie entering the final ten minutes.
Chances started to become more clear cut for the away side as the time ran down.
A cross from the right-hand side was sliced worryingly towards his own goal by Josh Barrett which had Michael Ingham at full stretch, only for it to whistle just wide.
From the resulting corner Guiseley would have been disappointed not to have drawn level as Jack Lazenby hesitated and Chris M’Bougu could only power a header straight into Ingham’s hands.
Liam Hughes had one final crack at beating Ingham but it was to no avail as his bobbling drive was gobbled up by the Northern Irishman.
There was one final talking point in the match as Albert Ibrahimi, who is incidentally brother of former Brewer Fatlum, went down in the penalty area under a ‘challenge’ from substitute Owen Marshall, only for referee Peter Walker to book the player for diving.
Full-Time: Tadcaster Albion 2-1 Guiseley
Tadcaster: Ingham, Howarth, Hunter, Roper, Mycoe, Barrett, Baker (Marshall 82), Sellars (Holmes 87), Savory, Davidson (Savage 76), Stewart
Guiseley: Lampton, Lazenby, Holden, Hogg, M’Bougu, Wells, Owusu (Buckham 60), Hughes, Mulhern, Ibrahimi, Hussain (Price 76)
Subs Unused: Banton, Webster