Lawrance Hunter and Alex Curran gave the North West side a healthy lead before Albion scored three times in the space fourteen minutes.
In fact, all three goals found the top-right corner but all were different strikes; Howarth toe-punted, Savory headed and Corner cleverly curled in front of the 254 fans.
Manager Michael Morton made just a single change to the side that played out a goalless draw with Mossley in the week.
Danny Frost picked up a hamstring injury in that game so Conor Sellars stepped in.
It was a fairly quiet start to the game with Aiden Savory testing Matthew Green's handling.
Taddy were in control of the contest but just couldn't quite score the opening goal that so often changes complexions of matches.
Cam Murray came incredibly close to netting his first goal for the club after twenty five minutes.
The former Scarborough man dropped his shoulder in the box, shrugged off his man but side-footed agonisingly wide.
Chris Howarth also came close after seeing his header tipped over before Savory's fierce strike was pushed clear by Green.
With Taddy finally starting to turn the screw, they were dealt a blow as it was Colne that broke the deadlock six minutes from the break.
Lawrance Hunter's in-swinging corner kick was difficult to deal with and Louis Jones could only help it into the back of the net.
The Brewers carried on where they left off however and almost hit straight back.
Josh Greening threaded a lovely little through ball to Conor Sellars but his low drive was kept out by Matthew Green from close range.
The rebound bounced into Aiden Savory's path but he blazed over the mark.
Half-Time: Taddy 0-1 Colne
The Brewers continued to test Colne at the start of the second half but again, Steve Cunningham's side took their chance and pounced on a loose ball to extend their lead.
Alex Curran was released down the inside right-hand channel and with Jones rushing off his line, he just helped it past the keeper.
Cue a spirited fight back from Tadcaster.
Chris Howarth, who has found himself take up a new role in the centre of midfield, was having an excellent game and he got the ball rolling netting his first for the club.
Sellars' free-kick was tipped onto the woodwork before the ball was recycled and Chris Howarth unconventionally toe-poked into the top corner.
This got the crowd going as the noise level increased at the i2i stadium.
And it was two a piece in the 76th minute as Aaron Hardy's lofted cross was powerfully headed into the back of the net by top scorer Aiden Savory. His sixth of the season!
And the crucial fifth goal came just three minutes later.
Conor Sellars intelligently pulled back to Tom Corner on the edge of the box who effortlessly curled into the far top corner.
The Lancashire side threw the kitchen sink in the six minutes of stoppage time but Albion stayed strong and saw out the victory.
Full-Time: Taddy 3-2 Colne
Tadcaster: Jones, Hardy, Grant, Howarth, Milne (c), Mycoe, Murray (Corner 62) (Ellam 90), Roper, Savory, Sellars, Greening (Barrett 87)
Unused: Dixon, Akeroyd
Colne: Green, Lynch, Hunter, Coleman, Ayres, Curran, Jordan, Anderson, Gaskell, Dean, Morrison (c)
Unused: Nangle, Hanley