Danny Whitaker went in search of his second successive goal on home turf only two minutes into the game when he fired a low shot wide of the goalkeeper's right post from 18 yards.
Leon Constantine tried his luck from a similar range in the 13th minute but failed to test Steve Mildenhall again with the striker's effort sailing clear of the crossbar.
However, Constantine made it 20 for the season three minutes later when Akpo Sodje's ball from the byline found Vale's top-scorer waiting in the box to coolly slot home from 12 yards.
The Valiants split the visiting defence once more a minute later when another selfless pass by Sodje was dummied by Constantine for Whitaker to fire into Mildenhall's bottom right corner.
In an extraordinary turn of events, Town made it level pegging once more with two quick-fire goals of their own before half-time.
Wayne Gray was first to strike when Martin Brittain's cross was deflected into the air, giving the former Vale loan player the chance to head past a helpless Joe Anyon in the 37th minute.
The home side were caught napping straight from the resulting kick-off with Chris Cohen bursting into the box to force a save only for Marcus Stewart to follow up with a good finish into the roof of the net.
Martin Foyle's men opened brightly again after the break and took the lead once more when Whitaker's low pass across the face of goal was turned into the net by Yeovil defender Matthew Rose.
Yeovil made a hash of some more defending in the 80th minute to hand the Valiants the points when Mildenhall's attempted clearance struck the on-rushing Constantine to claim his second of the afternoon.