The Blues head to Accrington Stanley tomorrow striving to make it five successive league victories.
Not since March-April 2014, under caretaker boss Andy Awford, have Pompey achieved such a winning streak.
During that period they registered five triumphs to succeed in remaining in the Football League with three matches to spare.
Of course, Paul Cook’s side still have some way to go before matching Northampton’s remarkable haul of 10 straight league victories in their march to the League Two title last term.
Chris Wilder’s side also recorded seven wins in all competitions earlier in the season – a stretch ended by Pompey at the Sixfields Stadium.
The next challenge for Cook’s men is a trip to Accrington tomorrow – a side disappointingly in 16th spot following their play-off exploits of last season.
And Burgess is eager to make them scalp number five in the Blues’ ongoing run.
He said: ‘We now have four in a row and while you go out to win every game, it is not always going to happen.
‘We have a tough trip to Accrington and will look to be positive again, continue what we have been doing and hopefully make it five to stretch this run we are on.
‘Northampton’s run last season shocked the whole league and if you can do something even close to that then you are buzzing as a unit.
‘It’s a cliché, I know, but you just have to take each game as it comes.
‘I am not sure I want to compare this team to last season’s, there are different aspects. We’ve had some good lads come in and some good lads leave and are trying to build that spirit in the team and create that belief that we can go on and win five or six.
‘You could see that in a fantastic win over Wycombe – and now we are looking at potentially a fifth win.’
Burgess, of course, netted in last weekend’s 4-2 victory over the Chairboys, marking his 50th Pompey appearance.
Cook may have evolved the team which last year reached the play-off semi-finals, but the 24-year-old continues to be an automatic choice in the centre of defence.
This term he has partnered Jack Whatmough, Adam Barton and Tom Davies in the Blues’ opening seven League Two matches.
Looking across the side, there are suggestions change has had a positive effect, particularly with the current winning streak and a run of three penalties in four matches.
Burgess added: ‘You hear things about whether we would have won that penalty last year or if there is a bit of luck going our way.
‘I am not sure whether that’s the case or not, I personally don’t overthink things too much. I take the three points over Wycombe and move on.
‘You cannot put your finger on why we suddenly have had more penalties – and I believe the one against Wycombe was a penalty.
‘We just have to keep working and building on what we have created and see where it takes us.’