It was Ben Stokes (50) and Jos Buttler (53), who showed some resistence against the visiting bowling attack to push their side to a fighting total.
Put into bat, England was off to a decent start as openers Jason Roy (38) and Jonny Bairstow (38) forged a 73-run partnership for the opening wicket before Kuldeep drew the first blood, dismissing the former in the 11th over.
The wrist-spinner made worsened England's situation when he sent back opener Bairstow, who was caught before the wicket, leaving the hosts reeling at 82/3.
Skipper Eoin Morgan then tried to nurse their inning with Ben Stokes before he became a victim of Yuzvendra Chahal in the 20th over leaving the hosts at 105/4.
Stokes and Buttler then forged a 93-run stand to inch England near the 200-run mark before Kuldeep shot another bullet in oppostion's line-up. The spinner scalped his fourth victim as he dismissed Buttler with England's scorecard readng 198/5.
As England managed to another 16 runs to their score, Kuldeep gave another jolt to the hosts after sending back Stokes in the 45th over.
There was no stopping for Kuldeep at a batting paradise Tent Bridge wicket on Thursday as he pounced his another wicket in the same over when David Willey was back to the dressing room after contributing a single run.
Before falling down to Umesh Yadav, Moeen Ali and Adil Rashid, chipped in with 24 and 22 runs while Liam Plunkett respectively while Liam Plunkett contributed with 10 runs to take their side to a competitive total.
Apart from Kuldeep, Umesh bagged couple of wickets leaking 70 runs from his 9.5 overs.
Brief Scores: England 268 all out in 49.5 overs (Jos Buttler 53, Ben Stokes 50; Kuldeep Yadav 6/25)