Khalsa made it two wins out of two in the new season but had to ride their luck slightly against a game and lively Swifts side.
A brace from Dan Westwood, his first goals for Khalsa in eight injury-plagued months, proved decisive.
The visitors equalised on 22 minutes, Drew Canavan doing what he normally does with a free kick and putting it in the top corner after Khalsa keeper Sam Arnold had handled outside the box.
This gave Swifts optimism and they almost took the lead through Chris Conway on 32 minutes and then five minutes later from Lewis Platt, forcing a fine save from Arnold.
The second half was a slog for the first 18 minutes or so, neither side willing to concede ground in the middle of the park.
But the game turned on 63 minutes when Westwood turned home a Alex Woodhouse corner to put Khalsa back in front.
Dave Meese had an effort cleared off the line by James Timmins to prevent Khalsa doubling their lead on 65 minutes after good work by substitute Lewis Worsey.
And at the other end Canavan was denied an equaliser by a good save from Arnold.
With ten minutes to play a great move by Khalsa ended with Meese hitting the post and having to play out a nervous finish to get the three points.
Sporting Khalsa: Sam Arnold, Carlo Franco, James McGrady, Leon Miles, Tes Robinson (captain), Alex Woodhouse (Alex Perry), Kieron Whittaker, Dave Meese, Dan Westwood (Josh McKenzie), Mykel Beckley (Lewis Worsey), Sean Williams. Subs not used: Mark Smith, Gaz Singh.