THE home team started the strongest and were catching the visitors out in every part of the pitch.
With 10 minutes gone Horncastle broke through and scored first.
Moments later they got their second before securing their third at the halfway stage.
Swifts started better after the break and narrowed the gap with a great header by Jack Fulton from a corner, Tyler Rice got himself on the score sheet for the visitors with 20 minutes gone to make it 3-2.
And despite Swifts pushing hard for the equaliser it was Horncastle who finished the match 4-2 winners after a defensive mistake by Swifts.
Next week Swifts host Bourne Town in their first ever County Cup Match. Kick off is 1pm at Jubilee Park, Ingoldmells.
Team: Chaplin (capt), Cunliffe, Day, Dunne, Fulton, Gregory, Jordon, Lavrenov, Parker, Probert, Rice, Sands, Turner, Wilson.