Hitchin's interest in the Herts Senior Cup came to an end against Bishop's Stortford, but manager Darren Salton was not too despondent.
"We played a lot better tonight and were much tighter, I thought we were genuinely unlucky," he said.
Salton made some changes to his side, bringing back Lance Gentle-King and Stuart Hammonds. Hitchin looked better at the back than they have for weeks against a half-decent Conference South side.
Chances from Rob Miller, Chris Dillon and Liam Folds should have given Hitchin the lead well before Stortford grabbed a late winner.
Gentle-King, who has been gaining valuable experience away from the club, went closest with a header onto the top of the crossbar.
Stortford’s winning goal came from an 85th minute breakaway, Danny Morgan scoring to send the East Herts side through to the next round.
Hitchin: Beckwith, Frater, Gentle-King, Hammonds, Folds, Deeney, Williams, Miller, Dillon, Sozzo (Jaggard 78), French
Stortford: Young, Collis, Stewart (Porter 88), Goodacre, Taylor (Morgan 58), Innocent (Jones 58), Langer, Ward, Fuller, Essandoh, Midson
Attendance: 95
Referee: R.Tincknell