Apparently the Little Skirrid and its more interesting big brother Ysgyryd Fawr (generally just referred to as "the Skirrid") a couple of miles up the road are two of the hills known collectively as the Seven Hills of Abergavenny. The others are the two best-known Abergavenny hills, Blorenge and Sugar Loaf, and the three minor hills Deri, Rholben and Mynydd Llanwenarth, all of which are really just outlying ridges on the south side of the Sugar Loaf without obvious "summits". Those given to occasional attacks of cynicism might conclude that the last few were added out of desperation just to get the number up to the magical seven (i.e. the same number as Rome). Further half-hearted lazy internet research reveals that this is a fairly common claim made on behalf of a whole host of places.
Anyway, here's the GPS track log and altitude profile, for what it's worth - the round trip took us just under two hours, but in slightly less treacherous underfoot conditions you could probably knock half an hour or so off that.
Our intention had been to pop into the Great Western by the railway station for a cheeky pint on the way back, but it was shut, unfortunately. The one Abergavenny pub recommendation I can give you is that the Hen & Chickens in the centre of town is excellent.