Isn't it a bit naive to leave for raiding, deny your treacherous brother to come with you AND leave him back with his scheming wife AND a former enemy (after you broke the vow to take him with you as well) I could imagine that his brother might keep calm but how big are the chances that ALL 3 act loyal. No wonder this episode was called "Treachery".
And these vikings are tougher than Spartans. I fully understand that they are battle-seasoned and have balls of steel but come on - pretty much every enemy force gets f*cked up without big losses. Yes, that were simple guards without tactics...but they went from blocking the narrow town entrance to running into the Vikings one after the other like cannon fodder while both horsemen were standing in the town's centre doing nothing. And even out of battle order a single Viking kills at least 2-3 of them without any kind of resistance. All guards dead, not a single casulty among the Vikings.
They are always dumb guards that get overhelmed immediately, no sign of tactics or a commander. Vikings just change to SHIELDWALL! mode and instant win