I've come to like weps that have the "Thrust" attack, since they seem to do high damage but have a low delay. Something like the Hardcleave (which I think has the "Berserk" option once you have enough skill) can do masses of damage in a single hit, but you have to actually score that hit and there's a very long delay before you get another go at it either way. And
really fast attacks, such as "Jab", just don't do enough damage to be worth it, I don't reckon. My normal weapon set-up (this is for a duo team) is two swords with the "Thrust" attack (in order - Rapier, Delta Blade, Inquisitor...obviously once I have the Inquisitor I can use that and the Delta Blade and so leave the Rapier behind), keeping two Vorpal Blades in the inventory for dealing with non-material creatures (though I tend to use the "Harm Non-Material Being" spell more for these). Both characters keep their current weapon in the right hand and a flask in the left, and I have them make potions as they need them - I only ever have the two flasks and as one of my characters is reincarnated Wuuf, I have the bonus of starting with a flask from Level 1
.
If you have too much stuff in your inventory, as mentioned the floor in Level 9 (either in the Central Stairwell or in that nearby room with the fountain) makes for a good stashing area, since it tends to be a common point to return to if you need food or water, or a rest. Or to get some training done in the Rat Room.
There's actually not that much stuff you need in the game, really, though that's the kind of thing you find out once you play it through the first time - on your second run-through you know which items you didn't use last time so you can just not bother picking them up
. Just wait till you start CSB!