Yeah, I'd just house-rule it in to fit whatever penalty a dwarf gets for using human-sized stuff. They're one "size" smaller than intended, so it would seem to incur the same penalties. Likewise, a human using dwarf-sized stuff would be akin to a troll using human-sized stuff, were it to come up in one of my personal games.