I don't know what the game mechanics solution is, but check these examples of real knife wounds out.
http://www.dlsports.com/knife_dangers.html
if that's 1d4 then what does 1d8 for a sword look like? Is there really a x2 factor of lethality between a sword and a knife? Or are most of the advantages of a sword tactical in nature?