You can, but it require a "good" knife (at your level) and some perks/mods to increase damages.
I'm level 10 (but already 13 in Cool) and I can one-shot enemies with knives (with silenced Overture too, indeed)
Weird, in my last playthrough, no difference until the end.
But after reaching level 16 in Cool (to unlock the perk to "instant" retrieve your knive when defeating an enemy). I generally level up my blade skill to reach the level 15 (deal +100% damage on "full" health enemies). So both skill combined maybe make a difference, I don't know