to give the devil his due ...

abych mu nekřivdil ...
"I don't like Mr. Jones, but to give the devil his due, I must admit that he is a good teacher." (Já pana Jonese rád nemám, ale abych mu nekřivdil, musím uznat, že je to dobrý učitel.)