yea no doubt luffy is more than someone who punches, he shows respect, honor

he chose not to fight against that one spring legged guy,, he dedicated himself to help nami in the beginning,, to help that old guy who dug up the well

his crew would have never followed him if he's just a simpleton (he does act stupid sometimes though lol)