I take it he didn't consider the first group Straw hats because he was himself among them. That probably turned on a filter successfully. However, this time it was only Zoro and Sanji.