After getting his branch, he won't aim at you, but his arrows can still hurt you and knock you down. This has happened to me a handful of times. Rare? Perhaps. But certainly not impossible.
Could be a bug since some people aren't experiencing it, or could just be that those people are lucky and the arrows are landing close, but are still valid misses.