I asked him what on earth that meant, and asked if I can go. He pointed at the road again. I said you have two possible signals and that isn't one of them, now am I staying or going? That was when he told me I had an attitude. I told him I just want to get to work so I can stand around doing fuck all as well.
The joke did not land and he waved me through, still not the correct signal but by that point I did not care.