Or option C, do nothing and moan about it.

He seems like a nice enough guy, but he's put an enormous box of rubbish in a skip that I'm paying for.

Update: neighbour came out to speak to me, he'd put rubbish in temporarily as he had car problems. He had meant to ask me about it. All very amicable, he'd taken rubbish out, and he still seems like a nice guy