Pot may be legal in some states—but the neighbors don’t have to like it.

Marijuana and hemp have joined wacky paint colors and unsightly fences as common neighborhood disputes facing homeowner associations. Though a few HOAs have willingly changed their rules to accommodate legal marijuana use or home-growing, many more are banning home pot smoking.