The community garden had always been a place where neighbors worked side by side without worrying about politics or publicity.