Here, we demonstrate an approach to synthesizing and structurally characterizing three atomically precise anion-templated silver thiolate nanoclusters, two of which form one- and two-dimensional structural frameworks composed of bipyridine-linked nanocluster nodes (referred to as nanocluster-based frameworks, NCFs). We describe the critical role of the chloride (Cl–) template in controlling the nanocluster’s nuclearity with atomic precision and the effect of a single Ag atom difference in the nanocluster’s size in controlling the NCF dimensionality, modulating the optical properties, and improving the thermal stability. With atomically precise assembly and size control, nanoclusters could be widely adopted as building blocks for the construction of tunable cluster-based framework materials.