The nitrogen-vacancy (NV) center in diamond has shown great promise for quantum information due to the ease of initializing the qubit and of reading out its state. Here we show the leading mechanism for these effects gives results opposite from experiment; instead both must rely on new physics. Furthermore, NV centers fabricated in nanometer-sized diamond clusters are stable, motivating a bottom-up qubit approach, with the possibility of quite different optical properties to bulk.