Neuroscience would be revolutionized by a technique to measure intracellular electrical potentials that would not disrupt cellular physiology and could be massively parallelized. Though such a technology does not yet exist, the technical hurdles for fabricating minimally disruptive, solid-state electrical probes have arguably been overcome in the field of nanotechnology. Nanoscale devices can be patterned with features on the same length scale as biological components, and several groups have demonstrated that nanoscale electrical probes can measure the transmembrane potential of electrogenic cells. Developing these nascent technologies into robust intracellular recording tools will now require a better understanding of device-cell interactions, especially the membrane-inorganic interface. Here we review the state-of-the art in nanobioelectronics, emphasizing the characterization and design of stable interfaces between nanoscale devices and cells.