Optical density is a common method for measuring exponential growth in bacterial batch cultures. However, there is a misconception that such exponential growth is equivalent to steady-state growth, which is a distinct physiological state that improves experimental reproducibility. Determining precisely when steady-state growth occurs is technically challenging and is aided by paired single-cell and population-level measurements. Using microfluidic mass sensors and optical density, we explore when in typical laboratory batch cultures steady-state growth occurs. We show that cell mass increases by an order of magnitude within a few hours of dilution into fresh medium and that steady-state growth is only achieved when cultures are inoculated with high dilutions from overnight stationary phase cultures. At high dilutions, Escherichia coli and Vibrio cyclitrophicus grown in different rich media achieve steady-state growth approximately 4 total biomass doublings after inoculation. We can decompose these dynamics into 3 doublings of average cell mass and 1 doubling of cell number for both species. We also show that batch cultures in rich media depart steady-state growth early in their growth curves at low cell and biomass concentrations. Achieving and maintaining steady-state growth in batch culture is a delicate balancing act, and we provide general guidance for commonly used rich media. Quantifying single-cell mass outside of steady-state growth is an important first step towards understanding how microbes grow in their natural context, where fluctuations pervade at the scale of individual cells.