This paper provides a critical assessment of the literature estimating the consequences of climate impacts in agriculture and the food system. This literature focuses overwhelmingly on the impact of elevated CO2 concentrations in the atmosphere, higher temperatures and changing precipitation on staple crop yields. While critically important for food security, we argue that researchers have gravitated to measuring impacts ‘under the streetlight’ where data and models are plentiful. We argue that prior work has largely neglected the vast majority of potential economic impacts of climate change on agriculture. A broader view must extend the impacts analysis to inputs beyond land, including the consequences of climate change for labor productivity, as well as the rate of total factor productivity growth in the face of more rapidly depreciating knowledge capital. This broader view must also focus more attention on non-staple crops, which, while less important from a caloric point of view, are critically important in redressing current micronutrient deficiencies in many diets around the world. The paper closes with numerical simulations that demonstrate the extent to which limited input and output coverage of climate impacts can lead to considerable underestimation of the consequences for food security and economic welfare – particularly in the poorest regions of the world.