Yong Suk Lee,

More than two thirds of the world’s population are expected to live in cities by 2050, according to the United Nations. As urbanization advances around the globe, researchers at the University of Notre Dame and Stanford University said the quality of the urban physical environment will become increasingly critical to human well-being and to sustainable development initiatives.

However, measuring and tracking the quality of an urban environment, its evolution, and spatial disparities is difficult due to the amount of on-the-ground data needed to capture these patterns. To address the issue, Kellogg Faculty Fellow Yong Suk Lee, assistant professor of technology, economy, and global affairs at the Keough School of Global Affairs at the University of Notre Dame, and Andrea Vallebueno, from Stanford University, used machine learning to develop a scalable method to measure urban decay at a spatially granular level over time.

 Their findings were recently published in Scientific Reports. 

“As the world urbanizes, urban planners and policy makers need to make sure urban design and policies adequately address critical issues such as infrastructure and transportation improvements, poverty, and the health and safety of urbanites, as well as the increasing inequality within and across cities,” Lee said. “Using machine learning to recognize patterns of neighborhood development and urban inequality, we can help urban planners and policy makers better understand the deterioration of urban space and its importance in future planning.”

Traditionally, the measurement of urban quality and quality of life in urban spaces has used sociodemographic and economic characteristics such as crime rates and income levels; survey data of urbanites’ perception and valued attributes of the urban environment, or image datasets describing the urban space and its socioeconomic qualities. The growing availability of street view images presents new prospects in identifying urban features, Lee said, but the reliability and consistency of these methods across different locations and time remains largely unexplored. 

In their study, Lee and Vallebueno, used the YOLOv5 model, (a computer vision algorithm that can detect objects) to detect eight object classes that indicate urban decay or contribute to an unsightly urban space, such as potholes, graffiti, garbage, tents, barred or broken windows, discolored or dilapidated façades, weeds, and utility markings. They focused on three cities: San Francisco; Mexico City; and South Bend, Indiana; in neighborhoods chosen based factors including urban diversity, stages of urban decay, and the authors’ familiarity with the cities.

Using comparative data, they evaluated their method in three contexts: homelessness in the Tenderloin District of, San Francisco between 2009 and 2021; a set of small-scale housing projects carried out in 2017–2019 in a subset of Mexico City neighborhoods; and the western neighborhoods of South Bend, Indiana in the 2011–2019 period, a part of the city that had been declining for decades but also saw urban revival initiatives.

Researchers found that the trained model could adequately detect the objects across different cities and neighborhoods, and did especially well in denser populations such as San Francisco. 

For instance, the maps allowed researchers to assess the temporal and geographic variation in homelessness in the San Francisco area, an issue that has been increasingly growing over the years. 

The model struggled in the more suburban area of South Bend, according to Lee, demonstrating a need to tweak the model, and the types of objects identified, in less dense populations. Additionally, they found there is still a risk for bias that should be addressed. 

“Our findings indicate that trained models such as ours are capable of detecting the incidences of decay across different neighborhoods and cities, highlighting the potential of this approach to be scaled in order to track urban quality and change for urban centers across the US and cities in other countries where street view imagery is available,” he said.

Overall, Lee said the model has potential to provide valuable information using data that can be collected in a more efficient way compared to using coarser, traditional economic data sources and that could be a valuable and timely tool for government, non-government organizations and the public.

“We found that our approach can employ machine learning to effectively track urban quality and change across multiple cities and urban areas,” Lee said. “This type of data could then be used to inform urban policy and planning and the social issues that are impacted by urbanization, including homelessness.”

This story originally published at Keough.nd.edu.


The Kellogg Institute for International Studies, part of the Keough School of Global Affairs at the University of Notre Dame, is an interdisciplinary community of scholars and students from across the University and around the globe that promotes research, provides educational opportunities, and builds partnerships throughout the world on the themes of global democracy and integral human development.