| id |
ecaade2024_80 |
| authors |
Li, Wenpei; Wu, Jiaqian; M. Herr, Christiane; Stouffs, Rudi |
| year |
2024 |
| title |
Enhancing Lexicon Based Evaluation of Urban Green Space Characteristics and Perceptions with a Large Language Model |
| source |
Kontovourkis, O, Phocas, MC and Wurzer, G (eds.), Data-Driven Intelligence - Proceedings of the 42nd Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe 2024), Nicosia, 11-13 September 2024, Volume 2, pp. 59–68 |
| doi |
https://doi.org/10.52842/conf.ecaade.2024.2.059
|
| summary |
Evaluating Urban green space Characteristics and Human Perceptions (UCHP) is crucial for landscape design and management due to their impact on public health. Online park reviews provide valuable insights into human-environment interactions, enabling the large-scale evaluation of UCHP. However, existing approaches to classify online park reviews commonly ignore text context, leading to low precision of UCHP quantification and supervised approaches are rarely applied due to huge cost. To improve the precision and effectiveness of UCHP quantification, we propose a novel workflow comprising five stages: custom lexicon creation, design of labels for a Large Language Model (LLM), sentence classification using lexicon and LLM, and performance evaluation using a manually annotated dataset and four metrics: precision, recall, accuracy, and F1 score. To examine the performance of the LLM, we compared the classification of 15 UCHP using LLM, lexicon, and lexicon+LLM. The analysis involved utilizing online park review sentences from Google Map and TripAdvisor using the proposed workflow. The higher precision, accuracy and F1 score demonstrate that combination of lexicon and LLM yields the highest performance, followed by using only lexicon and then solely LLM. This performance evaluation demonstrates the validity of the proposed LLM-aided workflow, providing a practical, reliable, and efficient alternative to the lower performance of unsupervised methods, or costly supervised classification methods. We discuss the limitations of lexicon+LLM and outline new opportunities for LLM application in landscape studies. |
| keywords |
urban green space, characteristics and human perceptions, large language model, evaluation |
| series |
eCAADe |
| email |
|
| full text |
 file.pdf (419,047 bytes) |
| references |
Content-type: text/plain
|
Chesnokova, O., & Purves, R. S. (2018)
 From image descriptions to perceived sounds and sources in landscape: Analyzing aural experience through text
, Applied Geography, 93, 103-111. https://doi.org/10.1016/j.apgeog.2018.02.014
|
|
|
|
|
Gugulica, M., & Burghardt, D. (2023)
Mapping indicators of cultural ecosystem services use in urban green spaces based on text classification of geosocial media data
, Ecosystem Services, 60, 101508. https://doi.org/10.1016/j.ecoser.2022.101508
|
|
|
|
|
Huai, S., & Van de Voorde, T. (2022)
Which environmental features contribute to positive and negative perceptions of urban parks? A cross-cultural comparison using online reviews and Natural Language Processing methods
, Landscape and Urban Planning, 218, 104307. https://doi.org/10.1016/j.landurbplan.2021.104307
|
|
|
|
|
Kong, I., Sarmiento, F. O., & Mu, L. (2023)
Crowdsourced text analysis to characterize the U.S. National Parks based on cultural ecosystem services
, Landscape and Urban Planning, 233, 104692. https://doi.org/10.1016/j.landurbplan.2023.104692
|
|
|
|
|
Laurer, M., Van Atteveldt, W., Casas, A., & Welbers, K. (2023)
Less Annotating, More Classifying: Addressing the Data Scarcity Issue of Supervised Machine Learning with Deep Transfer Learning and BERT-NLI
, Political Analysis. https://doi.org/10.1017/pan.2023.20
|
|
|
|
|
Li, J., Gao, J., Zhang, Z., Fu, J., Shao, G., Zhao, Z., & Yang, P. (2024)
Insights into citizens experiences of cultural ecosystem services in urban green spaces based on social media analytics
, Landscape and Urban Planning, 244, 104999. https://doi.org/10.1016/j.landurbplan.2023.104999
|
|
|
|
|
Lin, B. B., Fuller, R. A., Bush, R., Gaston, K. J., & Shanahan, D. F. (2014)
Opportunity or orientation? Who uses urban parks and why
, PLoS ONE, 9(1), 1-7. https://doi.org/10.1371/journal.pone.0087422
|
|
|
|
|
Linwei, H., Longyu, S., Fengmei, Y., Xue-qin, X., & Lijie, G. (2021)
Method for the evaluation of residents perceptions of their community based on landsenses ecology
, Journal of Cleaner Production, 281, 124048. https://doi.org/10.1016/j.jclepro.2020.124048
|
|
|
|
|
Veitch, J., Rodwell, L., Abbott, G., Carver, A., Flowers, E., & Crawford, D. (2021)
Are park availability and satisfaction with neighbourhood parks associated with physical activity and time spent outdoors?
, BMC Public Health, 21(1), 1-10, https://doi.org/10.1186/s12889-021-10339-1
|
|
|
|
|
Vich, G., Delclos-Alió, X., Maciejewska, M., Marquet, O., Schipperijn, J., & Miralles-Guasch, C. (2021)
Contribution of park visits to daily physical activity levels among older adults: Evidence using GPS and accelerometery data
, Urban Forestry and Urban Greening, 63. https://doi.org/10.1016/j.ufug.2021.127225
|
|
|
|
|
Wang, L., Han, X., He, J., & Jung, T. (2022)
Measuring residents perceptions of city streets to inform better street planning through deep learning and space syntax
, ISPRS Journal of Photogrammetry and Remote Sensing, 190, 215-230. https://doi.org/10.1016/j.isprsjprs.2022.06.011
|
|
|
|
|
Wang, R., Liu, Y., Lu, Y., Zhang, J., Liu, P., Yao, Y., & Grekousis, G. (2019)
Perceptions of built environment and health outcomes for older Chinese in Beijing: A big data approach with street view images and deep learning technique
, Computers, Environment and Urban Systems, 78, 101386. https://doi.org/10.1016/j.compenvurbsys.2019.101386
|
|
|
|
|
Zheng, T., Pan, Q., Zhang, X., Wang, C., Yan, Y., & Van De Voorde, T. (2024)
Research Note: Linking sensory perceptions with landscape elements through a combined approach based on prior knowledge and machine learning
, Landscape and Urban Planning, 242, 104928. https://doi.org/10.1016/j.landurbplan.2023.104928
|
|
|
|
|
Zhou, C., Zhang, S., Zhao, M., Wang, L., Chen, J., & Liu, B. (2023)
Investigating the dynamicity of sentiment predictors in urban green spaces: A machine learning-based approach
, Urban Forestry and Urban Greening, 89, 128130. https://doi.org/10.1016/j.ufug.2023.128130
|
|
|
|
|
Zhou, H., Wang, J., & Wilson, K. (2022)
Impacts of perceived safety and beauty of park environments on time spent in parks: Examining the potential of street view imagery and phone-based GPS data
, International Journal of Applied Earth Observation and Geoinformation, 115, 103078. https://doi.org/10.1016/j.jag.2022.103078
|
|
|
|
| last changed |
2024/11/17 22:05 |
|
