Aggregating XAI methods for insights into geoscience models with correlated and high-dimensional rasters

Simple item page
dc.contributor.authorKrell, Evan
dc.contributor.authorKamangir, Hamid
dc.contributor.authorCollins, Waylon
dc.contributor.authorKing, Scott A
dc.contributor.authorTissot, Philippe
dc.date.accessioned2023-09-01T20:32:09Z
dc.date.available2023-09-01T20:32:09Z
dc.date.issued2023-05-13
dc.description.abstractGeoscience applications have been using sophisticated machine learning methods to model complex phenomena. These models are described as black boxes since it is unclear what relationships are learned. Models may exploit spurious associations that exist in the data. The lack of transparency may limit user’s trust, causing them to avoid high performance models since they cannot verify that it has learned realistic strategies. EXplainable Artificial Intelligence (XAI) is a developing research area for investigating how models make their decisions. However, XAI methods are sensitive to feature correlations. This makes XAI challenging for high-dimensional models whose input rasters may have extensive spatial-temporal autocorrelation. Since many geospatial applications rely on complex models for target performance, a recommendation is to combine raster elements into semantically meaningful feature groups. However, it is challenging to determine how best to combine raster elements. Here, we explore the explanation sensitivity to grouping scheme. Experiments are performed on FogNet, a complex deep learning model that uses 3D Convolutional Neural Networks (CNN) for coastal fog prediction. We demonstrate that explanations can be combined with domain knowledge to generate hypotheses about the model. Meteorological analysis of the XAI output reveal FogNet’s use of channels that capture relationships related to fog development, contributing to good overall model performance. However, analyses also reveal several deficiencies, including the reliance on channels and channel spatial patterns that correlate to the predominate fog type in the dataset, to make predictions of all fog types. Strategies to improve FogNet performance and trustworthiness are presented.en_US
dc.description.sponsorshipThis material is based upon work supported by the National Science Foundation under 1460 awards 2019758 and 1828380.en_US
dc.identifier.citationEvan Krell, Hamid Kamangir, Waylon Collins, et al. Aggregating XAI methods for insights into geoscience models with correlated and high-dimensional rasters. Authorea. May 13, 2023. DOI: 10.22541/essoar.168394745.56383253/v1en_US
dc.identifier.doihttps://doi.org/10.22541/essoar.168394745.56383253/v1
dc.identifier.urihttps://hdl.handle.net/1969.6/97240
dc.language.isoen_USen_US
dc.rightsAttribution 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/*
dc.subjectdeep learningen_US
dc.subjectexplainable artificial intelligenceen_US
dc.subjectfog predictionen_US
dc.subjectgeoscienceen_US
dc.subjectmachine learningen_US
dc.titleAggregating XAI methods for insights into geoscience models with correlated and high-dimensional rastersen_US
dc.typeArticleen_US

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
Aggregating XAI methods for insights into geoscience models with correlated and high-dimensional rasters.pdf
Size:
6.2 MB
Format:
Adobe Portable Document Format
Description:
Download

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.72 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

COE Faculty Works