Journal article 297 views 24 downloads
MSMT-CNN for Solar Active Region Detection with Multi-Spectral Analysis
SN Computer Science, Volume: 3, Issue: 3
PDF | Version of Record
© The Author(s) 2022. This article is licensed under a Creative Commons Attribution 4.0 International LicenseDownload (1.78MB)
Precisely detecting solar active regions (AR) from multi-spectral images is a challenging task yet important in understanding solar activity and its influence on space weather. A main challenge comes from each modality capturing a different location of these 3D objects, as opposed to more traditiona...
|Published in:||SN Computer Science|
Springer Science and Business Media LLC
Check full text
No Tags, Be the first to tag this record!
Precisely detecting solar active regions (AR) from multi-spectral images is a challenging task yet important in understanding solar activity and its influence on space weather. A main challenge comes from each modality capturing a different location of these 3D objects, as opposed to more traditional multi-spectral imaging scenarios where all image bands observe the same scene. We present a multi-task deep learning framework that exploits the dependencies between image bands to produce 3D AR detection where different image bands (and physical locations) each have their own set of results. Different feature fusion strategies are investigated in this work, where information from different image modalities is aggregated at different semantic levels throughout the network. This allows the network to benefit from the joint analysis while preserving the band-specific information. We compare our detection method against baseline approaches for solar image analysis (multi-channel coronal hole detection, SPOCA for ARs (Verbeeck et al. Astron Astrophys 561:16, 2013)) and a state-of-the-art deep learning method (Faster RCNN) and show enhanced performances in detecting ARs jointly from multiple bands. We also evaluate our proposed approach on synthetic data of similar spatial configurations obtained from annotated multi-modal magnetic resonance images.
Object detection; Solar images; Active regions; Multi-spectral images; Deep neural networks
Faculty of Science and Engineering