Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems

High performance computing is absolutely necessary for large-scale geophysical simulations. In order to obtain a realistic image of a geologically complex area, industrial surveys collect vast amounts of data making the computational cost extremely high for the subsequent simulations. A major comput...

Full description

Bibliographic Details
Authors: Puzyrev, Vladimir; Koric, Seid; Wilkin, Scott
Format: Article
Publication date:2016
Country:España
Institution:Universitat Politècnica de Catalunya (UPC)
Repository:UPCommons. Portal del coneixement obert de la UPC
Language:English
OAI Identifier:oai:upcommons.upc.edu:2117/84760
Online Access:https://hdl.handle.net/2117/84760
https://dx.doi.org/10.1016/j.cageo.2016.01.009
Access Level:Open access
Keyword:Large scale systems--Data processing
Numerical modeling
Linear systems
Direct solvers
Parallel computing
Controlled-source electromagnetics
Geophysical exploration
Electromagnetisme--Mesuraments
Àrees temàtiques de la UPC::Enginyeria mecànica::Impacte ambiental
_version_ 1878737756250701824
author Puzyrev, Vladimir
author2 Koric, Seid
Wilkin, Scott
author2_role author
author
author_browse Koric, Seid
Puzyrev, Vladimir
Wilkin, Scott
author_facet Puzyrev, Vladimir
Koric, Seid
Wilkin, Scott
author_role author
collection UPCommons. Portal del coneixement obert de la UPC
description High performance computing is absolutely necessary for large-scale geophysical simulations. In order to obtain a realistic image of a geologically complex area, industrial surveys collect vast amounts of data making the computational cost extremely high for the subsequent simulations. A major computational bottleneck of modeling and inversion algorithms is solving the large sparse systems of linear ill-conditioned equations in complex domains with multiple right hand sides. Recently, parallel direct solvers have been successfully applied to multi-source seismic and electromagnetic problems. These methods are robust and exhibit good performance, but often require large amounts of memory and have limited scalability. In this paper, we evaluate modern direct solvers on large-scale modeling examples that previously were considered unachievable with these methods. Performance and scalability tests utilizing up to 65,536 cores on the Blue Waters supercomputer clearly illustrate the robustness, efficiency and competitiveness of direct solvers compared to iterative techniques. Wide use of direct methods utilizing modern parallel architectures will allow modeling tools to accurately support multi-source surveys and 3D data acquisition geometries, thus promoting a more efficient use of the electromagnetic methods in geophysics.
eu_rights_str_mv openAccess
format article
id ES_a47e95b261ccb057f58ddc3e0c59da1c
institution Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
language eng
network_acronym_str ES
network_name_str España
oai_identifier_str oai:upcommons.upc.edu:2117/84760
publishDate 2016
publishDateSort 2016
publisher Elsevier
publisherStr Elsevier
reponame_str UPCommons. Portal del coneixement obert de la UPC
spelling Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems Puzyrev, Vladimir Koric, Seid Wilkin, Scott Large scale systems--Data processing Numerical modeling Linear systems Direct solvers Parallel computing Controlled-source electromagnetics Geophysical exploration Electromagnetisme--Mesuraments Àrees temàtiques de la UPC::Enginyeria mecànica::Impacte ambiental High performance computing is absolutely necessary for large-scale geophysical simulations. In order to obtain a realistic image of a geologically complex area, industrial surveys collect vast amounts of data making the computational cost extremely high for the subsequent simulations. A major computational bottleneck of modeling and inversion algorithms is solving the large sparse systems of linear ill-conditioned equations in complex domains with multiple right hand sides. Recently, parallel direct solvers have been successfully applied to multi-source seismic and electromagnetic problems. These methods are robust and exhibit good performance, but often require large amounts of memory and have limited scalability. In this paper, we evaluate modern direct solvers on large-scale modeling examples that previously were considered unachievable with these methods. Performance and scalability tests utilizing up to 65,536 cores on the Blue Waters supercomputer clearly illustrate the robustness, efficiency and competitiveness of direct solvers compared to iterative techniques. Wide use of direct methods utilizing modern parallel architectures will allow modeling tools to accurately support multi-source surveys and 3D data acquisition geometries, thus promoting a more efficient use of the electromagnetic methods in geophysics. The authors would like to thank the MUMPS and PARDISO developers for providing free academic licenses and Dr. Anshul Gupta for access to his solver library which is not publicly available. We also would like to thank the Private Sector Program and the Blue Waters sustained-petascale computing project at the National Center for Supercomputing Applications (NCSA), which is supported by the National Science Foundation (awards OCI- 0725070 and ACI-1238993) and the state of Illinois. The shared-memory tests were performed on the MareNostrum supercomputer of the Barcelona Supercomputer Center. The first author acknowledges funding from the Repsol-BSC Research Center through the AURORA project and support from the RISE Horizon 2020 European Project GEAGAM (644602). The authors wish to thank Jef Caers and two anonymous reviewers for their valuable comments that significantly helped to improve this paper. Peer Reviewed Elsevier https://hdl.handle.net/2117/84760 https://dx.doi.org/10.1016/j.cageo.2016.01.009
spellingShingle Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
Puzyrev, Vladimir
Large scale systems--Data processing
Numerical modeling
Linear systems
Direct solvers
Parallel computing
Controlled-source electromagnetics
Geophysical exploration
Electromagnetisme--Mesuraments
Àrees temàtiques de la UPC::Enginyeria mecànica::Impacte ambiental
title Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
title_full Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
title_fullStr Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
title_full_unstemmed Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
title_short Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
title_sort Evaluation of parallel direct sparse linear solvers in electromagnetic geophysical problems
topic Large scale systems--Data processing
Numerical modeling
Linear systems
Direct solvers
Parallel computing
Controlled-source electromagnetics
Geophysical exploration
Electromagnetisme--Mesuraments
Àrees temàtiques de la UPC::Enginyeria mecànica::Impacte ambiental
topic_facet Large scale systems--Data processing
Numerical modeling
Linear systems
Direct solvers
Parallel computing
Controlled-source electromagnetics
Geophysical exploration
Electromagnetisme--Mesuraments
Àrees temàtiques de la UPC::Enginyeria mecànica::Impacte ambiental
url https://hdl.handle.net/2117/84760
https://dx.doi.org/10.1016/j.cageo.2016.01.009