Homec4science
Diffusion akantu (bugfixes/64bit-integer-corrections) Browse

rAKA/joss/paper.md
8a2ff789cf15bugfixes/64bit-integer…

Last Change
Raw File

paper.md
View Options

---
title: 'Akantu: an HPC finite-element library for contact and dynamic fracture simulations'
tags:
- C++
- cohesive element
- contact
- fracture
- python
authors:
- name: Nicolas Richart
orcid: 0000-0002-1463-4405
affiliation: 1
- name: Guillaume Anciaux
orcid: 0000-0002-9624-5621
affiliation: 1
- name: Emil Gallyamov
orcid: 0000-0002-2970-0890
affiliation: 1
- name: Lucas Frérot
orcid: 0000-0002-4138-1052
affiliation: "1, 2, 7"
- name: David Kammer
orcid: 0000-0003-3782-9368
affiliation: "1, 3"
- name: Mohit Pundir
orcid: 0000-0001-7244-7416
affiliation: "1, 3"
- name: Marco Vocialta
affiliation: 1
- name: Aurelia Cuba Ramos
affiliation: 1
- name: Mauro Corrado
affiliation: "1, 4"
- name: Philip Müller
affiliation: 3
- name: Fabian Barras
orcid: 0000-0003-1109-0200
affiliation: "1, 5"
- name: Shenghan Zhang
orcid: 0000-0002-4327-9115
affiliation: "1, 6"
- name: Roxane Ferry
orcid: 0000-0003-1881-6596
affiliation: "1"
- name: Shad Durussel
orcid: 0009-0001-6036-168X
affiliation: "1"
- name: Jean-François Molinari
orcid: 0000-0002-1728-1844
affiliation: 1
affiliations:
- name: Civil Engineering Institute, École Polytechnique Fédérale de Lausanne, Switzerland
index: 1
- name: Department of Microsystems Engineering, University of Freiburg, Germany
index: 2
- name: Institute for Building Materials, ETH Zurich, Switzerland
index: 3
- name: Department of Structural, Geotechnical and Building Engineering, Politecnico di Torino, Italy
index: 4
- name: The Njord Centre Department of Physics, Department of Geosciences, University of Oslo, Norway
index: 5
- name: The Hong Kong University of Science and Technology, Department of Civil and Environmental Engineering
index: 6
- name: Institut Jean le Rond d'Alembert, CNRS UMR 7190, Sorbonne Université, France
index: 7
date: February 2023
bibliography: paper.bib
---
# Summary
Complex, nonlinear, and transient phenomena are at the heart of modern research
in mechanics of materials. For example, the buildup and release of elastic
energy at geological fault is what causes earthquakes, and the intricate details
of the slip zone, the propagation of slip fronts and waves radiated through the
various geological media are still active areas of research
[@kammer_propagation_2012;@kammer_existence_2014;@roch_velocity-driven_2022].
Similarly, understanding fracture in heterogeneous materials such as concrete,
masonry or ceramics necessitates the modeling of interaction of crack fronts
with complex materials
[@taheri_mousavi_dynamic_2015;@yilmaz_damage_2017;@cuba_ramos_hpc_2018], the
representation of residual shear stresses in the contact of newly-formed crack
surfaces [@zhang_micro-mechanical_2017;@pundir_coupling_2021], and the accurate
characterization of transient dynamics
[@vocialta_numerical_2018;@corrado_effects_2016] and material structure
evolution [@cuba_ramos_hpc_2018;@gallyamov_multi-scale_2020].
The finite-element method is now ubiquitous in virtually all areas of solid
mechanics. With meticulous care on code architecture and performance, we show
that our finite-element library Akantu can handle the requirements
mentioned above for state-of-the-art research in mechanics of materials. Akantu
is designed from the ground up for high-performance, highly distributed
computations, while retaining the necessary flexibility to handle:
- crack propagation with cohesive elements
- non-local damage models
- plastic and visco-plastic constitutive laws
- large deformations
- contact constraints (including rate and state friction)
- interaction between contact and cohesive elements (residual crack shear
strength)
# Statement of need
Understanding the interplay between material constitutive behavior and interface
processes such as crack propagation, contact and friction is fundamental to a
number of application domains. Thanks to its versatility, the finite-element
method (FEM) has become an essential tool in these areas. However, codes that
can handle cutting edge simulations with interaction of material behavior and
interface processes in a high-performance computing (HPC) setting are rare,
particularity in the open-source space. Being able to simulate the
aforementioned interface processes in an efficient manner is the primary *raison
d'être* of Akantu. Even though Akantu is meant to be a generic FEM library, the
physics currently implemented, all serve the goal to get a better understanding
of fracture, contact and friction mechanism at a continuum scale.
![Dynamic fragmentation of a tempered glass pane using cohesive elements.\label{fig:cohesive_insertion}](results/cohesive_insertion.png){width=60%}
At its heart, Akantu leverages a SOA (structure of array) architecture in order
to take advantage of an object-oriented high-level abstraction, and maintains
performance in the critical areas of the code. In addition, Akantu benefits from
distributed memory parallelization using state-of-the-art domain decomposition
methods. A distinguishing feature is its communication strategy, which relies on
a layer of ghost elements instead of the more conventional ghost nodes. This
choice simplifies the implementation of algorithms involving topological changes
of the meshes in parallel, such as the dynamic insertion of cohesive elements.
\autoref{fig:cohesive_insertion} taken from @vocialta_numerical_2018
illustrates the usage of cohesive elements to simulate the dynamic fragmentation
of tempered glass panes.
Akantu differs from other existing codes in its ability to combine fracture
dynamics and contact mechanics by introducing new free surfaces through cohesive
elements insertion strategy. Other open-source parallel finite-element codes are
capable of performing fracture and/or contact mechanics simulations: among
others, the most well-known that can be cited are deal.II [@arndt_dealii_2023],
FEniCS [@baratta_dolfinx_2023], GetFEM [@renard_getfem_2021], MFEM
[@anderson_mfem_2021], MoFEM [@kaczmarczyk_mofem_2020], Moose
[@alexander_moose_2022], OOFEM [@patzak_oofem_2012]. These codes can do fracture
mechanics through continuum damage modeling, phase-field and in some cases,
X-FEM. Some of them implement traction-separation laws (cohesive elements) by
means of a discontinuous Galerkin formulation. Only a subset of these codes is
capable of performing contact mechanics computations. If we consider the dynamic
insertion of cohesive elements, which avoids the burden of having interface
elements pre-inserted everywhere and allows representing explicitly the newly
formed cracked surfaces, there is only one other code capable of doing such
simulations in parallel [@espinha_scalable_2013], to our best knowledge. However
this package is not distributed as open-source software.
# Scaling analysis
High performance and scalability is a necessity for the resolution of fracture
and contact simulations. To illustrate the possibilities offered by Akantu, a 3D
simulation is presented where a cube composed of 4'392'180 tetrahedra and
734'594 nodes is being compressed and sheared (cf \autoref{fig:setup}). This
simulation only serves to demonstrate how Akantu behaves in a situation where
massive fragmentation takes place: about 460'000 cohesive elements are inserted
during the run. The code, material and mesh files to reproduce the study can be
found on Zenodo [@richart_zenodo_2024].This simulation was run on 1 to 720
cores, on a cluster composed of Intel Xeon nodes with two sockets of 36 cores,
512Gb of RAM and dual 25Gb Ethernet links. The time to solution (TTS) averaged
over six different runs is computed for each core count on the $x$-axis in
\autoref{fig:tts}. The overhead due to cohesive element insertion is also
highlighted by providing the TTS when cohesive element insertions are precluded.
![Numerical setup.\label{fig:setup}](results/cube.svg)
When cohesive element insertion is not active, (cf. \autoref{fig:tts} 'no
insertion'), the time to solution scales well up to ~576 cores. The simulations
are running on a newly installed machine and the impact of the network on the
loss of scalability is not fully understood, the min and max measures vary a lot
after 288 cores (four nodes). The scalability with insertion of cohesive elements
(\autoref{fig:tts} 'insertion') decreases, and starts to plateau at around 288
cores: this is due to the extra communications needed to change the topology of
the mesh.
![Time to solution with and without cohesive insertion.\label{fig:tts}](results/TTS.svg)
# Publications
The following publications have been made possible with Akantu:
@kammer_propagation_2012, @kammer_existence_2014, @wolff_non-local_2014,
@richart_implementation_2015, @taheri_mousavi_dynamic_2015,
@cuba_ramos_new_2015, @radiguet_role_2015, @vocialta_influence_2015,
@corrado_effects_2016, @kammer_length_2016, @svetlizky_properties_2016,
@vocialta_3d_2016, @yilmaz_mesoscale_2017, @yilmaz_damage_2017,
@zhang_micro-mechanical_2017, @cuba_ramos_hpc_2018, @vocialta_numerical_2018,
@yilmaz_influence_2018, @zhang_numerical_2018, @zhang_numerical_2019,
@frerot_fourier_2019, @gallyamov_multi-scale_2020, @milanese_mechanistic_2020,
@albertini_three-dimensional_2021, @brun_hybrid_2021,
@rezakhani_meso-scale_2021, @pundir_coupling_2021, @roch_velocity-driven_2022,
@gallyamov_predicting_2022, @gallyamov_study_2022, and @gallyamov_long-term_2023.
# Acknowledgement
The development of Akantu would not have been possible without the support of
the European Research Council ERCstg UFO-240332, the Swiss Federal Office of
Energy contract No. SI/500852-01, Swiss National Science Foundation grants numbers
CRSII5_17108 and 200021_162569.
# References
c4science · Help