Extreme-Horizon: Understanding the “Dark” Universe and Primordial Galaxy Formation

RAMSES Simulation Code

The RAMSES simulation code is a numerical code for astrophysics and cosmology. It is based on an adaptive mesh refinement computing technique. The figure illustrates the adaptive mesh configuration based on the density of matter. Credit: CAE

The Extreme-Horizon collaboration run by teams at the CEA, CNRS, Sorbonne Université and Université Paris-Saclay has produced a completely new simulation of the evolution of cosmic structures – galaxies, stars and supermassive black holes – which begins a few moments after the Big Bang and continues to the present day. It describes the intergalactic regions, which represent 90% of the Universe’s volume, in unprecedented resolution. The simulation, which leads to two surprising results at the galactic and cosmological scales, constitutes one of the main ‘grand challenges’ carried out on GENCI’s Joliot-Curie supercomputer, at the CEA’s Very Large Computing Centre (TGCC). The results were published on November 4, 2020, in MNRAS and A&A Letters.

Visible matter constitutes only 16% of the Universe’s total mass. Little is known about the nature of the rest of that mass, which referred to as dark matter. Even more surprising is the fact that the Universe’s total mass accounts for only 30% of its energy. The rest is dark energy, which is totally unknown but is responsible for the Universe’s accelerated expansion.

Extreme Horizon Simulation

Figure 1. View of the Extreme-Horizon simulation. The red is hot gas, generally expelled from galaxies by supermassive black holes. The grey is primordial cold gas, which feeds the galaxies along the cosmic filaments. The green is gas enriched with heavy elements (metals) due to the effect of massive star explosions (supernovae). Credit: CAE

To find out more about dark matter and dark energy, astrophysicists use large-scale surveys of the Universe or detailed studies of the properties of galaxies. But they can only interpret their observations by comparing them to predictions by theoretical models of dark matter and dark energy. But these simulations take tens of millions of computing hours on supercomputers.

The Extreme-Horizon collaboration was able to run a simulation of the evolution of cosmic structures from the first few moments after the Big Bang to the present day, on the Joliot-Curie supercomputer, which offers computing power of 22 petaflops (22 x 1015 floating point operations per second). The volume of numerical data processed exceeded 3 TB (1012 bytes) at each step of the computation, justifying the use of new techniques for writing (RAMSES code with adaptive mesh refinement) and reading the simulation data.

Cosmology: correcting the data from the Lyman-α forest

The simulation’s first result concerns the interpretation of large structures of the distant Universe: intergalactic hydrogen clouds. Astrophysicists detect these by measuring the absorption of light from quasars, which are extremely luminous due to the presence of a supermassive black hole that attracts matter in its accretion disk. Each of the clouds along the line of sight produces an ‘absorption line’ (Lyman-α) with a specific redshift, due to the expansion of the Universe. All these lines form a dense ‘forest’, revealing the one-dimensional distribution of the hydrogen clouds, and therefore of matter, at distances between 10 and 12 billion light-years (ly).

Extreme Horizon Simulation View

Figure 2. View of the Extreme-Horizon simulation showing a region of 50 Mpc square. The gas temperature is shown here (violet ~10^4K – yellow ~10^7K). The main galaxies appear as cold spots within vast haloes of hot gas. Credit: CAE

However, many black holes between these quasars and us expel a considerable amount of energy into the intergalactic medium, changing its thermal state and the properties of the Lyman-α forest. The physical model used in the Extreme-Horizon simulation describes in detail this feedback, which biases estimates of cosmological parameters by several percent. The correction factor calculated will be vital, particularly for the DESI (Dark Energy Spectroscopic Instrument) experiment under construction in Arizona (USA), because the bias can exceed 5%, whereas the target accuracy is 1%.

Ultra-compact massive galaxies formed like a ‘beehive’

The Extreme-Horizon simulation’s high resolution in low density regions meant that it was able to describe ‘cold’ gas accretion by galaxies and the formation of ultra-compact massive galaxies when the Universe was only 2 to 3 billion years old. These atypical galaxies, recently observed with the Alma (Atacama Large Millimeter/Submillimeter Array) radio telescope in Chile, are formed by the rapid clustering of many very small galaxies. It was only possible to identify this ‘beehive’ method of growth because of Extreme-Horizon’s exceptional resolution.

Mass to Size Ratio of Galaxies

Figure 3. Mass-to-size ratio of the galaxies in the Extreme-Horizon simulation (blue) compared to the ratio for the same region of the Universe re-simulated at the normal resolution of cosmological simulations (red). Extreme-Horizon reproduces the mass-to-size ratio of the galaxies observed (black curve) and explains the presence of ultra-compact galaxies (under the dashed curve) observed in the primordial Universe, through improved resolution in the diffuse medium that feeds galaxy formation. Credit: CAE

Grand challenge on the Joliot-Curie supercomputer

Designed by the company Atos for GENCI (the French high-performance computing center), the Joliot-Curie supercomputer, based on Atos’s BullSequana architecture, reached a peak computing power of 22 petaflops in 2020.

Grand challenges are exceptional simulations and computations carried out during the ‘Grand Challenge’ period which follows the installation of a new computer partition. This three-month period provides a unique opportunity for a small number of users to access a large share of the machine’s resources. They benefit from the support of the TGCC’s and the manufacturer’s teams, working together to optimize the computer’s operation during this ‘startup’ phase.

Extreme-Horizon was run on the new AMD ROME computation partition of GENCI’s Joliot-Curie supercomputer, operated by teams of computer scientists from the CEA’s Military Applications Division (DAM) at the Very Large Computing Centre (TGCC at Bruyères-Le-Châtel). The simulation took fifty million computing hours and used new data reading and writing techniques to reduce the disk space used and accelerate data access. The work was done with the support of several institutes and divisions within the CEA and of Université Paris-Saclay’s High-Performance Computing and Simulation Laboratory


“Formation of compact galaxies in the Extreme-Horizon simulation” by S. Chabanier, F. Bournaud, Y. Dubois, S. Codis, D. Chapon, D. Elbaz, C. Pichon, O. Bressand, J. Devriendt, R. Gavazzi, K. Kraljic, T. Kimm10, C. Laigle, J.-B. Lekien, G. Martin, N. Palanque-Delabrouille, S. Peirani, P.-F. Piserchia, A. Slyz, M. Trebitsch and C. Yèche, 4 November 2020, Astronomy & Astrophysics.
DOI: 10.1051/0004-6361/202038614

“The impact of AGN feedback on the 1D power spectra from the Ly α forest using the Horizon-AGN suite of simulations” by Solène Chabanier, Frédéric Bournaud, Yohan Dubois, Nathalie Palanque-Delabrouille, Christophe Yèche, Eric Armengaud, Sébastien Peirani and Ricarda Beckmann, 7 May 2020, Monthly Notices of the Royal Astronomical Society.
DOI: 10.1093/mnras/staa1242

The project was run as a collaboration between CEA-Irfu, AIM (CEA, CNRS, Université de Paris), IAP (CNRS, Sorbonne Université) and LIHPC (Université Paris-Saclay, CEA-DAM).

3 Comments on "Extreme-Horizon: Understanding the “Dark” Universe and Primordial Galaxy Formation"

  1. Torbjörn Larsson | November 27, 2020 at 1:15 pm | Reply

    Good choice of illustrations.

    I may have seen the raw filament gas – supermassive black hole heated gas – supernova enriched gas results before, but never on such an impressive scale. It’s like a Yule tree
    [or is it Joule tree, considering the heated gas?]!

  2. MUSTI#@+905511321427 | November 27, 2020 at 6:00 pm | Reply

    I will explain in english for everyone
    Its unknown but its present
    The journey
    Youre journey
    After leaving this earth (i will not explain the dimension not to be missunderstood or anything which lead to a comparison of racism i am against discrimination and racism especially boarders; i want to visit anyplace on earth without restrictions)
    Where you arrive
    Therfor these undescribeable phenomens its for sure that science is always trying to understand and refollow
    If its getting evident then you probably call us back and that means
    Back to life
    In a new outfit
    God bless US for playing same roles.

    Hope to be hisown

    • Torbjörn Larsson | November 28, 2020 at 3:14 pm | Reply


      Also, you make a cultural reference to a superstition of your choice – that is certainly not relevant for any others.

Leave a comment

Email address is optional. If provided, your email will not be published or shared.