Reproducibility in density functional theory calculations of solids

Kurt Lejaeghere, Gustav Bihlmayer, Torbjörn Björkman, Peter Blaha, Stefan Blügel, Volker Blum, Damien Caliste, Ivano Eligio Castelli, Stewart J. Clark, Andrea Dal Corso, Stefano de Gironcoli, Thierry Deutsch, John Kay Dewhurst, Igor Di Marco, Claudia Draxl, Marcin Dulak, Olle Eriksson, José A. Flores-Livas, Kevin F. Garrity, Luigi Genovese & 49 others Paolo Giannozzi, Matteo Giantomassi, Stefan Goedecker, Xavier Gonze, Oscar Grånäs, E. K. U. Gross, Andris Gulans, François Gygi, D. R. Hamann, Phil J. Hasnip, N. A. W. Holzwarth, Diana Iuşan, Dominik B. Jochym, François Jollet, Daniel Jones, Georg Kresse, Klaus Koepernik, Emine Küçükbenli, Yaroslav O. Kvashnin, Inka L. M. Locht, Sven Lubeck, Martijn Marsman, Nicola Marzari, Ulrike Nitzsche, Lars Nordström, Taisuke Ozaki, Lorenzo Paulatto, Chris J. Pickard, Ward Poelmans, Matt I. J. Probert, Keith Refson, Manuel Richter, Gian-Marco Rignanese, Santanu Saha, Matthias Scheffler, Martin Schlipf, Karlheinz Schwarz, Sangeeta Sharma, Francesca Tavazza, Patrik Thunström, Alexandre Tkatchenko, Marc Torrent, David Vanderbilt, Michiel J. van Setten, Veronique Van Speybroeck, John M. Wills, Jonathan R. Yates, Guo-Xu Zhang, Stefaan Cottenier

Research output: Contribution to journalJournal articleResearchpeer-review

193 Downloads (Pure)

Abstract

The widespread popularity of density functional theory has given rise to an extensive range of dedicated codes for predicting molecular and crystalline properties. However, each code implements the formalism in a different way, raising questions about the reproducibility of such predictions. We report the results of a community-wide effort that compared 15 solid-state codes, using 40 different potentials or basis set types, to assess the quality of the Perdew-Burke-Ernzerhof equations of state for 71 elemental crystals. We conclude that predictions from recent codes and pseudopotentials agree very well, with pairwise differences that are comparable to those between different high-precision experiments. Older methods, however, have less precise agreement. Our benchmark provides a framework for users and developers to document the precision of new applications and methodological improvements.
Original languageEnglish
JournalScience (New York, N.Y.)
Volume351
Issue number6280
Pages (from-to)aad3000
ISSN0036-8075
DOIs
Publication statusPublished - 2016

Cite this

Lejaeghere, K., Bihlmayer, G., Björkman, T., Blaha, P., Blügel, S., Blum, V., ... Cottenier, S. (2016). Reproducibility in density functional theory calculations of solids. Science (New York, N.Y.), 351(6280), aad3000. https://doi.org/10.1126/science.aad3000
Lejaeghere, Kurt ; Bihlmayer, Gustav ; Björkman, Torbjörn ; Blaha, Peter ; Blügel, Stefan ; Blum, Volker ; Caliste, Damien ; Castelli, Ivano Eligio ; Clark, Stewart J. ; Dal Corso, Andrea ; de Gironcoli, Stefano ; Deutsch, Thierry ; Dewhurst, John Kay ; Di Marco, Igor ; Draxl, Claudia ; Dulak, Marcin ; Eriksson, Olle ; Flores-Livas, José A. ; Garrity, Kevin F. ; Genovese, Luigi ; Giannozzi, Paolo ; Giantomassi, Matteo ; Goedecker, Stefan ; Gonze, Xavier ; Grånäs, Oscar ; Gross, E. K. U. ; Gulans, Andris ; Gygi, François ; Hamann, D. R. ; Hasnip, Phil J. ; Holzwarth, N. A. W. ; Iuşan, Diana ; Jochym, Dominik B. ; Jollet, François ; Jones, Daniel ; Kresse, Georg ; Koepernik, Klaus ; Küçükbenli, Emine ; Kvashnin, Yaroslav O. ; Locht, Inka L. M. ; Lubeck, Sven ; Marsman, Martijn ; Marzari, Nicola ; Nitzsche, Ulrike ; Nordström, Lars ; Ozaki, Taisuke ; Paulatto, Lorenzo ; Pickard, Chris J. ; Poelmans, Ward ; Probert, Matt I. J. ; Refson, Keith ; Richter, Manuel ; Rignanese, Gian-Marco ; Saha, Santanu ; Scheffler, Matthias ; Schlipf, Martin ; Schwarz, Karlheinz ; Sharma, Sangeeta ; Tavazza, Francesca ; Thunström, Patrik ; Tkatchenko, Alexandre ; Torrent, Marc ; Vanderbilt, David ; van Setten, Michiel J. ; Van Speybroeck, Veronique ; Wills, John M. ; Yates, Jonathan R. ; Zhang, Guo-Xu ; Cottenier, Stefaan. / Reproducibility in density functional theory calculations of solids. In: Science (New York, N.Y.). 2016 ; Vol. 351, No. 6280. pp. aad3000.
@article{c2499ad74b514275a0e5a42366adec90,
title = "Reproducibility in density functional theory calculations of solids",
abstract = "The widespread popularity of density functional theory has given rise to an extensive range of dedicated codes for predicting molecular and crystalline properties. However, each code implements the formalism in a different way, raising questions about the reproducibility of such predictions. We report the results of a community-wide effort that compared 15 solid-state codes, using 40 different potentials or basis set types, to assess the quality of the Perdew-Burke-Ernzerhof equations of state for 71 elemental crystals. We conclude that predictions from recent codes and pseudopotentials agree very well, with pairwise differences that are comparable to those between different high-precision experiments. Older methods, however, have less precise agreement. Our benchmark provides a framework for users and developers to document the precision of new applications and methodological improvements.",
author = "Kurt Lejaeghere and Gustav Bihlmayer and Torbj{\"o}rn Bj{\"o}rkman and Peter Blaha and Stefan Bl{\"u}gel and Volker Blum and Damien Caliste and Castelli, {Ivano Eligio} and Clark, {Stewart J.} and {Dal Corso}, Andrea and {de Gironcoli}, Stefano and Thierry Deutsch and Dewhurst, {John Kay} and {Di Marco}, Igor and Claudia Draxl and Marcin Dulak and Olle Eriksson and Flores-Livas, {Jos{\'e} A.} and Garrity, {Kevin F.} and Luigi Genovese and Paolo Giannozzi and Matteo Giantomassi and Stefan Goedecker and Xavier Gonze and Oscar Gr{\aa}n{\"a}s and Gross, {E. K. U.} and Andris Gulans and Fran{\cc}ois Gygi and Hamann, {D. R.} and Hasnip, {Phil J.} and Holzwarth, {N. A. W.} and Diana Iuşan and Jochym, {Dominik B.} and Fran{\cc}ois Jollet and Daniel Jones and Georg Kresse and Klaus Koepernik and Emine K{\"u}{\cc}{\"u}kbenli and Kvashnin, {Yaroslav O.} and Locht, {Inka L. M.} and Sven Lubeck and Martijn Marsman and Nicola Marzari and Ulrike Nitzsche and Lars Nordstr{\"o}m and Taisuke Ozaki and Lorenzo Paulatto and Pickard, {Chris J.} and Ward Poelmans and Probert, {Matt I. J.} and Keith Refson and Manuel Richter and Gian-Marco Rignanese and Santanu Saha and Matthias Scheffler and Martin Schlipf and Karlheinz Schwarz and Sangeeta Sharma and Francesca Tavazza and Patrik Thunstr{\"o}m and Alexandre Tkatchenko and Marc Torrent and David Vanderbilt and {van Setten}, {Michiel J.} and {Van Speybroeck}, Veronique and Wills, {John M.} and Yates, {Jonathan R.} and Guo-Xu Zhang and Stefaan Cottenier",
year = "2016",
doi = "10.1126/science.aad3000",
language = "English",
volume = "351",
pages = "aad3000",
journal = "Science",
issn = "0036-8075",
publisher = "American Association for the Advancement of Science",
number = "6280",

}

Lejaeghere, K, Bihlmayer, G, Björkman, T, Blaha, P, Blügel, S, Blum, V, Caliste, D, Castelli, IE, Clark, SJ, Dal Corso, A, de Gironcoli, S, Deutsch, T, Dewhurst, JK, Di Marco, I, Draxl, C, Dulak, M, Eriksson, O, Flores-Livas, JA, Garrity, KF, Genovese, L, Giannozzi, P, Giantomassi, M, Goedecker, S, Gonze, X, Grånäs, O, Gross, EKU, Gulans, A, Gygi, F, Hamann, DR, Hasnip, PJ, Holzwarth, NAW, Iuşan, D, Jochym, DB, Jollet, F, Jones, D, Kresse, G, Koepernik, K, Küçükbenli, E, Kvashnin, YO, Locht, ILM, Lubeck, S, Marsman, M, Marzari, N, Nitzsche, U, Nordström, L, Ozaki, T, Paulatto, L, Pickard, CJ, Poelmans, W, Probert, MIJ, Refson, K, Richter, M, Rignanese, G-M, Saha, S, Scheffler, M, Schlipf, M, Schwarz, K, Sharma, S, Tavazza, F, Thunström, P, Tkatchenko, A, Torrent, M, Vanderbilt, D, van Setten, MJ, Van Speybroeck, V, Wills, JM, Yates, JR, Zhang, G-X & Cottenier, S 2016, 'Reproducibility in density functional theory calculations of solids', Science (New York, N.Y.), vol. 351, no. 6280, pp. aad3000. https://doi.org/10.1126/science.aad3000

Reproducibility in density functional theory calculations of solids. / Lejaeghere, Kurt; Bihlmayer, Gustav; Björkman, Torbjörn; Blaha, Peter; Blügel, Stefan; Blum, Volker; Caliste, Damien; Castelli, Ivano Eligio; Clark, Stewart J.; Dal Corso, Andrea; de Gironcoli, Stefano; Deutsch, Thierry; Dewhurst, John Kay; Di Marco, Igor; Draxl, Claudia; Dulak, Marcin; Eriksson, Olle; Flores-Livas, José A.; Garrity, Kevin F.; Genovese, Luigi; Giannozzi, Paolo; Giantomassi, Matteo; Goedecker, Stefan; Gonze, Xavier; Grånäs, Oscar; Gross, E. K. U.; Gulans, Andris; Gygi, François; Hamann, D. R.; Hasnip, Phil J.; Holzwarth, N. A. W.; Iuşan, Diana; Jochym, Dominik B.; Jollet, François; Jones, Daniel; Kresse, Georg; Koepernik, Klaus; Küçükbenli, Emine; Kvashnin, Yaroslav O.; Locht, Inka L. M.; Lubeck, Sven; Marsman, Martijn; Marzari, Nicola; Nitzsche, Ulrike; Nordström, Lars; Ozaki, Taisuke; Paulatto, Lorenzo; Pickard, Chris J.; Poelmans, Ward; Probert, Matt I. J.; Refson, Keith; Richter, Manuel; Rignanese, Gian-Marco; Saha, Santanu; Scheffler, Matthias; Schlipf, Martin; Schwarz, Karlheinz; Sharma, Sangeeta; Tavazza, Francesca; Thunström, Patrik; Tkatchenko, Alexandre; Torrent, Marc; Vanderbilt, David; van Setten, Michiel J.; Van Speybroeck, Veronique; Wills, John M.; Yates, Jonathan R.; Zhang, Guo-Xu; Cottenier, Stefaan.

In: Science (New York, N.Y.), Vol. 351, No. 6280, 2016, p. aad3000.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Reproducibility in density functional theory calculations of solids

AU - Lejaeghere, Kurt

AU - Bihlmayer, Gustav

AU - Björkman, Torbjörn

AU - Blaha, Peter

AU - Blügel, Stefan

AU - Blum, Volker

AU - Caliste, Damien

AU - Castelli, Ivano Eligio

AU - Clark, Stewart J.

AU - Dal Corso, Andrea

AU - de Gironcoli, Stefano

AU - Deutsch, Thierry

AU - Dewhurst, John Kay

AU - Di Marco, Igor

AU - Draxl, Claudia

AU - Dulak, Marcin

AU - Eriksson, Olle

AU - Flores-Livas, José A.

AU - Garrity, Kevin F.

AU - Genovese, Luigi

AU - Giannozzi, Paolo

AU - Giantomassi, Matteo

AU - Goedecker, Stefan

AU - Gonze, Xavier

AU - Grånäs, Oscar

AU - Gross, E. K. U.

AU - Gulans, Andris

AU - Gygi, François

AU - Hamann, D. R.

AU - Hasnip, Phil J.

AU - Holzwarth, N. A. W.

AU - Iuşan, Diana

AU - Jochym, Dominik B.

AU - Jollet, François

AU - Jones, Daniel

AU - Kresse, Georg

AU - Koepernik, Klaus

AU - Küçükbenli, Emine

AU - Kvashnin, Yaroslav O.

AU - Locht, Inka L. M.

AU - Lubeck, Sven

AU - Marsman, Martijn

AU - Marzari, Nicola

AU - Nitzsche, Ulrike

AU - Nordström, Lars

AU - Ozaki, Taisuke

AU - Paulatto, Lorenzo

AU - Pickard, Chris J.

AU - Poelmans, Ward

AU - Probert, Matt I. J.

AU - Refson, Keith

AU - Richter, Manuel

AU - Rignanese, Gian-Marco

AU - Saha, Santanu

AU - Scheffler, Matthias

AU - Schlipf, Martin

AU - Schwarz, Karlheinz

AU - Sharma, Sangeeta

AU - Tavazza, Francesca

AU - Thunström, Patrik

AU - Tkatchenko, Alexandre

AU - Torrent, Marc

AU - Vanderbilt, David

AU - van Setten, Michiel J.

AU - Van Speybroeck, Veronique

AU - Wills, John M.

AU - Yates, Jonathan R.

AU - Zhang, Guo-Xu

AU - Cottenier, Stefaan

PY - 2016

Y1 - 2016

N2 - The widespread popularity of density functional theory has given rise to an extensive range of dedicated codes for predicting molecular and crystalline properties. However, each code implements the formalism in a different way, raising questions about the reproducibility of such predictions. We report the results of a community-wide effort that compared 15 solid-state codes, using 40 different potentials or basis set types, to assess the quality of the Perdew-Burke-Ernzerhof equations of state for 71 elemental crystals. We conclude that predictions from recent codes and pseudopotentials agree very well, with pairwise differences that are comparable to those between different high-precision experiments. Older methods, however, have less precise agreement. Our benchmark provides a framework for users and developers to document the precision of new applications and methodological improvements.

AB - The widespread popularity of density functional theory has given rise to an extensive range of dedicated codes for predicting molecular and crystalline properties. However, each code implements the formalism in a different way, raising questions about the reproducibility of such predictions. We report the results of a community-wide effort that compared 15 solid-state codes, using 40 different potentials or basis set types, to assess the quality of the Perdew-Burke-Ernzerhof equations of state for 71 elemental crystals. We conclude that predictions from recent codes and pseudopotentials agree very well, with pairwise differences that are comparable to those between different high-precision experiments. Older methods, however, have less precise agreement. Our benchmark provides a framework for users and developers to document the precision of new applications and methodological improvements.

U2 - 10.1126/science.aad3000

DO - 10.1126/science.aad3000

M3 - Journal article

VL - 351

SP - aad3000

JO - Science

JF - Science

SN - 0036-8075

IS - 6280

ER -

Lejaeghere K, Bihlmayer G, Björkman T, Blaha P, Blügel S, Blum V et al. Reproducibility in density functional theory calculations of solids. Science (New York, N.Y.). 2016;351(6280):aad3000. https://doi.org/10.1126/science.aad3000