Superconductivity, Part 12: How Claims Are Verified

There was a clear reason why LK-99 became a global phenomenon in 2023.

A dark LK-99 pellet resting at an angle on top of a round metal magnet, with one edge raised.

LK-99 on a Magnet: Why Independent Measurements Matter
The widely circulated image shows a sample’s magnetic response. Its appearance alone does not establish zero resistance or a Meissner effect.
Hyun-Tak Kim, via Wikimedia Commons; original source: ScienceCast. CC BY 4.0. Displayed at reduced size.


It was presented as a material that could show superconductivity not only at room temperature, but also at ambient pressure. A short video showing a small sample appearing to partially levitate was enough to capture worldwide attention. Researchers and laboratories around the world quickly began trying to reproduce LK-99 for themselves.

As you may have noticed from the name of this blog, lk99.in, LK-99 was also one of the main reasons I became interested in superconductivity in the first place. This article compares two retracted hydride claims with LK-99 and explains the measurements and independent replication needed to assess each case.

2020 — A Claim That Superconductivity Had Finally Reached Room Temperature

In 2020, a remarkable paper was published in Nature. A team led by Ranga Dias reported superconductivity in a carbonaceous sulfur hydride at approximately 287.7 K.[1] That is about 58°F, a temperature we can easily experience in everyday life.

Considering that superconductivity was first discovered in 1911 at about 4 K, the number alone represented an extraordinary leap.

The title of the paper even included the phrase “Room-temperature superconductivity.”

But there was an important condition.

Pressure.

The reported superconducting state required an extreme pressure of approximately 267 GPa.[1] The temperature had reached the room-temperature range, but the pressure was still far removed from ordinary conditions. Nevertheless, 287.7 K attracted enormous attention because it suggested that superconductivity might be possible at temperatures once considered far beyond reach.


Two Years Later, the Paper Was Retracted

Publishing a scientific paper does not automatically establish its conclusions as scientific facts. After a paper appears, other researchers examine its experimental methods and data.

Were the measurements performed correctly?

How were the data processed?

Could the same results be obtained again?

Questions were eventually raised about the treatment of experimental data in the 2020 carbonaceous sulfur hydride paper. The central concern involved the processing of magnetic susceptibility data, which had been presented as important evidence for superconductivity.[2] In September 2022, Nature officially retracted the paper.[2]

According to the retraction notice, some background-subtraction steps used to produce the magnetic susceptibility plots relied on a non-standard, user-defined procedure that had not been adequately explained in the original publication. The journal concluded that these processing issues undermined confidence in the published magnetic susceptibility data. The authors maintained that their original data supported their scientific claims and disagreed with the retraction.

Nevertheless, the paper was officially retracted. The important point is not simply to conclude that the reported room-temperature superconductivity was wrong. Rather, this case demonstrates something fundamental about scientific research.

Even a paper published in one of the world's leading scientific journals can be re-examined and retracted when serious concerns arise about the reliability of its evidence.


2023 — Had Researchers Finally Reduced the Pressure Barrier?

In 2023, another surprising announcement captured scientific attention. Once again, the research involved Ranga Dias and colleagues. The team reported superconductivity in nitrogen-doped lutetium hydride at approximately 294 K, or about 70°F.[3]

But the temperature was not the only remarkable part. Earlier hydrogen-rich superconductors had required pressures exceeding 100 GPa. This new study claimed superconductivity near room temperature at approximately 1 GPa.[3]

That was still far above ordinary atmospheric pressure, but it represented a dramatic reduction compared with earlier high-pressure hydride experiments. If the results had been independently confirmed, the study could have marked an important advance toward more practical high-temperature superconductivity. However, as other researchers began examining the claim, the situation changed.


Could Other Researchers Obtain the Same Result?

When researchers announce a new superconducting material, other laboratories try to synthesize the same material and repeat the measurements.

This process brings us to an essential scientific concept:

Reproducibility.

A remarkable phenomenon should not depend entirely on the laboratory in which it was first observed. Independent researchers working under comparable conditions should also be able to observe the reported behavior. The nitrogen-doped lutetium hydride claim quickly attracted independent investigations.

In one study published in Nature, Xue Ming and colleagues synthesized nitrogen-doped lutetium hydride with structural characteristics similar to those reported in the original research.[4] They investigated its electrical resistance and magnetic properties under different pressures. However, they did not observe superconductivity above 2 K in the pressure range they investigated.

Their findings did not reproduce the near-room-temperature superconductivity reported in the original paper. Separately, concerns continued to emerge about the original study's experimental measurements, materials, and data. On November 7, 2023, Nature retracted the paper.[5]

The official retraction notice described concerns about the provenance of the investigated materials, experimental measurements, data-processing procedures, and the reliability of the electrical resistance data. These concerns were separate from the independent studies that had failed to reproduce the reported superconductivity. The original result had suggested an extraordinary combination of high temperature and much lower pressure.

But the reported superconducting state was not independently established, and the published paper was ultimately retracted because of unresolved concerns about the research record.


And Then, in 2023, LK-99 Appeared

That same year, another major event brought superconductivity into the global spotlight.

It was LK-99.

Researchers in South Korea released preprints claiming that LK-99, a copper-substituted lead-apatite material, could exhibit superconductivity at room temperature and ambient pressure.[6] Compared with the earlier claims, the difference was striking. Carbonaceous sulfur hydride required approximately 267 GPa.

Nitrogen-doped lutetium hydride was reported to require approximately 1 GPa. But LK-99 was claimed to work at ordinary atmospheric pressure.

If that claim were confirmed, it could mean overcoming two of the greatest obstacles in the history of superconductivity:

Temperature and pressure.

The short video showing a small sample apparently partially levitating above a magnet added to the excitement. Interest spread rapidly around the world. Researchers began synthesizing LK-99 samples.

Some measured electrical resistance. Others investigated magnetic properties. Still others used theoretical calculations to examine the material's electronic structure.

Watching research groups around the world investigate the same claim within such a short period was remarkable in itself.


Levitation Alone Does Not Prove Superconductivity

When people think about superconductors, one of the first images that comes to mind is often an object floating above a magnet. That image is closely associated with the Meissner effect and magnetic levitation. But there is an important distinction.

A material responding to a magnet, or appearing to partially levitate above it, is not enough by itself to establish superconductivity. Other magnetic properties can produce similar behavior.

More direct evidence is needed.

Researchers must determine whether electrical resistance truly falls to zero, whether the material exhibits the expected magnetic behavior of a superconducting state, and whether independent laboratories can reproduce those results. This is exactly the kind of scientific verification that followed the release of LK-99.


Independent Experiments Did Not Confirm the Claimed Superconductivity

During 2023, research groups around the world synthesized and tested materials related to LK-99. The independent studies published at the time did not establish reproducible evidence of room-temperature, ambient-pressure superconductivity.[7] Some researchers observed magnetic responses in their samples, but those observations alone were insufficient to demonstrate superconductivity.

Other experiments investigated sharp changes in electrical resistance that initially appeared interesting. One possible explanation involved copper sulfide (Cu₂S), an impurity that could be present in synthesized samples. A study by Shilin Zhu and colleagues, published in Matter, found that a structural phase transition in Cu₂S could produce a sharp resistance change resembling a superconducting transition, without the resistance actually reaching zero.[8]

This offered a possible non-superconducting explanation for some of the unusual behavior observed in LK-99-related samples. Based on the independent investigations available at the time, room-temperature, ambient-pressure superconductivity had not been confirmed in the publicly tested LK-99 samples.

Why Is Reproducibility So Important in Science?

When a discovery as significant as a room-temperature superconductor is announced, excitement is inevitable.

I feel that excitement too.

But our expectations cannot change the standard of scientific evidence. One research group reports a new phenomenon. Another group repeats the experiment.

If the same result does not appear, scientists investigate the possible reasons.

Was the material composition different?

Were the experimental conditions different?

Was there a problem with the measurements?

Or was the original interpretation itself incorrect?

Further investigation may strengthen the original claim. Or it may reveal that another explanation better fits the experimental results. Science advances by repeatedly testing explanations against evidence.

That is why reproducibility is much more than simply asking someone to perform an experiment a second time. It helps determine whether an extraordinary observation represents a genuine physical phenomenon that independent researchers can confirm under comparable conditions.


Does a Retraction Mean the Science Was Meaningless?

When a scientific paper is retracted, it can seem as though the entire research effort has simply disappeared. But after following the history of superconductivity, I have come to see this process differently.

A new claim is published.

Other scientists investigate it.

Questions arise about the data.

The evidence is examined again.

If serious problems are identified, conclusions may be revised or a paper may be retracted. This process is also part of how science works. Identifying and correcting unreliable findings is more important than allowing questionable conclusions to remain unchallenged.

This is especially true for room-temperature superconductivity, where a genuine discovery could have enormous consequences for science and industry. The stronger the implications of a claim, the more important careful verification becomes. And to me, the efforts of researchers who test, question, and improve one another's work are part of the progress of superconductivity itself.


How to Assess a Claim

Read the reported temperature and pressure together. Check electrical and magnetic measurements, data-processing methods, sample composition, and independent replication. A retracted paper and an unconfirmed preprint have different publication histories; neither should be presented as an established discovery.

References

[1] E. Snider et al., “Room-temperature superconductivity in a carbonaceous sulfur hydride,” Nature, 2020, Vol. 586, pp. 373–377. DOI: 10.1038/s41586-020-2801-z. Retracted in 2022.

[2] E. Snider et al., “Retraction Note: Room-temperature superconductivity in a carbonaceous sulfur hydride,” Nature, 2022, Vol. 610, p. 804. DOI: 10.1038/s41586-022-05294-9.

[3] N. Dasenbrock-Gammon et al., “Evidence of near-ambient superconductivity in a N-doped lutetium hydride,” Nature, 2023, Vol. 615, pp. 244–250. DOI: 10.1038/s41586-023-05742-0. Retracted in 2023.

[4] X. Ming et al., “Absence of near-ambient superconductivity in LuH₂±xNy,” Nature, 2023, Vol. 620, pp. 72–77. DOI: 10.1038/s41586-023-06162-w.

[5] Nature, “Retraction Note: Evidence of near-ambient superconductivity in a N-doped lutetium hydride,” 2023. DOI: 10.1038/s41586-023-06774-2.

[6] Sukbae Lee, Ji-Hoon Kim, Young-Wan Kwon, “The First Room-Temperature Ambient-Pressure Superconductor,” arXiv preprint, 2023, arXiv:2307.12008. DOI: 10.48550/arXiv.2307.12008.

[7] Kapil Kumar, Navneet Kumar Karn, Yogesh Kumar, V. P. S. Awana, “Absence of Superconductivity in LK-99 at Ambient Conditions,” ACS Omega, 2023, Vol. 8, pp. 41737–41743. DOI: 10.1021/acsomega.3c06096.

[8] Shilin Zhu, Wei Wu, Zheng Li, Jianlin Luo, “First-order transition in LK-99 containing Cu₂S,” Matter, 2023, Vol. 6, pp. 4401–4407. DOI: 10.1016/j.matt.2023.11.001.

Comments

Popular posts from this blog

LK-99, Part 8: Patents and Applications

Superconductivity, Part 3: How Flux Pinning Works

Superconductivity, Part 1: The 1911 Discovery