Reproducibility in Cancer Biology: Rethinking research into metastasis

The partial success of an attempt to repeat findings in cancer biology highlights the need to improve study designs for preclinical research into metastasis and the targeting of cancer cells.
  1. Peter Friedl  Is a corresponding author
  1. Radboud University Medical Centre, Netherlands
  2. University of Texas MD Anderson Cancer Center, United States

Cancer metastasis results from the escape of cancer cells from the primary tumor, followed by circulation in the blood or lymph system, and then seeding in distant organs. In 2011 researchers at the CNIC in Madrid and other institutions in Spain and the United States reported the results of in vitro experiments and experiments in mice that highlighted how the mechanical properties of the stromal cells around a tumor can influence cancer progression and metastasis (Goetz et al., 2011). In particular they reported that the expression of an intracellular protein called caveolin-1 in tumor-associated fibroblasts resulted in remodeling of the stroma in breast cancer xenografts, which led to increased metastasis.

In 2015, as part of the Reproducibility Project: Cancer Biology, Fiering et al. published a Registered Report which explained in detail how they would seek to replicate some of these experiments (Fiering et al., 2015). The results of these experiment have now been published as a Replication Study (Sheen et al., 2019). Sheen et al. confirmed that fibroblasts expressing caveolin-1 display increased extracellular matrix (ECM) remodeling in vitro, and a higher capacity for intra-tumoral stroma remodeling in vivo. Moreover, by co-implanting caveolin-1-expressing or caveolin-1-deficient fibroblasts with breast cancer cells in nude mice, they confirmed that the expression of caveolin-1 does not affect the tumor growth at the implantation site. However, in contrast to the original study, metastasis formation was not enhanced by caveolin-1 expression, though it should be noted that there were important differences between the original work and the replication. This means that we cannot draw about conclusions about the reproducibility or otherwise of the original findings about metastasis. It is worth looking at these differences to see what we can learn for future studies.

Experiments with mice and other animals are stopped at a 'humane endpoint' to prevent unnecessary suffering. The original experiments to monitor metastasis were stopped 75 days after the breast cancer cells had been implanted in the mice. However, the tumors grew much faster in the replication, which meant that the humane endpoint was reached after just 45 days. Tumor growth and metastasis are both nonlinear processes, with long periods of relatively slow growth being followed by periods of rapid growth. It is possible, therefore, that the low levels of metastasis seen in the replication are due to the duration of the experiments being significantly shorter than the original experiments.

So what lessons might we take away from this Replication Study? First, the differences between the two studies with respect to the link between ECM remodeling in the primary tumor site and metastasis might indicate that factors other than ECM alignment have an influence on the outcome. In particular, the orientation of the ECM relative to the tumor may be important: it is known that the invasion of neighboring tissue by cancer cells, metastasis and poor prognosis are all supported when the ECM is perpendicular to the tumor surface, whereas a capsule-like orientation of the ECM parallel to the tumor surface can limit tumor cell evasion (Figure 1A; Conklin et al., 2011; Park et al., 2019).

Studying tumor invasion and metastasis.

(A) The orientation of the extracellular matrix (ECM) and fibroblasts in the vicinity of a tumor (pale blue) has an influence on the development of the tumor. A capsule-like orientation will limit the escape of cancer cells from the tumor (1), whereas a perpendicular orientation will encourage escape and the invasion of nearby tissue (2). The orientation of the ECM and the fibroblasts can be quantified by image processing. (B) Experiments in which cancer cells are implanted into an animal have to be stopped when the primary tumor reaches a certain size to prevent unnecessary suffering (1). This can limit the data that can be collected on other aspects of cancer, such as metastasis. An alternative approach is to monitor each animal individually and to resection a tumor when it reaches a certain size (2): this allows for longer studies, including the collection of Kaplan-Meier survival curves similar to those collected during clinical trials.

Second, it is possible to design experiments where faster-than-expected growth of the primary tumor does not limit our ability to study metastasis. This can be done by monitoring each mouse individually and resecting the primary tumor during exponential growth, before the humane endpoint is reached, while also continuing to measure metastasis and other outcomes (Figure 1B). Preclinical studies using this refined procedure have allowed researchers to measure the response of primary tumors to experimental molecular-targeted therapy and to monitor whether metastasis is affected or not for endpoints after 100 days and later (Gómez-Cuadrado et al., 2017; Miller et al., 2019). It should be noted that resection might not be required if the experimental treatment causes reliable regression of the primary tumor: the present author and co-workers recently used this approach to monitor incidence of metastasis and overall survival in tumor-bearing mice over a period of 180 days (Haeger et al., 2020).

Third, multiple experimental details that are difficult to control may affect tumor growth and metastasis. For example, tumor cells may change their growth characteristics, and grow more or less efficiently, as a result of continued culture. Other factors that influence tumor growth rates in mouse experiments include: the use of fetal calf serum to cultivate cells before implantation (van der Valk et al., 2018); the conditions under which the mice are housed (Kilkenny et al., 2010); and variation in the microbiomes of the mice (Sethi et al., 2018). It is vital, therefore, that the Methods sections of papers fully describe how the mice used in experiments were housed (including information about diet, environmental enrichment and housing temperature; see Kilkenny et al., 2010 for a full list). And in the future, molecular fingerprinting of the microbiome of animals might also be required.

In conclusion, we do not know for sure in which tumors and to what extent the expression of caveolin-1 and the subsequent remodeling of the ECM in the tumor stroma has an influence on metastasis. However, the efforts to replicate previous work in this field provide an opportunity for self-reflection, and make clear that there are strong reasons to refine workflows in preclinical metastasis research and to improve the way we carry out research into anti-cancer pathways and drug discovery.

Note

Peter Friedl was a peer reviewer for Registered Report (Fiering et al., 2015) and the Replication Study (Sheen et al., 2019).

References

Article and author information

Author details

  1. Peter Friedl

    Peter Friedl is in the Department of Cell Biology, Radboud Institute for Molecular Life Sciences, Radboud University Medical Centre, Nijmegen, Netherlands, the Cancer Genomics Center, Utrecht, Netherlands, and the Department of Genitourinary Medicine, University of Texas MD Anderson Cancer Center, Houston, United States

    For correspondence
    peter.friedl@radboudumc.nl
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0119-4041

Publication history

  1. Version of Record published:

Copyright

© 2019, Friedl

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,064
    views
  • 188
    downloads
  • 7
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Peter Friedl
(2019)
Reproducibility in Cancer Biology: Rethinking research into metastasis
eLife 8:e53511.
https://doi.org/10.7554/eLife.53511

Further reading

    1. Cancer Biology
    2. Evolutionary Biology
    Arman Angaji, Michel Owusu ... Johannes Berg
    Research Article

    In growing cell populations such as tumours, mutations can serve as markers that allow tracking the past evolution from current samples. The genomic analyses of bulk samples and samples from multiple regions have shed light on the evolutionary forces acting on tumours. However, little is known empirically on the spatio-temporal dynamics of tumour evolution. Here, we leverage published data from resected hepatocellular carcinomas, each with several hundred samples taken in two and three dimensions. Using spatial metrics of evolution, we find that tumour cells grow predominantly uniformly within the tumour volume instead of at the surface. We determine how mutations and cells are dispersed throughout the tumour and how cell death contributes to the overall tumour growth. Our methods shed light on the early evolution of tumours in vivo and can be applied to high-resolution data in the emerging field of spatial biology.

    1. Cancer Biology
    2. Evolutionary Biology
    Susanne Tilk, Judith Frydman ... Dmitri A Petrov
    Research Article

    In asexual populations that don’t undergo recombination, such as cancer, deleterious mutations are expected to accrue readily due to genome-wide linkage between mutations. Despite this mutational load of often thousands of deleterious mutations, many tumors thrive. How tumors survive the damaging consequences of this mutational load is not well understood. Here, we investigate the functional consequences of mutational load in 10,295 human tumors by quantifying their phenotypic response through changes in gene expression. Using a generalized linear mixed model (GLMM), we find that high mutational load tumors up-regulate proteostasis machinery related to the mitigation and prevention of protein misfolding. We replicate these expression responses in cancer cell lines and show that the viability in high mutational load cancer cells is strongly dependent on complexes that degrade and refold proteins. This indicates that the upregulation of proteostasis machinery is causally important for high mutational burden tumors and uncovers new therapeutic vulnerabilities.