Reproducibility in Cancer Biology: Pseudogenes, RNAs and new reproducibility norms
The partial success of a study to reproduce experiments that linked pseudogenes and cancer proves that understanding RNA networks is more complicated than expected.
- Translational Molecular Pathology Department, University of Texas MD Anderson Cancer Center, United States
- Center for RNA Interference and Non-Coding RNAs, University of Texas MD Anderson Cancer Center, United States
Of all the molecules involved in the flow of genetic information within any biological system, RNA is the oldest (Crick, 1970). This means that RNA molecules can interact with other RNAs and with all the other molecules that appeared later in evolution, including DNA molecules, proteins and lipids (Fabbri et al., 2019). RNA further evolved into coding RNA molecules (which are translated into proteins) and non-coding RNA molecules (which are not translated, but can still perform a number of other roles within cells; Pang et al., 2006). The most widely studied non-coding RNAs are the short transcripts called microRNAs that can silence a molecule of messenger RNA and prevent it from being translated into a protein. Relatively little studied, on the other hand, are non-coding RNAs called pseudogenes: a pseudogene is an RNA molecule that has been transcribed from a DNA segment that resembles a protein-coding gene but, for various reasons, this DNA is never expressed as a protein.
In 2010 researchers at the Beth Israel Deaconess Medical Center, Harvard University and the Memorial Sloan Kettering Cancer Center reported some surprising results about a pseudogene that is related to PTEN, a gene that codes for a protein that can suppress tumors (Poliseno et al., 2010). Mutations in this gene are linked to a number of cancers. Poliseno et al. reported that the pseudogene, which is called PTENP1, is biologically active and can regulate the levels of PTEN in cells via the direct interaction with a number of different microRNAs.
This report changed the dogmatic view of pseudogenes as relicts of genomic evolution: rather, by retaining multiple sites that can bind microRNAs, pseudogenes can act as decoys for their functional counterpart. The results of Poliseno et al. therefore provided support for a theory in which RNAs are regulated by other RNAs (Salmena et al., 2011; please see Thomson and Dinger (2016) for a balanced description of this theory, which is called the 'competing endogenous RNA theory'). Moreover, the results in the 2010 paper showed that pseudogenes can influence genes that are involved in cancer.
In 2015, as part of the Reproducibility Project: Cancer Biology, Khan et al. published a Registered Report which explained in detail how they would seek to replicate four of these experiments (Khan et al., 2015a; somewhat unusually, this report has been corrected twice: Khan et al. (2015b); Khan et al. (2015c). The results of these experiments have now been published as a Replication Study (Kerwin et al., 2020). As with a number of other Replication Studies in this project, some of the original results have been reproduced and some have not. Moreover, as we will describe below, the Replication Study does not contain data for one of the four experiments (although these data will be made available at https://osf.io/fjdtn/). Unfortunately, this was probably the most important of the experiments. First, however, we will discuss the experiments for which data are reported.
Poliseno et al. reported that the depletion of PTEN and/or PTENP1 increased the proliferation of DU145 prostate cancer cells, compared to administration of non-targeting siRNA, by an amount that was statistically significant (Figure 2F in the 2010 paper). The Replication Study also reports a similar increase in proliferation, and while it is not statistically significant, it supports the idea that pseudogenes can have a functional role in human cancers. Moreover, a study published by researchers at the University of Michigan in 2012 confirmed that transcribed pseudogenes are an important contributor in the transcriptional landscape of cancer cells (Kalyana-Sundaram et al., 2012).
The original study reported that overexpression of PTEN 3’UTR increased PTENP1 levels in DU145 cells (Figure 4A), whereas the Replication Study reports that it does not. As the level of the 3’UTR expression was not determined in either study, it is not possible to compare the amount of 3’UTR molecules used by the two groups, so it is difficult to make meaningful comparisons. However, the original study and the Replication Study both found that overexpression of PTEN 3’UTR led to a statistically significant decrease in the proliferation of DU145 cells compared to controls.
In the original study Poliseno et al. reported that two microRNAs – miR-19b and miR-20a – suppress the transcription of both PTEN and PTENP1 in DU145 prostate cancer cells (Figure 1D), and that the depletion of PTEN or PTENP1 led to a statistically significant reduction in the corresponding pseudogene or gene (Figure 2G). Neither of these effects were seen in the Replication Study. There are many possible explanations for this. For example, although both studies used DU145 prostate cancer cells, they did not come from the same batch, so there could be significant genetic differences between them: see Andor et al. (2020) for more on cell lines acquiring mutations during cell cultures. Furthermore, one of the techniques used in both studies – quantitative real-time PCR – depends strongly on the reagents and operating procedures used in the experiments. Indeed, there are no widely accepted standard operating procedures for this technique, despite over a decade of efforts to establish such procedures (Willems et al., 2008; Schwarzenbach et al., 2015).
What are the take-home messages from this Replication Study? One is the importance of fruitful communication between the laboratory that did the initial experiments and the lab trying to repeat them. The lack of such communication – which should extend to the exchange of protocols and reagents – was the reason why the experiments involving microRNAs could not be reproduced. The original paper did not give catalogue numbers for these reagents, so the wrong microRNA reagents were used in the Replication Study. The introduction of reporting standards at many journals means that this is less likely to be an issue for more recent papers. Another take-home message is that it is finally time for the research community to make raw data obtained with quantitative real-time PCR openly available for papers that rely on such data. This would be of great benefit to any group exploring the expression of the same gene/pseudogene/non-coding RNA in the same cell line or tissue type.
The true power of the Reproducibility Project is not restricted to what it can tell us about the robustness of papers in the field of cancer biology: rather, it should make researchers in the field – and the wider scientific community – realize that we can and should establish new standards and norms to make data freely available and comparable.
Note
George A Calin was the Reviewing Editor for the Registered Report (Khan et al., 2015a) and the Replication Study (Kerwin et al., 2020).
References
-
Joint single cell DNA-seq and RNA-seq of gastric cancer cell lines reveals rules of in vitro evolutionNAR Genomics and Bioinformatics 2:lqaa016.https://doi.org/10.1093/nargab/lqaa016
-
Decrypting noncoding RNA interactions, structures, and functional networksGenome Research 29:1377–1388.https://doi.org/10.1101/gr.247239.118
-
Data normalization strategies for microRNA quantificationClinical Chemistry 61:1333–1342.https://doi.org/10.1373/clinchem.2015.239459
-
Endogenous microRNA sponges: evidence and controversyNature Reviews Genetics 17:272–283.https://doi.org/10.1038/nrg.2016.20
-
Standardization of real-time PCR gene expression data from independent biological replicatesAnalytical Biochemistry 379:127–129.https://doi.org/10.1016/j.ab.2008.04.036
Article and author information
Author details
Publication history
Copyright
© 2020, Calin
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,012
- views
-
- 78
- downloads
-
- 2
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
A two-part list of links to download the article, or parts of the article, in various formats.
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Reproducibility in Cancer Biology: Pseudogenes, RNAs and new reproducibility norms
eLife 9:e56397.
https://doi.org/10.7554/eLife.56397
Further reading
-
- Cancer Biology
- Chromosomes and Gene Expression
Despite exciting developments in cancer immunotherapy, its broad application is limited by the paucity of targetable antigens on the tumor cell surface. As an intrinsic cellular pathway, nonsense-mediated decay (NMD) conceals neoantigens through the destruction of the RNA products from genes harboring truncating mutations. We developed and conducted a high-throughput screen, based on the ratiometric analysis of transcripts, to identify critical mediators of NMD in human cells. This screen implicated disruption of kinase SMG1’s phosphorylation of UPF1 as a potential disruptor of NMD. This led us to design a novel SMG1 inhibitor, KVS0001, that elevates the expression of transcripts and proteins resulting from human and murine truncating mutations in vitro and murine cells in vivo. Most importantly, KVS0001 concomitantly increased the presentation of immune-targetable human leukocyte antigens (HLA) class I-associated peptides from NMD-downregulated proteins on the surface of human cancer cells. KVS0001 provides new opportunities for studying NMD and the diseases in which NMD plays a role, including cancer and inherited diseases.
-
- Cancer Biology
- Medicine
A doctoral-level internship program was developed at the University of North Carolina at Chapel Hill with the intent to create customizable experiential learning opportunities for biomedical trainees to support career exploration, preparation, and transition into their postgraduate professional roles. We report the outcomes of this program over a 5-year period. During that 5-year period, 123 internships took place at over 70 partner sites, representing at least 20 academic, for-profit, and non-profit career paths in the life sciences. A major goal of the program was to enhance trainees’ skill development and expertise in careers of interest. The benefits of the internship program for interns, host/employer, and supervisor/principal investigator were assessed using a mixed-methods approach, including surveys with closed- and open-ended responses as well as focus group interviews. Balancing stakeholder interests is key to creating a sustainable program with widespread support; hence, the level of support from internship hosts and faculty members were the key metrics analyzed throughout. We hypothesized that once a successful internship program was implemented, faculty culture might shift to be more accepting of internships; indeed, the data quantifying faculty attitudes support this. Furthermore, host motivation and performance expectations of interns were compared with results achieved, and this data revealed both expected and surprising benefits to hosts. Data suggests a myriad of benefits for each stakeholder group, and themes are cataloged and discussed. Program outcomes, evaluation data, policies, resources, and best practices developed through the implementation of this program are shared to provide resources that facilitate the creation of similar internship programs at other institutions. Program development was initially spurred by National Institutes of Health pilot funding, thereafter, successfully transitioning from a grant-supported model, to an institutionally supported funding model to achieve long-term programmatic sustainability.
