Peer review process
Revised: This Reviewed Preprint has been revised by the authors in response to the previous round of peer review; the eLife assessment and the public reviews have been updated where necessary by the editors and peer reviewers.
Read more about eLife’s peer review process.Editors
- Reviewing EditorChristoph BuettnerRutgers Robert Wood Johnson Medical School, New Brunswick, United States of America
- Senior EditorMa-Li WongState University of New York Upstate Medical University, Syracuse, United States of America
Reviewer #3 (Public review):
In this study, the authors tested a dietary intervention focused on improving meal regularity. Participants first utilized a smartphone application to track their meal frequencies, and then they were asked to restrict their meal intake to times when they most often eat to enhance meal regularity for six weeks. This, supposedly, resulted in some weight loss, supposedly independent of changes in caloric intake.
The concept is appealing, and it is interesting to use a smartphone app in participants' typical everyday environment to regularize food intake. It asks from participants to stick to meal intake times that are supported in many cultures, and it asks them not to eat outside of what are likely unhealthy habits such as grazing a refrigerator late at night. In essence, this is a restrictive diet, not restricting caloric intake but the timing of food intake, and it has many parallel to time restricted feeding. It is important to note that there are many restrictive diets, and a common problem with restrictive diets is that while they allow one to lose a couple of pounds for a couple of months just as with this diet, the long-term success is very poor because they depend on restriction. This issue is still not discussed.
Further, why the participants lose weight, whether this is indeed due to a reduction in food intake as implied, or if the weight loss occurred without a reduction in caloric intake as first stated by the authors and now suggested remains to be determined as the method of food diary as a method to assess caloric intake lacks rigor as has been well established and has been shown again and again to be misleading even though many readers without that knowledge draw conclusions from such studies and they should best have been omitted.
The authors hypothesize that the intervention improves metabolism by improving circadian rhythmicity. That's plausible, but the study provides only a subjective questionnaire and lacks more objective measures such as actigraphy.
While the authors now state now that this as a pilot study, the study falls short of providing mechanistic insights into what underlies the weight loss and the many correlations provided do not make up for this weakness.
Overall, while this pilot study introduces an interesting approach to meal regularity, its limitations highlight the need for more rigorous studies to validate these findings.
(1) Unreliable method of caloric intake
The trial's reliance on self-reported caloric intake is problematic, as participants tend to underreport intake. As pointed out earlier by me and now cited in the revised manuscript, the NEJM paper (DOI: 10.1056/NEJM199212313272701) reported that some participants underreported caloric intake by approximately 50%, rendering such data unreliable and hence misleading. The question is, why include such unreliable data that is more misleading than informative at all? These data should have been omitted. More rigorous methods for assessing food intake should have been utilized. I understand this requires more effort, such as providing participants with meals, or using better methods that photograph and weigh the meals, etc., but it is certainly feasible. It has been done many times in other studies. Further, the control group was not asked to restrict their diet in any way, and hence, asking for a restriction in timing in the treatment group may be sufficient to reduce caloric intake and induce weight loss.
Merely acknowledging the unreliability of self-reported caloric intake is insufficient, as it still leaves the reader with the impression that this weight loss is independent of caloric intake when, in reality, we actually have no idea if food intake contributes to it. A more robust approach to assessing food intake is imperative. Even if a decrease in caloric intake is observed through rigorous measurement, as I am convinced a more rigorous study would unveil testing this paradigm, this intervention may merely represent another restrictive diet among countless others that show that one may lose weight by going on a diet. Seemingly, any restrictive diet works for a few months. The trouble is they do not work long-term because they depend on restriction. I agree with the authors that their intervention seems common sense and has little downside, but one also needs to be realistic about the prospects of this intervention.
(2) Lack of objective data regarding circadian rhythm
The assessment of circadian rhythm using the MCTQ, a self-reported measure of chronotype, is subjective. More objective methods like actigraphy would have strengthened the study.
Actigraphy is considered better than a sleep questionnaire for assessing circadian rhythms because it provides objective data on activity patterns over time, offering a more accurate picture of sleep-wake cycles compared to subjective self-reported information from a questionnaire.
The authors' responses to my prior review are misleading.
I understand that this is a pilot study. Is it appropriate to point out weaknesses and flaws in the conclusion drawn from a pilot study? Absolutely, that is the reviewer's job.
I also understand that food intake can affect circadian rhythm, which was part of the rationale behind the study. Is it appropriate to criticize the study for not examining the effect of the intervention on circadian rhythm using objective measures provided by actigraphy? Yes, it is, as this would have provided mechanistic insights that are more rigorous. I understand that this was not the declared goal, but it should have been examined in a pilot study. To jump to the conclusion that based on prior studies, the intervention will improve circadian rhythms as the authors do is not rigorous and hence a weakness.
A less rigorous method, such as a food questionnaire, to assess caloric intake can result in inadequately supported and potentially misleading conclusions. By including it, the reader may conclude that there was no change in caloric intake when indeed we do not know. I disagree with the authors that this is a minor issue. The associations and correlations the authors provide do not solve the issue. Hence, to make it very clear, it remains to be studied if this intervention reduces weight by reducing caloric intake or other mechanisms. Including this data reduces the study's rigor as it suggests that there is no difference in food intake.
I did not suggest to only use an actimeter (which is a device); I suggested actigraphy. Actigraphy is widely recognized in the field for its utility in circadian rhythm research and provides objective data, while the questionnaire used is subjective. The authors do quote papers comparing their survey to actigraphy by correlation analysis, but the fundamental difference of the two approaches remains. Does an objective measure increase rigor compared to a subjective assessment? Yes, it does.
Similarly, I did not state "that any form of imposed diet appears to lead to weight loss over several months." I said that many forms of restrictive diets do induce weight loss of a similar magnitude to this diet.
The authors should have discussed the fundamental confounder of the study in that the treatment group is asked to restrict food intake to specific times while the control group is not asked to restrict in any way and the potential contribution of this to the weight loss observed.