5 Important Peer Review Questions To Answer Before Submitting Your Flow Cytometry Data

Publish or perish remains the mantra of science.

All the experiments and experience in the world do not count if you are unable to communicate your results to the scientific community.

As part of that communication process, your paper will undergo the dreaded ‘Peer Review’ process. If you wish your paper to survive the peer review process, you must collect, analyze, and present your data properly—before you submit your paper.

A review of the following peer review questions, as well as how to answer these questions, will help ensure your paper is not rejected.

5 Questions Peer Reviewers Will Ask

As one who is asked to peer review papers regularly, especially those with flow cytometry data, there are 5 specific questions I ask when reading a manuscript.

If these questions are not adequately answered or explained in the paper, it raises red flags and ultimately leads to rejection.

1. What is the scientific hypothesis?

It all begins with the scientific hypothesis being tested. One of the critical parts of the paper is a clear statement of the reason for the study.

While it may seem obvious, answering this question should be the focus of the paper. However, many scientists make the mistake of forming one hypothesis and answering another.

To paraphrase the statistician Francis Anscombe…

“It is better to realize what the problem really is and solve that problem as well as we can, instead of inventing a substitute problem that can be solved exactly, but is irrelevant.”

There are many scientific papers that state one hypothesis and end up proving a second hypothesis because the second one was easier. This is especially true for papers with flow cytometry data. The truth is some questions are better suited to be answered by flow cytometry than others. If you’re using flow, make sure you are using it to answer the right hypothesis.

2. Are the correct statistics applied to the data?

If you want your flow cytometry data published, be sure to apply the correct statistics to your data.

Flow cytometry data is very numbers rich—you have percent positive, median fluorescent intensities, and much more. All of these numbers make up a critical part of the information that you must extract from your flow cytometry data, and the statistical tests to be used for your analysis will dictate which values are needed.

For questions concerning expression levels, the median is a better measure of the central tendency of the data than the mean is. If you’re using the term MFI in the paper—make sure it is properly defined and justified.

Using the mean implies a Gaussian distribution, which means that all the values are known and the distribution returns to zero. It also means that outliers can skew the results, as well as the interpretation of the results. Avoid this mistake and your paper will have a much better chance of being published.

3. How was the data compensated?

In reviewing the methods section of a paper, I always pay attention to how the data was compensated.

There are three rules that should be followed for proper compensation:

  • Controls must be at least as bright as the samples they will be applied to. Brighter is better, but not off scale.
  • Background fluorescence should be the same between the negative and positive population. Avoid using the universal negative for compensation.
  • The compensation color must be the same as the experimental color. For example, don’t use Alexa488 to compensate for FITC.

Automatic compensation programs are available with almost all of the major digital instruments, as well as third party software—so no one should be trying to manually compensate their flow cytometry data anymore.

Manual compensation is what we call cowboy compensation (see below figure)…

peer review questions | Expert Cytometry | peer reviewed papers

If the methods section says the data was manually compensated, this is clear reason to be suspicious of the data and often leads to rejection.

4. How were the antibody panels and gates designed?

One of the fundamental processes in flow cytometry data is the processing, or gating of the data, to identify the cells of interest. This gating process requires proper controls and application of these controls. It also relies on the proper polychromatic panel design.

In evaluating a polychromatic panel and the experimental protocols used to process the cells, some secondary questions that are important to ask include…

  • Was a dead cell marker included in the panel? Dead cells can indiscriminately take up all the antibodies in the panel, thus mask as positive cells. With the advent of live/dead fixable cells, there is no reason that one cannot be used in the assay.
  • Were the antibodies titrated? High antibody concentration can lead to non-specific binding, and thus reduce the sensitivity of the measurement because of the increase in background staining.
  • Were isotype controls used to set gates? There is a lot of contradictory information about the use of isotype controls on the web. Some say yes, some say no. The reality is that an isotype control can show if there is poor blocking of the cells, but isotype controls should not be used to set the gates. If the paper discusses the use of the isotype control to set gates, this is another strike against the paper and can lead to rejection.
  • Were the FMO controls used? The Fluorescence Minus One control is a gating control where every fluorochrome but one is used. The missing (minus one) fluorochrome will reveal the spread of data in the channel of interest, and help define where the gate should be placed (see below figure).
importance of peer review | Expert Cytometry | peer review in science

5. Which instrument and instrument settings did you use?

With a few exceptions, modern flow cytometers are very customizable. This means that it is critical to communicate the important features of the instrument used in the studies—specifically excitation wavelengths and laser power, and the arrangement of the detectors and filters on the emission side.

These two pieces of information help the reviewer understand where, if any, problems with the fluorescent panel may reside. For example, if there is a 488 nm laser of 50 mW power and the researchers used PerCP as a fluorochrome, that should raise some significant issues.

Likewise, having a 633, 561, 488 and 405 laser on a system, and having a 700/50 type filter on the emission side when using a fluorochrome like QDot705 would be a cause for concern (see below figure).

the peer review process | Expert Cytometry | peer review research paper

At the end of the day, there are many small errors that can easily be committed which doom peer reviewed papers to rejection. Avoiding these errors and ensuring that your flow data stands out for all the right reasons is the path to surviving peer review questions.

To learn more about getting your flow cytometry data published and to get access to all of our advanced materials including 20 training videos, presentations, workbooks, and private group membership, get on the Flow Cytometry Mastery Class wait list.

Join Expert Cytometry's Mastery Class

ABOUT TIM BUSHNELL, PHD

Tim Bushnell holds a PhD in Biology from the Rensselaer Polytechnic Institute. He is a co-founder of—and didactic mind behind—ExCyte, the world’s leading flow cytometry training company, which organization boasts a veritable library of in-the-lab resources on sequencing, microscopy, and related topics in the life sciences.

Tim Bushnell, PhD

Similar Articles

Common Numbers-Based Questions I Get As A Flow Cytometry Core Manager And How To Answer Them

Common Numbers-Based Questions I Get As A Flow Cytometry Core Manager And How To Answer Them

By: Tim Bushnell, PhD

Numbers are all around us.  My personal favorite is ≅1.618 aka ɸ aka ‘the golden ratio’.  It’s found throughout history, where it has influenced architects and artists. We see it in nature, in plants, and it is used in movies to frame shots. It can be approximated by the Fibonacci sequence (another math favorite of mine). However, I have not worked out how to apply this to flow cytometry.  That doesn’t mean numbers aren’t important in flow cytometry. They are central to everything we do, and in this blog, I’m going to flit around numbers-based questions that I have received…

How To Do Variant Calling From RNASeq NGS Data

How To Do Variant Calling From RNASeq NGS Data

By: Deepak Kumar, PhD

Developing variant calling and analysis pipelines for NGS sequenced data have become a norm in clinical labs. These pipelines include a strategic integration of several tools and techniques to identify molecular and structural variants. That eventually helps in the apt variant annotation and interpretation. This blog will delve into the concepts and intricacies of developing a “variant calling” pipeline using GATK. “Variant calling” can also be performed using tools other than GATK, such as FREEBAYES and SAMTOOLS.  In this blog, I will walk you through variant calling methods on Illumina germline RNASeq data. In the steps, wherever required, I will…

Understanding Clinical Trials And Drug Development As A Research Scientist

Understanding Clinical Trials And Drug Development As A Research Scientist

By: Deepak Kumar, PhD

Clinical trials are studies designed to test the novel methods of diagnosing and treating health conditions – by observing the outcomes of human subjects under experimental conditions.  These are interventional studies that are performed under stringent clinical laboratory settings. Contrariwise, non-interventional studies are performed outside the clinical trial settings that provide researchers an opportunity to monitor the effect of drugs in real-life situations. Non-interventional trials are also termed observational studies as they include post-marketing surveillance studies (PMS) and post-authorization safety studies (PASS). Clinical trials are preferred for testing newly developed drugs since interventional studies are conducted in a highly monitored…

How To Profile DNA And RNA Expression Using Next Generation Sequencing (Part-2)

How To Profile DNA And RNA Expression Using Next Generation Sequencing (Part-2)

By: Deepak Kumar, PhD

In the first blog of this series, we explored the power of sequencing the genome at various levels. We also dealt with how the characterization of the RNA expression levels helps us to understand the changes at the genome level. These changes impact the downstream expression of the target genes. In this blog, we will explore how NGS sequencing can help us comprehend DNA modification that affect the expression pattern of the given genes (epigenetic profiling) as well as characterizing the DNA-protein interactions that allow for the identification of genes that may be regulated by a given protein.  DNA Methylation Profiling…

How To Profile DNA And RNA Expression Using Next Generation Sequencing

How To Profile DNA And RNA Expression Using Next Generation Sequencing

By: Deepak Kumar, PhD

Why is Next Generation Sequencing so powerful to explore and answer both clinical and research questions. With the ability to sequence whole genomes, identifying novel changes between individuals, to exploring what RNA sequences are being expressed, or to examine DNA modifications and protein-DNA interactions occurring that can help researchers better understand the complex regulation of transcription. This, in turn, allows them to characterize changes during different disease states, which can suggest a way to treat said disease.  Over the next two blogs, I will highlight these different methods along with illustrating how these can help clinical diagnostics as well as…

What Is Next Generation Sequencing (NGS) And How Is It Used In Drug Development

What Is Next Generation Sequencing (NGS) And How Is It Used In Drug Development

By: Deepak Kumar, PhD

NGS methodologies have been used to produce high-throughput sequence data. These data with appropriate computational analyses facilitate variant identification and prove to be extremely valuable in pharmaceutical industries and clinical practice for developing drug molecules inhibiting disease progression. Thus, by providing a comprehensive profile of an individual’s variome — particularly that of clinical relevance consisting of pathogenic variants — NGS helps in determining new disease genes. The information thus obtained on genetic variations and the target disease genes can be used by the Pharma companies to develop drugs impeding these variants and their disease-causing effect. However simple this may allude…

7 Key Image Analysis Terms For New Microscopist

7 Key Image Analysis Terms For New Microscopist

By: Heather Brown-Harding, PhD

As scientists, we need to perform image analysis after we’ve acquired images in the microscope, otherwise, we have just a pretty picture and not data. The vocabulary for image processing and analysis can be a little intimidating to those new to the field. Therefore, in this blog, I’m going to break down 7 terms that are key when post-processing of images. 1. RGB Image Images acquired during microscopy can be grouped into two main categories. Either monochrome (that can be multichannel) or “RGB.” RGB stands for red, green, blue – the primary colors of light. The cameras in our phones…

We Tested 5 Major Flow Cytometry SPADE Programs for Speed - Here Are The Results

We Tested 5 Major Flow Cytometry SPADE Programs for Speed - Here Are The Results

By: Tim Bushnell, PhD

In the flow cytometry community, SPADE (Spanning-tree Progression Analysis of Density-normalized Events) is a favored algorithm for dealing with highly multidimensional or otherwise complex datasets. Like tSNE, SPADE extracts information across events in your data unsupervised and presents the result in a unique visual format. Given the growing popularity of this kind of algorithm for dealing with complex datasets, we decided to test the SPADE algorithm in 5 software packages, including Cytobank, FCS Express, FlowJo, R, and the original, free software made available by the author of SPADE. Which was the fastest?

5 FlowJo Hacks To Boost The Quality Of Your Flow Cytometry Analysis

5 FlowJo Hacks To Boost The Quality Of Your Flow Cytometry Analysis

By: Tim Bushnell, PhD

FlowJo is a powerful tool for performing and analyzing flow cytometry experiments, if you know how to use it to the fullest. This includes understanding embedding and using keywords, the FlowJo compensation wizard, spillover spreading matrix, FlowJo and R, and creating tables in FlowJo. Extending your use of FJ using these hacks will help organize your data, improve analysis and make your exported data easier to understand and explain to others. Take a few moments and explore all you can do with FJ beyond just gating populations.

Top Industry Career eBooks

Get the Advanced Microscopy eBook

Get the Advanced Microscopy eBook

Heather Brown-Harding, PhD

Learn the best practices and advanced techniques across the diverse fields of microscopy, including instrumentation, experimental setup, image analysis, figure preparation, and more.

Get The Free Modern Flow Cytometry eBook

Get The Free Modern Flow Cytometry eBook

Tim Bushnell, PhD

Learn the best practices of flow cytometry experimentation, data analysis, figure preparation, antibody panel design, instrumentation and more.

Get The Free 4-10 Compensation eBook

Get The Free 4-10 Compensation eBook

Tim Bushnell, PhD

Advanced 4-10 Color Compensation, Learn strategies for designing advanced antibody compensation panels and how to use your compensation matrix to analyze your experimental data.