What is a p-value, explained for high school researchers

TL;DR

• A p-value measures the probability your results happened by chance.

• A p-value below 0.05 is the most common threshold for statistical significance.

• Low p-values do not prove your hypothesis is correct.

• Journals expect you to report p-values alongside effect sizes and context.

• Misreporting p-values is one of the most common mistakes in student papers.

You ran your experiment. You collected your data. Now your statistics software is showing you a number like 0.03 or 0.47, and you are not sure what it means or whether your research is any good. That number is a p-value, and understanding it is one of the most important skills you can develop as a researcher.

This concept trips up students at every level, including undergraduates and early graduate students. If you are a high school researcher preparing to submit to a peer-reviewed journal, getting this right is not optional. Reviewers will look at how you report and interpret your p-value before they look at almost anything else in your results section.

What follows is a plain-language explanation of what a p-value is, what it is not, and how to use it correctly in your research paper. No advanced mathematics required.

What Is a P-Value, Explained for High School Researchers?

A p-value is the probability of getting your observed results, or results more extreme, if the null hypothesis were true. In plain terms: it tells you how likely your data would be if there were actually no real effect in what you are studying. A small p-value means your results would be very unlikely under that assumption, which is evidence against the null hypothesis.

Start with the null hypothesis. In any experiment, you begin with two competing ideas. The null hypothesis says there is no effect, no difference, no relationship between the variables you are testing. The alternative hypothesis says there is one. Your job as a researcher is to collect data that helps you decide which is more plausible.

The p-value sits at the center of that decision. Imagine you are testing whether a new study technique improves test scores. Your null hypothesis is that the technique makes no difference. You collect data from two groups of students. After running your statistical test, you get a p-value of 0.03. That means: if the technique truly had no effect, there would only be a 3% chance of seeing a difference this large (or larger) just from random variation in your sample. That is a fairly small chance. Most researchers would take that as meaningful evidence against the null hypothesis.

If you are working on a research paper right now and want structured guidance through the full submission process, joining the Publication Compass waitlist puts you first in line when the platform opens.

What Does the 0.05 Threshold Actually Mean?

The 0.05 threshold, often called alpha, is the conventional cutoff below which a result is labeled statistically significant. It means researchers have agreed to accept a 5% risk of incorrectly rejecting the null hypothesis when it is actually true. This is called a Type I error, or false positive.

The 0.05 threshold was popularized by statistician Ronald Fisher in the 1920s and has been a default in many scientific fields ever since. It is not a law of nature. It is a convention. Some fields, like particle physics, require p-values below 0.000001 before claiming a discovery. Some psychology and social science journals now encourage researchers to report exact p-values rather than simply stating whether results crossed the 0.05 line, following guidance from the American Statistical Association, which published a formal statement on p-values in 2016 noting that scientific conclusions should not be based only on whether a p-value passes a specific threshold.

For high school researchers submitting to student journals, the 0.05 threshold is still the most widely expected standard. But knowing it is a convention, not a truth, will make you a more careful and credible writer.

The key steps in applying the threshold correctly are:

1. State your alpha level before you collect data, not after you see your results.

2. Run the appropriate statistical test for your data type and research design.

3. Report the exact p-value you calculated, not just whether it is above or below 0.05.

4. Interpret the result in context, alongside your effect size and sample size.

What a P-Value Does Not Tell You

A p-value does not tell you the probability that your hypothesis is true. It does not measure the size of an effect. It does not confirm that your findings will replicate. And a statistically significant result is not automatically an important or meaningful one. These misunderstandings appear in student papers constantly, and reviewers notice them immediately.

This is where many first-time researchers make a critical error. They see a p-value of 0.02 and write something like: "This proves that the treatment works." That sentence contains two problems. First, statistics do not prove anything in the absolute sense. Second, statistical significance and practical significance are different things entirely.

Consider a study with 10,000 participants that finds a new app reduces daily screen time by an average of four minutes. With that sample size, even a tiny difference will produce a very low p-value. The result is statistically significant. But is four minutes of reduced screen time meaningful in real life? That is a separate question, and it requires reporting an effect size, not just a p-value.

Effect size measures like Cohen's d or Pearson's r tell readers how large the observed difference or relationship actually is. Peer-reviewed journals increasingly require both. If you are planning to submit to a journal that publishes student research, check their author guidelines carefully. Journals like the Journal of High School Science and the International Journal of High School Research expect results sections that go beyond a single p-value. You can find submission guidance for specific student journals in this overview of peer-reviewed journals for high school researchers.

What Is a P-Value, Explained Through a Real Example?

Walking through a concrete example is the fastest way to make this stick. Suppose you are investigating whether listening to classical music while studying improves memory recall. You recruit 40 students, split them into two groups, and test recall scores after a study session. One group studied in silence; the other listened to classical music.

Your results show the music group scored an average of 6.2 points higher. You run an independent samples t-test and get a p-value of 0.04. Here is how to interpret that correctly:

1. Your p-value of 0.04 is below your pre-set alpha of 0.05.

2. You reject the null hypothesis that there is no difference between the groups.

3. You report the exact p-value: p = 0.04.

4. You calculate and report the effect size (Cohen's d) to show how large the difference is.

5. You acknowledge limitations: your sample is small, your participants may not be representative, and the result needs replication.

Notice what you do not write: "Classical music improves memory." That is a much broader claim than your data supports. You write: "In this sample, students who listened to classical music during a study session scored significantly higher on the recall test (p = 0.04), though further research with larger and more diverse samples is needed."

That kind of careful language is exactly what journal reviewers want to see. It shows you understand the limits of your own findings. Avoiding overstatement is one of the areas covered in detail in this guide to common mistakes first-time researchers make.

How to Report a P-Value in Your Research Paper

Report p-values in the results section of your paper, immediately after the statistical test you ran. Use the format p = [value], rounded to two or three decimal places. If your p-value is very small, use p < 0.001 rather than writing out a long string of zeros. Never write p = 0.000.

The standard reporting format used in most science and social science journals follows the guidelines of the American Psychological Association (APA) or similar style guides. A correctly formatted result sentence looks like this: "Students in the music condition scored significantly higher than those in the silence condition, t(38) = 2.14, p = 0.04, d = 0.68."

That single line tells a reviewer the test used (t-test), the degrees of freedom (38), the test statistic (2.14), the p-value (0.04), and the effect size (d = 0.68). Each piece of information serves a purpose. Leaving any of them out raises questions about your methodology.

If your research involves biology, psychology, or computer science, the reporting conventions may vary slightly by field. These subject-specific guides can help: journals for student researchers in biology and journals for student researchers in psychology both include notes on what those fields expect in results sections.

Why Journals Care So Much About This

Peer-reviewed journals care about p-values because the integrity of published science depends on them being reported honestly and completely. The reproducibility crisis, a term used to describe the widespread failure to replicate published findings across many fields, has been partly attributed to selective reporting of p-values, sometimes called p-hacking.

P-hacking happens when a researcher runs many different analyses and only reports the ones that produced a p-value below 0.05. This inflates the apparent significance of results and misleads readers. Major publishers and academic bodies, including the Committee on Publication Ethics (COPE), treat selective reporting as a form of research misconduct.

As a student researcher, you are held to the same standards as professional academics when you submit to a peer-reviewed journal. That is not a reason to feel intimidated. It is a reason to understand the rules clearly before you submit. Publication Compass was built to help students navigate exactly this kind of technical requirement, providing structured feedback on drafts so that issues like p-value misreporting are caught before a reviewer sees them.

FAQ: What Is a P-Value, Explained for High School Researchers

What does a p-value of 0.05 mean in simple terms?

A p-value of 0.05 means there is a 5% chance of seeing your results, or more extreme results, if the null hypothesis were true. Researchers commonly use 0.05 as the cutoff for calling a result statistically significant, meaning results below this threshold are considered unlikely to be due to chance alone.

Can a high p-value mean my research is wrong?

Not necessarily. A high p-value means your data did not provide strong evidence against the null hypothesis. It could mean there is no real effect, or it could mean your sample was too small to detect one. A high p-value does not invalidate your research question or your methodology if both were sound.

Do I need a low p-value to get published in a student journal?

Not always. Many student journals value well-designed studies and honest reporting over significant results. A study with a high p-value that is clearly explained and properly contextualized can still be publishable. Journals increasingly accept null results. Check the specific journal's scope and author guidelines before submitting.

What is the difference between statistical significance and practical significance?

Statistical significance means your result is unlikely to be due to chance. Practical significance means the effect is large enough to matter in the real world. A study can be statistically significant but practically meaningless, especially with very large sample sizes. Always report effect size alongside your p-value to address both.

What is a p-value, explained for high school researchers who are new to statistics?

Think of a p-value as a measure of surprise. It tells you how surprising your data would be if nothing interesting were actually happening. A very small p-value means your data would be very surprising under that assumption, which is evidence that something real is going on. It is one piece of evidence, not a final verdict.

What to Do Before You Submit

Understanding p-values is one part of preparing a research paper that survives peer review. The other parts include choosing the right journal, formatting your citations correctly, and writing a results section that is honest about what your data can and cannot show. Each of those steps has its own set of conventions, and getting them wrong is the most common reason student papers are rejected before reviewers even read the discussion.

Start by reading the author guidelines for the journal you are targeting. Then review your results section against the reporting standards for your field. If you want a platform that walks you through that process and flags problems before submission, Publication Compass is designed for exactly that. You can also explore the full guide to publishing a research paper as a high school student to see how p-value reporting fits into the broader submission process.