Our Methodology
How We Review: Our Methodology
We use a complex analytical matrix to assess each product, ensuring a level playing field across all evaluations. This matrix standardizes key criteria, helping to minimize discrepancies in the way products are compared. While our reviews ultimately contain a degree of subjective analysis—particularly in areas like taste and texture—our process is designed to ensure consistency and fairness in each product assessment.
Our Research Process
Sources of Information
We begin our research by gathering a wide range of information from sources including scientific journals, brand-provided details and marketing, third-party lab results, and user reviews. We also review brand marketing materials to understand product positioning and user perceptions, adding context to our evaluation. This comprehensive approach ensures that we account for multiple perspectives on each product.
Scientific Validation
Our evaluations rely on peer-reviewed scientific studies where possible, utilizing metrics like PDCAAS and protein efficiency ratios to validate ingredient effectiveness and bioavailability. For common ingredients, we draw on extensive existing knowledge of scientific research; for newer or unique ingredients, we consult published studies to assess suitability. We also avoid relying on anecdotal evidence, unless it is overwhelmingly consistent across multiple sources.
Data Verification
To ensure accuracy, we cross-check data from various sources, including brand websites, product labels, and independent testing reports. We also analyze the composition of protein powders to align with their marketed goals, helping to eliminate ambiguity and bias. This step is crucial for verifying product claims and maintaining the credibility of our reviews.
Pricing Analysis
We consider the recommended retail price and typical online pricing across multiple stores, acknowledging that sale prices can vary. We use a comparative metric for pricing to maintain fairness without listing specific prices, which avoids conflicts with affiliate agreements.
Independent Reporting
We maintain independence throughout our analysis process by not relying solely on brand-provided information. We do not endorse any specific brand, and our commissions from affiliate sales do not vary between products, ensuring that our reviews remain unbiased.
AI Utilization
AI is a tool that supports our process by aiding with calculations, content editing, consistency checks, watchlist ingredient identification, and minor research tasks. AI is also used to extract data from product labels and images. This allows us more time to focus on pure research, analysis, and writing in-depth content.
Content Freshness
We routinely update our reviews as new information becomes available, whether it’s updated formulations, new ingredients, pricing, or fresh user feedback. This dynamic approach ensures our assessments remain current and relevant. We also reevaluate our testing matrix and introduce new metrics and tools to provide improvements to testing procedures and comparisons between products.
Focus on User Needs
Our research is guided by real-world user needs, prioritizing factors like digestibility, effectiveness for different goals, and ingredient transparency, which matter most to users seeking protein supplementation. We also account for taste, texture, and mixability, as personal experiences can significantly affect user satisfaction.
Testing Criteria
1. Ingredients (Scored out of 100)
- Protein Source: We assess the protein source’s digestion speed, digestibility, and suitability for different diets and goals.
- Protein Concentration: We evaluate protein content relative to serving size, with allowances for functional ingredients like BCAAs.
- Carbohydrates: Lower-carb products are favored, except when carbs serve a functional purpose, like in mass gainers or meal replacements. Or where fiber is included to aid with the digestibility of the product.
- Fats: Healthy fats (e.g., MCTs, Omega-3) are assessed for their metabolic benefits.
- Clean formulation: We prioritize products with fewer artificial ingredients and natural sourcing.
- Potential Fillers: We identify unnecessary fillers that don’t significantly contribute to product effectiveness.
- Allergens: We flag common allergens or ingredients that may cause issues.
- Lactose: We examine lactose content and any added enzymes that enhance digestibility.
- Beneficial Additions: We identify added ingredients like Creatine, BCAAs, Enzymes, Prebiotics, Probiotics, Superfoods, Vitamins & Minerals, Stimulants, and L-glutamine which may be beneficial inclusions.
- Omitted Ingredients: We consider what could be added to improve the product's effectiveness.
- Certifications: We identify claims like vegan, kosher, gluten-free, and more.
- Transparency: We assess the clarity and detail of the ingredient labeling.
2. Effectiveness (Scored out of 100)
- Goal Alignment: We evaluate how well the product aligns with specific goals, such as muscle development, weight loss, or recovery.
- Ingredient Impact: We examine the use of added ingredients that support the product’s purpose (e.g., creatine, digestive enzymes).
- Protein Content: We assess the protein content per serve and the protein content concentration by weight.
- Macros: We assess the balance of macros in relation to the products marketed goals.
- Amino Acid Profile: We assess the protein sources amino acid profile and its suitability for the marketed goals.
- Protein Digestion Speed: We assess the speed of protein absorption and its suitability for intended uses.
- Protein Bioavailability Score: We assess nutrient absorption using the Protein Digestibility-Corrected Amino Acid Score (PDCAAS).
- Potential Issues: We identify any factors that may limit effectiveness, such as poor digestibility.
3. Taste, Texture, and Mixability (Scored out of 100)
- Flavor Profile: We consider the depth and balance of the product’s flavor.
- Texture: We evaluate smoothness, consistency, and mouthfeel.
- Mixability: We evaluate how easily the product dissolves in water or milk, whether using a shaker or blender.
4. Value (Scored out of 100)
- Cost per Gram: We analyze the cost per gram of both the entire product and the protein content specifically, offering a fairer comparison.
- Ingredient Suitability: We weigh the role of each ingredient in fulfilling the product’s marketed purpose.
- Added Benefits: We assess any extras, such as BCAAs or vitamins, that add value.
- Protein Sourcing: We consider whether the protein is grass-fed, hormone-free, or non-GMO, as these factors impact quality and value.
- Protein Purity: We compare concentrates, isolates, and hydrolysates to assess efficiency and cost-effectiveness.
- Brand Reputation: We factor in brand credibility, customer support, and the history of products.
- Lab Testing: We examine lab testing data where available, ensuring the brand's claims match the actual composition.
This comprehensive approach allows us to deliver honest, detailed, and helpful protein powder reviews tailored to the needs of our readers. We’re committed to continual updates and improvements to our methodology to ensure accurate and reliable assessments.
What We Don't Do
When it comes to evaluating protein powders, we aim to be as thorough as possible, but there are some things we can't do.
We don't provide medical advice
While we do consult with professionals for content on this site, this is not a substitute for personal medical advice. You should check with a medical professional before taking a supplement or making a significant change to your diet.
We don't analyze amino acid profiles
Few brands provide amino acid profile breakdowns and they tend to vary between batches anyway. While we applaud this transparency, the data isn't consistent enough to be used for a comparative review. However, we consider the typical amino acid profiles of the protein sources used in a product, their strengths and weaknesses, and the benefits of combining certain sources to support goals.
We don't perform 3rd party lab testing
We don't perform additional 3rd party lab tests for impurities or contaminants. Most brands already use 3rd party testing for quality control. There are also sites such as Labdoor that just perform 3rd party testing for consumers. We do however take into account publically available results where available.
We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites.