Is Promptfoo Safe? — Trust Score: 92.6/100
According to Nerq's independent analysis of promptfoo/promptfoo, this security has a trust score of 92.6 out of 100, earning a A+ grade. With 17,263 stars on github, it is recommended for production use. Security score: 1/100. Compliance: 97/100 across 52 jurisdictions. Data sourced from 13+ independent signals including GitHub, NVD, OSV.dev, and OpenSSF Scorecard. Last updated: 2026-03-19. Machine-readable data (JSON).
Is Promptfoo safe?
YES — Promptfoo has a Nerq Trust Score of 92.6/100 (A+). It meets Nerq's trust threshold with strong signals across security, maintenance, and community adoption. Recommended for production use — review the full report below for specific considerations.
Trust Assessment
Highly Trusted — promptfoo/promptfoo ranks among the top AI agents with exceptional trust signals across security, maintenance, and ecosystem metrics. It has been independently assessed by Nerq and demonstrates consistently strong quality indicators.
Trust Signal Breakdown
Details
| Author | promptfoo |
| Category | security |
| Stars | 17,263 |
| Source | https://github.com/promptfoo/promptfoo |
| Frameworks | openai · anthropic · ollama |
| Protocols | rest |
Regulatory Compliance
| EU AI Act Risk Class | Not assessed |
| Compliance Score | 97/100 |
| Jurisdictions | Assessed across 52 jurisdictions |
Popular Alternatives in security
Deep Analysis: promptfoo/promptfoo
Executive Summary
promptfoo/promptfoo is a security tool with a Nerq Trust Score of 92.6/100 (A+). No known vulnerabilities. 17,263 GitHub stars. Test and evaluate LLMs for security vulnerabilities.
Security
No known CVEs. promptfoo/promptfoo has a clean security record in the Nerq database.
Maintenance Health
- GitHub stars: 17,263
- Activity score: 1/100
Ecosystem Position
- Compatible frameworks: anthropic, mcp-sdk, openai, vercel-ai
Cost Analysis
- Cost per code_review: $0.0018
- Cost per code_generation: $0.0027
- Cost per chat_response: $0.0004
- Cost per document_analysis: $0.0027
- Cost per data_extraction: $0.0014
Trust Score Breakdown
Strongest: Compliance (97/100). Weakest: Documentation (1/100).
How to Improve This Score
Frequently Asked Questions
Is promptfoo safe to use in production?
Yes. promptfoo has a Nerq Trust Score of 92.6/100 (A+). This is a high trust score, indicating strong security, maintenance, and community signals.
Does promptfoo have any known vulnerabilities?
As of March 2026, promptfoo has no known CVEs in the Nerq database.
What license does promptfoo use?
License information is not yet available in the Nerq database.
How does promptfoo compare to alternatives?
In the security category, promptfoo scores 92.6/100. Use the Nerq comparison API to compare directly: curl nerq.ai/v1/compare/promptfoo/vs/[alternative]
How often is promptfoo updated?
Check the maintenance health section above for the latest activity data. Nerq tracks commit frequency, release cadence, and issue response times.
Community Reviews
No reviews yet. Be the first to review promptfoo/promptfoo.
What Is Promptfoo?
Promptfoo is a AI security tool for vulnerability scanning and threat detection. Test and evaluate LLMs for security vulnerabilities.
As of March 2026, Promptfoo has 17,263 stars on github, making it one of the most popular tools in its category in the AI ecosystem. But popularity alone does not equal safety — which is why Nerq independently analyzes every tool across 13+ trust signals.
How Nerq Assesses Promptfoo's Safety
Nerq's Trust Score is calculated from 13+ independent signals aggregated into five dimensions. Here is how Promptfoo performs in each:
- Security (1/100): Promptfoo's security posture is poor. This score factors in known CVEs, dependency vulnerabilities, security policy presence, and code signing practices.
- Maintenance (1/100): Promptfoo is potentially abandoned. We track commit frequency, release cadence, issue response times, and PR merge rates.
- Documentation (1/100): Documentation quality is insufficient. This includes README completeness, API documentation, usage examples, and contribution guidelines.
- Compliance (97/100): Promptfoo is broadly compliant. Assessed against regulations in 52 jurisdictions including the EU AI Act, CCPA, and GDPR.
- Community (1/100): Community adoption is limited. Based on GitHub stars, forks, download counts, and ecosystem integrations.
The overall Trust Score of 92.6/100 (A+) reflects the weighted combination of these signals. This exceeds the Nerq Verified threshold of 70, indicating the tool meets our standards for production use.
Who Should Use Promptfoo?
Promptfoo is designed for:
- Developers and teams working with security tools
- Organizations evaluating AI tools for their stack
- Researchers exploring AI capabilities in this domain
Risk guidance: Promptfoo is well-suited for production environments. Its high trust score indicates robust security, active maintenance, and strong community support. Standard security practices (dependency pinning, access controls, monitoring) are still recommended.
How to Verify Promptfoo's Safety Yourself
While Nerq provides automated trust analysis, we recommend these additional steps before adopting any AI tool:
- Check the source code — Review the repository's security policy, open issues, and recent commits for signs of active maintenance.
- Scan dependencies — Use tools like
npm audit,pip-audit, orsnykto check for known vulnerabilities in Promptfoo's dependency tree. - Review permissions — Understand what access Promptfoo requires. AI tools should follow the principle of least privilege.
- Test in isolation — Run Promptfoo in a sandboxed environment before granting access to production data or systems.
- Monitor continuously — Use Nerq's API to set up automated trust checks:
GET nerq.ai/v1/preflight?target=promptfoo/promptfoo - Review the license — Confirm that Promptfoo's license is compatible with your intended use case. Pay attention to restrictions on commercial use, redistribution, and derivative works. Some AI tools use dual licensing or have separate terms for enterprise customers that differ from the open-source license.
- Check community signals — Look at the project's issue tracker, discussion forums, and social media presence. A healthy community actively reports bugs, contributes fixes, and discusses security concerns openly. Low community engagement may indicate limited peer review of the codebase.
Common Safety Concerns with Promptfoo
When evaluating whether Promptfoo is safe, consider these category-specific risks:
Understand how Promptfoo processes, stores, and transmits your data. Review the tool's privacy policy and data retention practices, especially for sensitive or proprietary information.
Check Promptfoo's dependency tree for known vulnerabilities. Tools with outdated or unmaintained dependencies pose a higher security risk.
Regularly check for updates to Promptfoo. Security patches and bug fixes are only effective if you're running the latest version.
If Promptfoo connects to external APIs or services, each integration point is a potential attack surface. Audit all third-party connections, verify that data shared with external services is minimized, and ensure that integration credentials are rotated regularly.
Verify that Promptfoo's license is compatible with your intended use case. Some AI tools have restrictive licenses that limit commercial use, redistribution, or derivative works. Using Promptfoo in violation of its license can expose your organization to legal liability.
Best Practices for Using Promptfoo Safely
Whether you're an individual developer or an enterprise team, these practices will help you get the most from Promptfoo while minimizing risk:
Periodically review how Promptfoo is used in your workflow. Check for unexpected behavior, permissions drift, and compliance with your security policies.
Ensure Promptfoo and all its dependencies are running the latest stable versions to benefit from security patches.
Grant Promptfoo only the minimum permissions it needs to function. Avoid granting admin or root access.
Subscribe to Promptfoo's security advisories and vulnerability disclosures. Use Nerq's API to get automated trust score updates.
Create and maintain a clear policy for how Promptfoo is used within your organization, including data handling guidelines and acceptable use cases.
When Should You Avoid Promptfoo?
Even well-trusted tools aren't right for every situation. Consider avoiding Promptfoo in these scenarios:
- Scenarios where Promptfoo's specific capabilities exceed your actual needs — simpler tools may be safer
- Air-gapped environments where the tool cannot receive security updates
- Projects with strict regulatory requirements that haven't been explicitly validated
For each scenario, evaluate whether Promptfoo's trust score of 92.6/100 meets your organization's risk tolerance. The Nerq Verified status indicates general production readiness, but sector-specific requirements may apply.
How Promptfoo Compares to Industry Standards
Nerq indexes over 204,000 AI agents and tools across dozens of categories. Among security tools, the average Trust Score is 67/100. Promptfoo's score of 92.6/100 is significantly above the category average of 67/100.
This places Promptfoo in the top tier of security tools that Nerq tracks. Tools scoring this far above average typically demonstrate mature security practices, consistent release cadence, and broad community adoption.
Industry benchmarks matter because they contextualize a tool's safety profile. A score that looks moderate in isolation may actually represent strong performance within a challenging category — or vice versa. Nerq's category-relative analysis helps teams make informed decisions by showing not just absolute quality, but how a tool ranks against its direct peers.
Trust Score History
Nerq continuously monitors Promptfoo and recalculates its Trust Score as new data becomes available. Our scoring engine ingests real-time signals from source repositories, vulnerability databases (NVD, OSV.dev), package registries, and community metrics. When a new CVE is published, a major release ships, or maintenance patterns change, Promptfoo's score is updated within 24 hours.
Historical trust trends reveal whether a tool is improving, stable, or declining over time. A tool that consistently maintains or improves its score demonstrates ongoing commitment to security and quality. Conversely, a downward trend may signal reduced maintenance, growing technical debt, or unresolved vulnerabilities. To track Promptfoo's score over time, use the Nerq API: GET nerq.ai/v1/preflight?target=promptfoo/promptfoo&include=history
Nerq retains trust score snapshots at regular intervals, enabling trend analysis across weeks and months. Enterprise users can access detailed historical reports showing how each dimension — security, maintenance, documentation, compliance, and community — has evolved independently, providing granular visibility into which aspects of Promptfoo are strengthening or weakening over time.
Promptfoo vs Alternatives
In the security category, Promptfoo scores 92.6/100. It ranks among the top tools in its category. For a detailed comparison, see:
- Promptfoo vs Ciphey — Trust Score: 73.8/100
- Promptfoo vs strix — Trust Score: 73.8/100
- Promptfoo vs SWE-agent — Trust Score: 91.3/100
Key Takeaways
- Promptfoo has a Trust Score of 92.6/100 (A+) and is Nerq Verified.
- Promptfoo demonstrates strong trust signals and is well-suited for production use with standard security precautions.
- Among security tools, Promptfoo scores significantly above the category average of 67/100, demonstrating above-average reliability.
- Always verify safety independently — use Nerq's Preflight API for automated, up-to-date trust checks before integration.
Frequently Asked Questions
Add This Badge to YOUR Project
pip install nerq && nerq scan
Scans all dependencies for trust scores and security issues.
Related Safety Checks
Disclaimer: Nerq trust scores are automated assessments based on publicly available signals. They are not endorsements or guarantees. Always conduct your own due diligence.