AcademySkillsDevelopment

OpenJudge

Development teams that build agents or chatbots and need a repeatable way to check the quality of their answers.

  • Recommendedour rating
  • 871gitHub stars
  • Apache-2.0licence
  • 30 days agolast update
git clone https://github.com/agentscope-ai/OpenJudge.git
README.md

Loading the file...

What it does

An open-source framework for evaluating AI applications such as agents and chatbots. It provides a way to score outputs and produce quality signals, and it is available as a Python package.

Use cases

  1. 01Score chatbot answers against quality criteria
  2. 02Compare two versions of an agent
  3. 03Add output checks to a test routine

Questions about
OpenJudge.

What is OpenJudge used for?

Development teams that build agents or chatbots and need a repeatable way to check the quality of their answers. An open-source framework for evaluating AI applications such as agents and chatbots. It provides a way to score outputs and produce quality signals, and it is available as a Python package.

How do I install OpenJudge?

Run this in your terminal: git clone https://github.com/agentscope-ai/OpenJudge.git

Is OpenJudge open source?

Yes. The code is on GitHub (agentscope-ai/OpenJudge) under the Apache-2.0 licence.

Is OpenJudge safe to use?

It passed our automatic scan for credential theft, hidden instructions and risky install commands. Third party open source software. Sabemos AI does not maintain it. Check the code and permissions before you connect it to company data.