AcademyWorkflowsData and reporting

Local Multi-LLM Testing and Performance Tracker

Data and AI teams that need to compare local language models on the same prompts before choosing one.

Use it nowWant it running at your company?
  • Recommendedour rating
  • 3,614views on n8n

Use it now

Open inClaudeChatGPTGeminiPerplexity
Open on n8n.io ↗

Paste it straight onto an n8n canvas with Ctrl+V or Cmd+V.

Third party software. By copying, downloading or installing it you accept the Academy legal notice: you are responsible for reviewing its code and permissions before use.

local-multi-llm-testing-performance-tracker.json

Loading the file...

What it does

This n8n workflow sends the same test prompts to every active model in LM Studio on your own computer. It measures word count, readability and response time, then writes each result to a Google Sheet so you can compare the models side by side. You can change the temperature and top P values for each run.

Use cases

  1. 01Compare local models on the same set of prompts
  2. 02Track response time and readability in a shared sheet
  3. 03Test different temperature and top P settings

Connects

Google Sheets · HTTP Request · Code · Basic LLM Chain · OpenAI Chat Model

Questions about
Local Multi-LLM Testing and Performance Tracker.

What is Local Multi-LLM Testing and Performance Tracker used for?

Data and AI teams that need to compare local language models on the same prompts before choosing one. This n8n workflow sends the same test prompts to every active model in LM Studio on your own computer. It measures word count, readability and response time, then writes each result to a Google Sheet so you can compare the models side by side. You can change the temperature and top P values for each run.

How do I import Local Multi-LLM Testing and Performance Tracker into n8n?

Copy the workflow JSON from this page and paste it onto the n8n canvas with Ctrl+V or Cmd+V. Then connect your credentials in each node.

Is Local Multi-LLM Testing and Performance Tracker safe to use?

It passed our automatic scan for credential theft, hidden instructions and risky install commands. Third party open source software. Sabemos AI does not maintain it. Check the code and permissions before you connect it to company data.

Related resources

Read the guide: AI data analysts: ask your data ↗

  1. 001markitdownOperations and analyst teams that need to give reports, contracts and spreadsheets to an AI assistant as plain text.OfficialMCP server · ★ 189k
  2. 002XLSXFinance and data teams that build or update Excel models and reports and want them to recalculate correctly.OfficialSkill
  3. 003server-fetchMarketing and research teams that want an AI assistant to read and summarise public web pages.OfficialMCP server
  4. 004Scrape and summarize webpages with AIMarketing and research teams that want quick summaries of articles from a website.RecommendedWorkflow · 292k views
  5. 005AI agent that can scrape webpagesOperations and research teams that want a chat agent able to read web pages and answer questions about their content.RecommendedWorkflow · 212k views
  6. 006Pull data from services without an n8n integrationOperations and data teams who need to connect n8n to a service that has no dedicated node.RecommendedWorkflow · 194k views