Notes

Why I'm publishing my local AI numbers

This site is my lab notebook for local models and agents, measured on my own hardware, with the raw data attached to every post.

1 min read

Table of contents
  1. What you’ll find here
  2. The rules I hold myself to

Most local AI advice is either a vendor chart or a vibe. I wanted numbers I could trust, so I started measuring things myself: which model build to run, how fast it really is on my machines, and what an agent actually does when I hand it a task.

This site is where those measurements go.

What you’ll find here

  • Benchmarks: models measured on my own hardware, with the machine, runtime, settings and date written down.
  • Setup: the hardware and software behind it all, written so you can copy it.
  • Workflows: real Hermes agent runs, step by step, including the steps that failed.
  • Notes: short findings like this one.

The rules I hold myself to

Every number comes with its raw data. Every benchmark says what I did not test. If something turns out wrong, I correct the post and say so.

The first results are already up: nine model builds and four runtimes on my Mac Studio, on the Benchmarks page.

Get the next one

New benchmarks and agent runs by email, with the raw data. Or follow on RSS or X.

Free. You confirm by email, and every issue has a one-click unsubscribe. How I handle your email.

RSSX