I continue low-intensity work on Quamina; among other things, it benefits my mental health. At the moment there’s this little voice at the back of my brain that keeps saying “This would be a great job for Claude.” So far I’m ignoring it, but the internal conversation is worth sharing.

Disclosure · I’m not a GenAI expert, have never relied on it for any substantial piece of work. However, I’ve seen plenty of PRs with LLM fingerprints, and I follow a whole lot of indie devs who are in it up to their elbows. It seems to me that a pretty clear picture emerges of what it can and can’t do, where the wins and losses are. This essay reflects that picture but maybe I’m just wrong, in which case I’ll confess my errors.

Negative externalities · For me (and I’m not alone), the biggest issue isn’t what GenAI can and can’t do, it’s the ethical and economic discomforts. This technology is being peddled by terrible people who are rich and whose goal is to get richer. It’s bought and deployed by terrible people who want to slash their payrolls by throwing thought workers onto the street. It facilitates the oncoming climate catastrophe and devalues human creative effort.

Notice that I said “ethical and economic”? That second issue is all about the bubble and how nobody knows what GenAI technology will really cost, post-explosive-decompression. It wouldn’t surprise me if we ended up in a future where most software devs are using beefy “desktop” computers running open-weight models; or else they’re using AWS/GCloud/Azure (but still open-weight). Or something completely different. Or we’ve learned that the cost of AI, as measured in mental fitness and organizational health, is simply too high.

The stage has been set; let’s talk about bits on the wire.

Quamina and JSON and … · At the moment Quamina does its super-fast-matching magic on JSON blobs. But it should be perfectly possible to work with any other data format that has nested fields and boolean/numeric/string values at the leaves. Oh, and arrays of the above. There’s no shortage of candidates: Thrift, Protobufs, Apache Avro, and CBOR come to mind immediately.

Quamina has the built-in notion of a “Flattener”, that turns input data into a sorted list of “Field” structures. For example, here’s a JSON blob:

{
  "X: {
    "Z": 22,
    "Y": 21,
  },    
  "A": 33
}

The output of the flattener, what the matcher works on, would be something like this:

{"A": 33}, {"X\nY": 21}, {"X\nZ": 22}

In Quamina, flattening eats more time than matching. It used to eat dramatically more time, but the JSON flattener has been heavily optimized by me and other contributors.

Maybe the most important optimization is maintaining a list of which fields are actually up for matching and skipping over the ones that aren’t. Obviously this means that the parser can’t be the typical thing that turns your JSON blob into a fully-serialized tree of structures and arrays in a one-shot call. In fact, you need a parser that’s a tokenizer and lets the calling code decide how to deal with each little piece of it, one at a time.

Protobufs · Someone out there asked Claude to build a Flattener for Protobufs. It seemed to partly work but was kind of buggy and I found the code hard to read. Hmm. Of course the usual GenAI “That was six months ago, it’s much better now” narrative applies.

CBOR · For those who don’t know, CBOR is JSON but binary, which is claimed to make it more compact and faster to process. It’s also got a richer type repertoire, but whenever I’ve run across it in the field, it’s basically being used as JSON-only-faster.

So, I’ve started working on a CBOR Flattener for Quamina.

The simplest thing that could possibly work · The default CBOR processor for Go, from Faye Amacker, looks very polished. But it’s not a tokenizer, it’s a “deserialize your whole blob in one call” thing. So the simplest thing would be to make that one call on each incoming blob, then run around the deserialized tree and compute the flattening. Ignore all that stuff about bypassing for efficiency. Because it might be plenty fast enough and that optimization would have been premature. After all, if you read Faye’s page linked above, they seem to be something of an optimization fanatic.

And you know what, I bet if I gave Claude the problem of turning CBOR into Fields, I’d get OK code back; tell it find a way to fuzz-test the process and it’d be surprising if it didn’t work.

Right at this moment in history, I could make a case for that being a good engineering decision. Code, in the LLM-pre-bubble-pop era, is cheap. Time is still expensive. This task has clear, clean success criteria, easy to point an agent at. The Simplest Thing That Could Possibly Work is a powerful design principle, one that I’ve forced down the throat of more than just one or two over-aspirational engineering team leads.

But I’m not gonna do that. I mean, there’s the nauseating state of current AI culture and finance. But also, I’m doing this for fun. Writing high-performance tokenizers is fun! [Really? -Ed.][Serious fun. -T.] I’ve started poking around inside Faye’s library, raised an issue, and I’m confident that there is plenty of code and tests in there that I can steal.

Testing · Quamina has 14K lines of test code and 47M of of test data. A high proportion of the tests amount to “Run the code against this JSON and require these results.” Obviously, now I want to run 100% of those tests with equivalent CBOR input. It seems to me that Claude could do a great job of automating plenty of this work, which I predict will be grinding, tedious, and not fun at all. On top of which I tend to be lax and forgiving about test-code quality.

My internal engineering-leader mind has no doubt, it’d tell the devs to automate the hell out of replicating the test suite and not be picky about how. But I bet that it’d burn a whole lot of tokens, which means routing money to bad people with bad goals. So once again, I’m not going to do it with LLMs.

Post-bubble, it might be somewhere between forgivable and praiseworthy. But not as I write this.



Contributions

Comment feed for ongoing:Comments feed

From: Dave Pawson (Oct 24 2026, at 00:28)

" the biggest issue isn’t what GenAI can and can’t do, it’s the ethical and economic discomforts. This technology is being peddled by terrible people who are rich and whose goal is to get richer."

I'm sure humanity has met this before with other 'stuff'. Can we learn from history?

That's without the slow takeup of websites blocking AI bots, which may impact growth.

[link]

From: Nathan (Oct 24 2026, at 17:08)

I've found "this activity routes money to bad people" to be a game that's frustrating, futile, and drenched in (usually unintentional) hypocrisy.

For one, in Western-style capitalism it's almost a truism that all roads lead to bad people. If you follow the supply chain all the way back you will surely find someone -- probably several someones -- whose politics or morals or actions you find repugnant.

For two, avoiding the whipping boy du jour sometimes requires a pivot to another supplier which is no less reprehensible, if possibly less shunned by the zeitgeist.

If you choose not to partake altogether, it then can underline those areas of your life where you have chosen to compromise, either through ignorance or expedience or just being so dang EXHAUSTED by the effort of trying to lead a moral life here in 2026.

I'm not saying to go ahead and put dollars in the pockets of fascists and pedophiles and the worst dregs humanity can cough up, but it's easy to get that warm glow of self-righteousness when bypassing a certain problematic business, only to ignore the fact that mere existence in Western civilization is to feed the beast that eats our planet and our young.

[link]

From: Jim (Oct 26 2026, at 05:07)

Thanks for writing this, and writing in general on a blog with RSS. I do the same re: LLMs, and it’s always nice to be less lonely.

This is indeed a symptom of capitalism. Another one is making you think there’s no point in fighting it because there’s no other way and that the world is doomed to climate catastrophe so you just get yours right now without worrying about others.

Capitalism isn’t all that old in the context of history, and there are other ways to exist. Many big changes seemed impossible before they happened, and that people that fought them were wasting their time.

[link]

From: Len Bullard (Oct 30 2026, at 09:04)

From my perch and ignoring the political social hysteria, the advantages are undeniable and the code is good enough. My concerns are conversion pipelines and the stability of the governing standards over the rendering systems. Bit twiddling is largely a nuisance particularly when it arrives wrapped in social engineering. There is a point of view that if the code in MCCF enables a ten year old to build real time 3D for a web of freestanding worlds, thus learning basic concepts of math, music, video, audio and graphics production for low to no cost, it’s worth the risks. LLMs are practical from that point of view.

len

[link]

From: Bob (Nov 02 2026, at 08:53)

Nathan kind of hits the nail on the head, unfortunately: the only real solution to the problem of bad people coveting wealth and abusing power is to abolish capitalism and end Western civilization, neither of which are better than any of the alternatives and neither of which has contributed anything good to the world. Despite the progress being made in US at the moment, sadly these systems are fairly entrenched, and one must meantime simply figure out the least morally repulsive way to live with them.

[link]

From: ForeverYoung (Nov 08 2026, at 17:44)

The current future of AI technologies doesn't look very local. Stadia and such tried to make cloud-based gaming with GPUs, but it didn't work. LLMs have many of the benefits of something like high utilization in a data center while requiring less bandwidth, latency, and customizations. It might even be less location sensitive than cloud hosting.

[link]

author · Dad
colophon · rights
picture of the day
October 19, 2026
· Technology (90 fragments)
· · AI (20 more)
· · Quamina Diary (27 more)

By .

The opinions expressed here
are my own, and no other party
necessarily agrees with them.

A full disclosure of my
professional interests is
on the author page.

I’m on Mastodon!