It instead embeds a bunch of runtimes onto the same OS thread.

I have a tweak that allows pasting images to claude code over SSH:

How it works:

PTY Interception: It creates a pseudo-terminal (PTY) to wrap the SSH process, allowing it to sit as a "man-in-the-middle" between your keyboard and the remote shell.

Bracketed Paste Detection: It monitors stdin for "bracketed paste" sequences (the control codes terminals send when you Cmd+V or drag-and-drop a file).

The "Hook": When a paste occurs, it pauses execution and scans the text for local macOS file paths.

Auto-Sync: If a local path is found, it immediately syncs that file to the remote server (using the provided SSH key) in the background.

Transparent Forwarding: Once the sync is complete, it forwards the original text to the shell.

You can drag and drop a file from your local Finder into a remote SSH session, and the file is automatically uploaded to the server before the path appears on the command line. Also works with copy paste, screnshots.

OpenAI-compatible endpoint: https://ch.at/v1/chat/completions (supports streamed responses)

Also accessible via HTTP/SSH/DNS for quick tests: curl ch.at/?q=… , ssh ch.at Privacy note: we don’t log anything, but upstream LLM providers might...

Also, I wonder if this could be adapted to use Apple's Hypervisor.framework. That one also doesn't require root and ought to be able to spin up and down very quickly.

However, we don't parse markdown on the server and convert to HTML. Rather, we just prompt the model to emit HTML directly.

It has not been expensive to operate so far. If it ever changes we can think about rate limiting it.

We used GPT4o because it seemed like a decent general default model. Considering adding an openrouter interface to a smorgasbord of additional LLMS.

One day, on a plane with WiFi before paying, I noticed that DNS queries were still allowed and thought it would be nice to chat with an LLM over it.

We are not logging anything but OpenAI must be...