Our approach was quite a bit different to Kiczales at the time. We had "attribute providers" which were essentially compiler plugin DLLs.

These plugins could register themselves at various parse points and add work like enzymes on the AST.

So here we have a compile time attribute that writes all the boilerplate to add windowing support to a class. Adding message maps, hooking up the dispatch, life cycle etc.

[Window] class MyWindow { };

It worked, but as others pointed out, it suffers from combinatorial explosion, and issues with debug ability.

That said, as long as you stick within well defined verticals it was still very useful and saved a lot of typing, and reduced cognitive load.

I have thought quite a lot about modern versions of this using LLMs and I can see why the article notices a parallel to prompts or spec based designs.

At some point I tried to make a version of the system we built almost 30 years ago, but using an LLM as the preprocessor instead of rigid AST hackery.

It works a lot better, and you can approach a more continuous interpolations between intent blocks and generated code. Even the combinatorial problem largely disappears.

I stopped working on it though because I couldn't really see anyone wanting to adopt a new language or some whacked out extensions these days.

Maybe it does have its place though in certain fields. It might be worth having another go at it with fresh hindsight.

Hmmm, the median house price is $2.1M.

> It's a good time to live in SF.

It seems pretty K shaped.

Great time to live in SF and Bay Area iff you are an AI researcher, founder, VC, executive at one of the hyper-scalers, or a senior engineer with massive equity package in the few winning companies.

Not entirely sure if it's a great time to live in SF if you work at a bakery, are a Barista at Starbucks or even a mid tier SWE.

Thoughts?

Can you post some images of lines getting garbled. That sounds like a genuine bug Anthropic might want to look into. I haven't seen that ever.

We need compute, yes, but we certainly aren't short of talent if we put our minds to it, and many of them are already here.

Should be able to turn the computer off at the mains half way through, then restart and instantly carry on without any loading phase as if nothing had happened.

Well that's the dream.

Now the lower layers work I'm mapping out the actual ECS part and what the API will be like.

I'm quite enjoying it and it's a really fun challenge.

No, but seriously, you could imagine what we witnessed playing out in a high stakes Tom Clancy or Michael Crichton style fable.

The fiery blowhard Pentagon chief, the arrogant know it all tech bro lab head, an alarm being called in from a remote office and surfaced through Amazon.

It almost writes itself.

But we can use your name for the novel.

"Bolt Cutter"

Has a nice ring to it.

Under such conditions we would be looking at Amazon's actions through a much more benevolent lens.

Not saying it has been, but it certainly crossed my mind as something worth doing regardless.

And also, even though Anthropic may not have labs themselves directly, there is a funnel of research that comes in the form of papers and conference tracks.

The AI community is pretty tight knit, and not having access to frontier models affects everyone.

Banning foreign nationals from using your technology only makes sense if you don't rely on foreign nationals to build it in the first place.

Or are we so far along now we think we don't need them anymore.

I'm wondering if they might go for a restricted access model that goes beyond passport or citizenship, where people can still use it, but you have to be individually vetted, and put on a list to get security clearance.

Thing is, hardly any games are optimized for ARM. And no serious AI development occurs on Windows.

I understand that you want multiple models running concurrently, but then 128GB is starting to look cramped.

It's a bold move that goes one to one against Apple and AMD Strix Halo.

I'm looking at it and thinking, if it can run Linux at a fair price it could be great.

I'm curious. I am thinking, what does a non developer buy this thing, take it home, and do with it.

What does the unboxing and first 24 hours look like?

A mixture of emotions somewhere between thinking you are living in the future, and frustration at not actually being able to do much.

The target audience seems like wealthy early adopters, but that is about it.

I guess we shall see.

It's quite different from llama.cpp, vLLM, or ZINC for example.

Written in Zig, and super clean, with no dependencies apart from Vulkan Compute itself of course.

While it supports multiple model families and features like an OpenAI compatibility server, a big thing is you can run it with strict time budgets running inside an existing Vulkan host.. think video games, AR/VR apps, edge devices, or robots.

In addition it supports a rich probe interface to research language model internals at close to real time.

I'm not trying to take on existing runtimes, those exist already. What I am trying to do is help inference work cooperatively with time sensitive applications.

Would love it if you checked it out.

Please let me know if you have any questions or ideas. Thanks!

Comments URL: https://news.ycombinator.com/item?id=47996427

Points: 3

# Comments: 0

They really need to get rid of human mods on there, it is completely toxic.

The idea is everyone posts in good faith, and AI moderates the posts before you send.

You can still go ahead if you don't agree with the moderation, so it isn't censorship, it's just that it provides a pause.

The AI also rates the posts and comments, just like you said.

I built it for precisely the reasons you said, because the way it is going, reddit is unsustainable.

I hope they change something.

The functions are optionally tested using formal verification. I plan to enable this by default soon, as time allows.

These functions that get written can then be composed, and enzymes that run in the cloud actively look for functions to fuse.

Also more people use it, the faster the compiler gets via network scaling laws.

It's very much research at the moment, but kinda works.

Jupyter Notebook style interface with the beginnings of some image and media support.

https://prometheus.entrained.ai

Can try looking at some of the examples or trying something yourself.

Would love some feedback.