In my experience, it is incredibly hard, practically impossible, to find a lawyer who will even talk to you. I think this is a valid use case to get at least some understanding what the next steps might be and if it even makes sense to seek legal representation.

Comments URL: https://news.ycombinator.com/item?id=47911058

Points: 2

# Comments: 0

Comments URL: https://news.ycombinator.com/item?id=47768374

Points: 2

# Comments: 0

Comments URL: https://news.ycombinator.com/item?id=47543548

Points: 6

# Comments: 0

[1]: https://github.com/p0deje/vagrant-mosh

I'm Alex, a tech lead of the Selenium project and a QA engineer. For the last 10 months, I've been working on Alumnium - a test automation library that should make my life easier and let me write less code when automating the tests. The goal is to use LLM for _automating_ so I could focus more on _testing_.

Unlike other similar projects, Alumnium can be used in existing tests without changes to test runners, reporting tools, or any other test infrastructure. This allows me to gradually migrate my test suites (mostly Selenium) and revert whenever something goes wrong (this happens a lot, to be honest).

Other major differences:

- cheap (works on low-tier models like gpt-4o-mini, costs $20 per month for 1k+ tests)

- not an AI agent (dumb enough to fail the test rather than working around to make it pass)

- fast thanks to a built-in caching

- supports both mobile (Appium) and web (Playwright, Selenium)

- supports completely local execution (Ollama)

The project is still in a very much experimental phase, but I'd be happy to get any feedback.

Comments URL: https://news.ycombinator.com/item?id=44136372

Points: 10

# Comments: 2

Keep working on a test automation library that should allow writing browser/mobile tests easier with LLMs help, so I could focus more on testing, and less on automating.

Comments URL: https://news.ycombinator.com/item?id=44032263

Points: 14

# Comments: 2

I misunderstood looking at demo videos, it seemed like you constantly update elements with borders/IDs so I assumed that's what is then passed to vision.

> Do you have any great resources on where to get started?

A great place to start is https://chromium.googlesource.com/chromium/src/+/main/docs/a....

How would you determine that something changed in UI by just looking at a screenshot? Would you additionally compare HTML/DOM or approximate the two screenshots?

> Omini parser lets you split section of the UI to hash and watch for changes that are relevant.

I wasn't aware, thanks for sharing!

> For 2, can you give some examples?

Specifically, if you take the Shortest tool (https://shortest.com), a test runner powered by Computer Use API, write a test "Validate the task can be pinned" for https://todomvc.com/examples/vue/dist/, and run it — it passes. It should have failed because there is no way to "pin" tasks in the app, yet it pretends that completing the task is the same as pinning.

1. It's unreasonably expensive. A single test "2+2=4" for a web calculator costs around $0.15. I run roughly 1k tests per month on CI and I don't want to spend $150 on those. The approach I took with Alumnium costs me $4 per month for the same amount of tests.

2. It tries too hard to make the test pass even when it's not possible. When I intentionally introduced bugs in applications, Computer Use sometimes pretended the everything was fine and marked the test passed. Alumnium on the other hand attempts to fail as early as possible.

I aim to create a stable and affordable tool that allows me to eliminate most of the support code I write for web tests (page objects, locators, etc.) and replace it with human-readable actions and assertions. These actions and assertions are then translated by an LLM into browser instructions. The tool, however, should still leverage all existing infrastructure (test runner, CI/CD, Selenium infrastructure).

So far, it's working well on simple websites (e.g., a calculator, TodoMVC), and I'm currently working on scaling it to large web applications.

Comments URL: https://news.ycombinator.com/item?id=41556742

Points: 7

# Comments: 2

Comments URL: https://news.ycombinator.com/item?id=29962916

Points: 2

# Comments: 0

Comments URL: https://news.ycombinator.com/item?id=28435129

Points: 3

# Comments: 0