I will say I have some feelings about Wayland and how hard it makes some stuff I do. I'm visually impaired and have a whole stack of tools. But this project has helped me port over 70-80% of those tools and it helps me bridge some gaps on Wayland temporarily so I can get infra set up. It's also great for the many sites that Claude blocks for whatever reason (Reddit, I am a sub mod but the a11y on Reddit is terrible, AmEx, LinkedIn).

Tine is a GNOME extension and CLI that lets an agent (I have used Claude but in theory any agent that can access the CLI) drive the desktop around using SPI trees (AT-SPI2), OCR, and visual fallbacks. Agent can do work with the a11y (AT-SPI2) trees, take screenshots, zoom in on a grid, click, enter text using a uinput device, and generally bumble their way around a Wayland Linux desktop.

This project would probably have been way easier in x11 but Wayland is teh future!!!111 Thanks for any thoughts and feedback and feels good to release something here after a decade of lurking. Decade plus but who's counting / I'm not old.

Comments URL: https://news.ycombinator.com/item?id=47781944

Points: 4

# Comments: 4

First, we've had these distros, about 5 of them. They're very hard to maintain and are all abandoned now. SOme of these were long-running projects but scale matters in these enterprises.

Second, you can't always use some custom distro. I work for a security company. For various reasons, it makes sense to use a small set of distros that have some major maintenance / royal road element.If I try running Slackware or some distro only maintained by one guy on my work machine, as a practical matter I'm putting my career in jeopardy when I can't do something basic and I ahve no explanation.

The reality is, this shit needs to get fixed. It's not a problem that's going to go away, blind folks aren't going to go away, though that would be really convenient for many, I guess. Let's just clean up this mess. Blind folks are trying to contribute and help, there have been some major breakthroughs lately, mostly because folks have somewhat less crappy attitudes and it's just gotten too ridiculous, but the attitude of "oh just go do this" has run its course, as has the RTFM and figure it out when you can't even get intital purchase on the system. Let's just grow up and clean up this mess, own it and get on board, no on'es asking you to fix this but at least don't be a pain from the sidelines and just say hey, this needs to happen, I support it.

- Adding hotkeys

- Replacing all my utilities that involve screenshot + OCR

- Making sure Orca works to some extent (low expectations here, but I need some of it to work)

- Reversing the gamma ramp

- Screen magnification

I have mapped out some approaches to most of these, but I full anticipate one or more to be show-stoppers or items I have to attempt to implement from scratch. I'm looking at 100 hours of work, minimum, to make this switch, and am basically just left out in the cold to figure all these workflows out under more hostile circumstances. It's also a chicken and egg, since I need to bootstrap into the new environment without any of my old tools working.

It's great that GNOME is taking some of this seriously, but they're forcing a very difficult transition, and it's frustrating that they think accessibility is in a usable state, or that we're low prioritiy enough to not matter. I'vbe heard the word "edge case" used a lot, it really stinks to be in a category where your entire computer use and professional career are considered an edge case.

https://fireborn.mataroa.blog/blog/i-want-to-love-linux-it-d...