Hacker News: karimf

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Tue, 07 Apr 2026 09:27:06 +0000

Well, on my demo it's around 2.5s and I already consider it as a "real-time". One way to improve it is to disable the image input.

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Tue, 07 Apr 2026 06:08:43 +0000

What's your average response time with M1 max and what's the target?

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Tue, 07 Apr 2026 06:07:12 +0000

Is this the problem? https://news.ycombinator.com/item?id=47669954

New comment by karimf in "Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS"

karimf — Tue, 07 Apr 2026 00:02:45 +0000

In the /r/macapps subreddit, they have huge influx of new apps posts, and the "whisper dictation" is one of the most saturated category. [0]

>“Compare” - This is the most important part. Apps in the most saturated categories (whisper dictation, clipboard managers, wallpaper apps, etc.) must clearly explain their differentiation from existing solutions.

https://www.reddit.com/r/macapps/comments/1r6d06r/new_post_r...

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Mon, 06 Apr 2026 16:25:21 +0000

During my limited testing, it works better than I expected at handling multiple languages in a single session. Perhaps I just had a low expectation since I've mostly worked with English-only STT models.

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Mon, 06 Apr 2026 16:20:51 +0000

Nothing unique, it's just taking a snapshot when it's processing the input. Even processing a single image will increase the TTFT by ~0.5s on my machine, so for now, it seems to be impossible for feeding a live video and expecting a real-time response.

In regards to the video capability, I haven't tested it myself, but here's a benchmark/comparison from Google [0]

[0] https://huggingface.co/blog/gemma4#video-understanding

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Mon, 06 Apr 2026 16:11:30 +0000

Huh that's weird. I just tried it and it works on my machine. Could you perhaps create a GitHub issue and share the reproduction steps and any relevant logs?

New comment by karimf in "I won't download your app. The web version is a-ok"

karimf — Mon, 06 Apr 2026 15:09:50 +0000

This. I posted this on my other comment, but there's a meme that "Gen Z Kids Don't Understand How File Systems Work" [0].

There seems to be a disconnect between some developers and the younger folks.

[0] https://news.ycombinator.com/item?id=30253526

New comment by karimf in "I won't download your app. The web version is a-ok"

karimf — Mon, 06 Apr 2026 15:04:43 +0000

This is my stance as well, but keep in mind that a lot of people have the opposite preference.

They didn't grow up with the world wide web. They only started using technology when Android and iPhone was popular. They only know Whatsapp, Youtube, TikTok. They're not used to using the browser.

There's a meme that "Gen Z Kids Don't Understand How File Systems Work" [0]

So, it'll depend on your target audiences.

[0] https://news.ycombinator.com/item?id=30253526

New comment by karimf in "Gemma 4 on iPhone"

karimf — Mon, 06 Apr 2026 06:10:37 +0000

Oh wow, that's awesome. Thanks a lot, dang!

New comment by karimf in "Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B"

karimf — Mon, 06 Apr 2026 05:52:47 +0000

Thank you. This reminds me of a paragraph from the LatentSpace newsletter [0]

> The excellent on device capabilities makes one wonder if these are the basis for the models that will be deployed in New Siri under the deal with Apple….

https://www.latent.space/p/ainews-gemma-4-the-best-small-mul...

New comment by karimf in "Gemma 4 on iPhone"

karimf — Mon, 06 Apr 2026 05:44:54 +0000

Thanks for sharing! I'm still torn about it. Sure it'll feel more natural if you have the AI head animation, but I don't want people to get attached to it. I don't want to make the loneliness epidemic even worse.

New comment by karimf in "Gemma 4 on iPhone"

karimf — Sun, 05 Apr 2026 21:24:00 +0000

Thanks! Although, I can't claim any credit for it. I just spent a day gluing what other people have built. Huge props to the Gemma team for building an amazing model and also an inference engine that's focused for edge devices [0]

[0] https://github.com/google-ai-edge/LiteRT-LM

New comment by karimf in "Gemma 4 on iPhone"

karimf — Sun, 05 Apr 2026 20:51:46 +0000

This app is cool and it showcases some use cases, but it still undersells what the E2B model can do.

I just made a real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B. I posted it on /r/LocalLLaMA a few hours ago and it's gaining some traction [0]. Here's the repo [1]

I'm running it on a Macbook instead of an iPhone, but based on the benchmark here [2], you should be able to run the same thing on an iPhone 17 Pro.

[0] https://www.reddit.com/r/LocalLLaMA/comments/1sda3r6/realtim...

[1] https://github.com/fikrikarim/parlor

[2] https://huggingface.co/litert-community/gemma-4-E2B-it-liter...

New comment by karimf in "Google releases Gemma 4 open models"

karimf — Sun, 05 Apr 2026 19:49:36 +0000

Update: Just made one that runs on Macbook M3 Pro https://github.com/fikrikarim/parlor

Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

karimf — Sun, 05 Apr 2026 17:53:19 +0000

Comments URL: https://news.ycombinator.com/item?id=47652007

Points: 287

# Comments: 35

New comment by karimf in "OpenScreen is an open-source alternative to Screen Studio"

karimf — Sun, 05 Apr 2026 01:29:09 +0000

Nice project. I thought of building exactly this.

Since it's much easier to port source code to other languages now, I'd love to see more projects like written in Swift, or C#.

New comment by karimf in "Show HN: Apfel – The free AI already on your Mac"

karimf — Fri, 03 Apr 2026 16:35:09 +0000

The big question is whether Apple can keep shipping new models constantly.

AFAIK the current model is on par with with Qwen-3-4B, which is from a year ago [0]. There's a big leap going from last year Qwen-3-4B to Qwen-3.5-4B or to Gemma 4.

Apple model is nice since you don't need to download anything else, but I'd rather use the latest model than to use a model from a year ago.

https://machinelearning.apple.com/research/apple-foundation-...

New comment by karimf in "Google releases Gemma 4 open models"

karimf — Fri, 03 Apr 2026 06:22:13 +0000

Thank you for the kind words!

New comment by karimf in "Ollama is now powered by MLX on Apple Silicon in preview"

karimf — Thu, 02 Apr 2026 23:03:32 +0000

Ok it's on the app store now: https://apps.apple.com/app/volocal/id6761493288