Hacker News: jwyang

New comment by jwyang in "Magma: A foundation model for multimodal AI agents"

jwyang — Thu, 20 Feb 2025 08:04:13 +0000

very good question, now we are mainly focusing on building the foundtion for multimodal perception and atomic action taking. Of course, integrating the trace-of-mark prediction for robotics and human video data enhances the model's medium length reasoning but this is not sufficient for sure. The current Magma model will serve as the basis for our next step, i.e., longer horizong reasoning and planning! We are exactly looking at this part for our next version of Magma!

New comment by jwyang in "Magma: A foundation model for multimodal AI agents"

jwyang — Thu, 20 Feb 2025 07:34:30 +0000

ops, a typo, no M from Microsoft.

New comment by jwyang in "Magma: A foundation model for multimodal AI agents"

jwyang — Thu, 20 Feb 2025 06:29:52 +0000

Thanks for your great interests on our Magma work, everyone!

We will gradually roll out the inference/training/evaluation/data preprocessing code on our codebase: https://github.com/microsoft/Magma, and this will be finished by next Tuesday. Stay tunned!

New comment by jwyang in "Magma: A foundation model for multimodal AI agents"

jwyang — Thu, 20 Feb 2025 06:26:23 +0000

Good catch! A minor correction: Magma - M(ultimodal) Ag(entic) M(odel) at M(icrosoft) (Rese)A(rch), the last part is similar to how the name Llama came out, :)

New comment by jwyang in "Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vision"

jwyang — Thu, 09 Nov 2023 19:13:51 +0000

Here are other related links:

code: https://github.com/microsoft/SoM

demo: https://user-images.githubusercontent.com/3894247/281586831-...