I think it probably wouldn’t be as weird if the project were a meaningfully different fork of it, but it sounds like it’s trying to accomplish the same goals as the open source project which I feel should probably be ported back? and renaming it seems sorta ungrateful? Kinda like that “you made this? I made this” meme. Maybe I just don’t have an understanding of how different the projects are though…

Comments URL: https://news.ycombinator.com/item?id=45891035

Points: 17

# Comments: 10

Comments URL: https://news.ycombinator.com/item?id=45461926

Points: 3

# Comments: 0

Were I building something that I would want to assert the level of privacy claims that ICEBlock asserts, I would absolutely be taking any/all reports about security extremely seriously.

"Whenever the President shall find as a fact that any foreign country places any burden or disadvantage upon the commerce of the United States by any of the unequal impositions or discriminations aforesaid, he shall, when he finds that the public interest will be served thereby, by proclamation specify and declare such new or additional rate or rates of duty as he shall determine will offset such burden or disadvantage, not to exceed 50 per centum ad valorem or its equivalent, on any products of, or on articles imported in a vessel of, such foreign country"

it does cap it at 50%, but I mean it seems like a much easier way to justify the tariff. is there something else about it that isn't as practical (other than being almost 100 years old)

Comments URL: https://news.ycombinator.com/item?id=43675398

Points: 2

# Comments: 0

> Second, we develop budget forcing to control test-time compute by forcefully terminating the model's thinking process or lengthening it by appending "Wait" multiple times to the model's generation when it tries to end

I'm feeling proud of myself that I had the crux of the same idea almost 6 months ago before reasoning models came out (and a bit disappointed that I didn't take this idea further!). Basically during inference time, you have to choose the next token to sample. Usually people just try to sample the distribution using the same sampling rules at each step.... but you don't have to! you can selectively insert words into the the LLM's mouth based on what it said previously or what it wants to say, and decide "nah, say this instead". I wrote a library so that you could sample an LLM using llama.cpp in swift and you could write rules to sample tokens and force tokens into the sequence depending on what was sampled. https://github.com/prashanthsadasivan/LlamaKit/blob/main/Tes...

Here, I wrote a test that asks Phi-3 instruct "how are you" and it if it tried to say "as an AI I don't have feelings" or "I'm doing " I forced it to say "I'm doing poorly" and refuse to help since it was always so dang positive. It sorta worked, though the instruction tuned models REALLY want to help. But at the time I just didn't have a great use case for it - I had thought about a more conditional extension to llama.cpp's grammar sampling (you could imagine changing the grammar based on previously sampled text), or even just making it go down certain paths, but I just lost steam because I couldn't describe a killer use case for it.

This is that killer use case! forcing it to think more is such a great usecase for inserting ideas into the LLM's mouth, and I feel like there must be more to this idea to explore.

Comments URL: https://news.ycombinator.com/item?id=42339379

Points: 6

# Comments: 0

And that's a very strange reason to be skeptical of womens' description of their symptoms in a medical setting. Is there evidence that women are more prone to 'social contagion'? You yourself said that "women are more prone to auto immune diseases" and that they are known to be triggered by viruses...To me, skepticism (and in my view, cynicism) of patients is one of the major contributors to distrust of evidence based medical advice.

Taking your last anecdote as an example, just because the patient's self diagnosis is likely incorrect, that does not mean that the symptoms they're experiencing are all "made up" and should be met with skepticism. There may be other reasons they're experiencing symptoms. A doctor shouldn't just say "Because you thought it was long COVID even though you weren't diagnosed with COVID, I'm convinced you're making the whole thing up". That's just lazy and unsound.