Hacker News: digitallyfree

New comment by digitallyfree in "OPNsense: Open-source security platform"

digitallyfree — Tue, 27 Jun 2023 04:24:13 +0000

If you want to take it even further a fully virtualized Opnsense with Proxmox is amazing. Your router can float between cluster nodes and each VLAN becomes a virtual interface in the hypervisor. What still blows my mind is how I can migrate the instance to a second server and bring the original server down for maintenance without my users noticing a thing.

New comment by digitallyfree in "BrowserBox Pro goes open-source"

digitallyfree — Sun, 25 Jun 2023 03:21:22 +0000

Since you're releasing this under GPLv3 this is indeed open source. Having multiple license options does not affect this.

New comment by digitallyfree in "OpenLLaMA 13B Released"

digitallyfree — Sun, 18 Jun 2023 17:18:59 +0000

It's not a community per se but there's a lot of research and discussion going on directly in the llama.cpp repo (https://github.com/ggerganov/llama.cpp) if you're interested in the more technical side of things.

New comment by digitallyfree in "Ask HN: What are some of the best Reddit alternatives?"

digitallyfree — Thu, 15 Jun 2023 20:32:54 +0000

It certainly looks like it if you check their discussion board.

New comment by digitallyfree in "Stack Overflow Is Down"

digitallyfree — Thu, 15 Jun 2023 14:25:37 +0000

Likely it's hosted on the same infrastructure. The general recommendation is to host the status page on different provider so it's more likely to stay up.

New comment by digitallyfree in "[dead]"

digitallyfree — Tue, 13 Jun 2023 21:11:06 +0000

It's not even source code, it's the fact that this just looks super sketchy in general. The website http://faction504.com/ listed just links directly to the Play Store page. There's no info on what Blackpage does or who runs it.

New comment by digitallyfree in "AMD Expands AI Product Lineup with GPU-Only Instinct Mi300X with 192GB Memory"

digitallyfree — Tue, 13 Jun 2023 19:08:29 +0000

The issue with AMD and AI is, as always, the software stack. Even if the hardware is great ROCM simply doesn't have industry traction and accessiblity.

New comment by digitallyfree in "Show HN: Non.io, a Reddit-like platform Ive been working on for the last 4 years"

digitallyfree — Mon, 12 Jun 2023 18:05:49 +0000

If you ask me to make an account before I can see your content (even if it looks interesting) that's a turn off and I'll go somewhere else. Maybe have a button at the top that says "explore as guest" or something like that?

Also you should advertise that this is an open-source project on the landing page, as that may cause more people to be interested in trying it out.

New comment by digitallyfree in "Cloudflare Is Having Issues"

digitallyfree — Mon, 12 Jun 2023 16:07:40 +0000

I don't like the centralization of Cloudflare, but it's the only way I can host public web pages out of my homelab with a DSL connection. I would rather have a CDN than put my content on a VPS as the servers remain 100% under my control and I can change providers anytime.

New comment by digitallyfree in "The case for the decentralization of online forums"

digitallyfree — Sat, 10 Jun 2023 21:47:43 +0000

If we look at this from a technical perspective, what is the cost of running such a service?

Something like Facebook obviously costs a lot more to run, as it stores photos and video and also provides each user with an individually generated feed. In contrast HN is rather lightweight and basically serves mostly static cachable content to all users. I believe it was stated somewhere that the entire HN comfortably runs on a 64GB 4/8 bare metal server. On the extreme side I host my personal static web site on my home DSL connection fronted by Cloudflare, as the CDN does all the work and the bandwidth used is minimal.

To the people running these new communities the software cost is low as they're based off an open-source service of choice (Lemmy, Mastodon, etc.), and as we saw on Reddit moderation can be done by volunteers. Are the remaining costs for admins, hosting, etc. feasible for a non-profit with some user donations? And can we create more efficient platforms with a plainer style that will minimize the server and electricity costs?

New comment by digitallyfree in "Reddit CEO doubles down on attack on Apollo developer in drama-filled AMA"

digitallyfree — Fri, 09 Jun 2023 23:09:37 +0000

Yeah as a long-time user I was really hoping for that myself, or at least have some sort of compromise. Certainly not that trainwreck of an AMA.

New comment by digitallyfree in "A Swedish startup’s bid to build a green rival to AWS"

digitallyfree — Fri, 09 Jun 2023 22:00:34 +0000

Wouldn't that be Hetzner?

New comment by digitallyfree in "Reddit's Recently Announced API Changes, and the future of /r/blind"

digitallyfree — Wed, 07 Jun 2023 20:23:29 +0000

It's not easy to move a group to a new platform, and there's very little people using Lemmy currently. The thing about Reddit despite its flaws is that it allows access to many large communities with a single account.

New comment by digitallyfree in "GGML – AI at the Edge"

digitallyfree — Tue, 06 Jun 2023 21:28:39 +0000

OpenLLAMA will be released soon and it's 100% compatible with the original LLAMA.

https://github.com/openlm-research/open_llama

New comment by digitallyfree in "GGML – AI at the Edge"

digitallyfree — Tue, 06 Jun 2023 21:15:18 +0000

The fact that this is commodity hardware makes ggml extremely impressive and puts the tech in the hands of everyone. I recently reported my experience running 7B llama.cpp on a 15 year old Core 2 Quad [1] - when that machine came out it was a completely different world and I certainly never imagined how AI would look like today. This was around when the first iPhone was released and everyone began talking about how smartphones would become the next big thing. We saw what happened 15 years later...

Today with the new k-quants users are reporting that 30B models are working with 2-bit quantization on 16GB CPUs and GPUs [2]. That's enabling access to millions of consumers and the optimizations will only improve from there.

[1] https://old.reddit.com/r/LocalLLaMA/comments/13q6hu8/7b_perf...

[2] https://github.com/ggerganov/llama.cpp/pull/1684, https://old.reddit.com/r/LocalLLaMA/comments/141bdll/moneros...

New comment by digitallyfree in "First impressions: Yes, Apple Vision Pro works and yes, it’s good"

digitallyfree — Tue, 06 Jun 2023 13:05:17 +0000

Likely you can use a Bluetooth keyboard and mouse with it.

New comment by digitallyfree in "Apple unveils new Mac Studio and brings Apple Silicon to Mac Pro"

digitallyfree — Mon, 05 Jun 2023 19:56:34 +0000

It also doesn't have ECC as well which was a staple of the previous Mac Pro line.

New comment by digitallyfree in "Teddit – An alternative Reddit front-end focused on privacy"

digitallyfree — Thu, 01 Jun 2023 00:11:56 +0000

I personally like the Adminforge instance https://teddit.adminforge.de. It's much quicker than the original teddit.net.

New comment by digitallyfree in "AI Is Catapulting Nvidia Toward the $1 Trillion Club"

digitallyfree — Fri, 26 May 2023 18:24:58 +0000

Theoretically the ARC should work with llama.cpp using OpenCL, but I haven't seen benchmarks or even a confirmation that it works.

New comment by digitallyfree in "The tiny corp raised $5.1M"

digitallyfree — Thu, 25 May 2023 02:38:17 +0000

I think the tinybox is meant to be a training/inference server meant for tinygrad and filled with those AMD cards. Very likely it will run Linux.