Hacker News: adileo

New comment by adileo in "How I Made Google's "Web" View My Default Search"

adileo — Wed, 22 May 2024 10:43:45 +0000

Absolutely spot on. Additionally, it's worth mentioning that a lot of content is now locked behind a few major platforms (eg. Facebook, LinkedIn, Medium, YouTube, etc.) or CDNs like Cloudflare, which often block crawling from non-Google IPs or well-known search engines.

While the other costs mentioned here can be optimized with current hardware prices and a good database, anti-crawling measures necessitate thousands of IPs/proxies, making the process even more challenging and costly.

New comment by adileo in "RemotePN: Pause your script and wait for a manual prompt on Telegram"

adileo — Tue, 09 Apr 2024 19:59:49 +0000

I created RemotePN because I needed an OTP input during the execution of a server automated cron process. This solution is particularly useful in scenarios where you want to pause the execution of your script and await manual prompts or responses from users via Telegram. It's helpful for tasks where user input or confirmation is necessary before proceeding with further actions.

RemotePN: Pause your script and wait for a manual prompt on Telegram

adileo — Tue, 09 Apr 2024 19:59:49 +0000

Article URL: https://github.com/adileo/remotepn

Comments URL: https://news.ycombinator.com/item?id=39983596

Points: 4

# Comments: 1

New comment by adileo in "Moving Away from UUIDs (2018)"

adileo — Tue, 22 Nov 2022 00:13:16 +0000

I made a comparison list with the most known uuids out there, a couple of days ago, it was quite fun discovering all the different kinds of uid and their pros/cons.

https://adileo.github.io/awesome-identifiers/

New comment by adileo in "Choosing the best database primary key – INT and UUIDs alternatives"

adileo — Sat, 05 Nov 2022 00:36:53 +0000

Very interesting insight, as you say, probably ORMs instilled this way of thinking, while the primary key is not just constrained to that function I perfectly agree with that.

* at the cost of dealing with long keys creating large indexes and more cache thrashing in the RDBMS. *

This is actually one of the point I'm currently dealing with. Especially finding the right trade-off to manage records in the order of hundred millions/billions, the right decision could save GB of space both on disk and RAM and seconds in computation during each JOIN operation for example.

That's why I drafted out a comparison table, sometimes I see people start using UUIDs right away just because they are offered as out of the box in some ORMs or just because it souds "cool", without knowing that there are better or simplier alternatives out there.

New comment by adileo in "Choosing the best database primary key – INT and UUIDs alternatives"

adileo — Fri, 04 Nov 2022 21:32:41 +0000

Author here, you're correct, the title is misleading and assumes a match between surrogate and primary keys in a simplistic way, especially for when you can't make use of a natural key. (most of the cases in the domain I work in)

If you can't identify a natural key that indicates failure to normalize or even the wrong model of the data.

I'm not sure about this point. As a matter of fact a lot of entities in the real world do not have a natural key, or if they have it, it could be subject to changes. How do you identify a user or an anonymous post on a forum?

Maybe for an user you could just use the email. Then, what if the user want to change their email? Or what if one day you want to allow users to sign-up with just their social login?

Surrogate keys are always a good level of indirection to keep a consistent identity, and especially useful as foreign key and hence also as a primary key. Of course with some exceptions (eg. intermediate tables, where the PK is spanning across multiple columns)

But I'm curious to know also other scenarios since my view is skewed by the business domain I work in.

New comment by adileo in "Choosing the best database primary key – INT and UUIDs alternatives"

adileo — Fri, 04 Nov 2022 19:03:52 +0000

While working on a big data & distributed system, I started questioning myself on which is the best database primary key to be used in terms of performance, security and, functionality. Despite some articles on Stackoverflow and a couple of blog post around the web highlighting the pros of some identifiers against others, I didn't found a complete overall picture. So I decided to create this comparison table.

My next step is to understand the best way to not expose the primary key to the world, maybe an additional column with a public random id? Maybe encoding/decoding the PK with some cryptographycally secure algorithm in the REST API layer? Or better a key-value mapping cache layer between the public Id and the internal Primary Key?

Every insight is welcomed.

Choosing the best database primary key – INT and UUIDs alternatives

adileo — Fri, 04 Nov 2022 19:03:52 +0000

Article URL: https://adileo.github.io/awesome-identifiers/

Comments URL: https://news.ycombinator.com/item?id=33472027

Points: 4

# Comments: 6

New comment by adileo in "Using forums vs. Discord: why not both"

adileo — Tue, 09 Nov 2021 13:30:17 +0000

I understand, I've been in the same situation before, not recommending it to anyone. Having more than 2 or 3 tools is like having no tool at all or worst. This idea was born more for Open Source communities or hobbyst, etc. rather than companies. So yeah I agree the headline here is a little bit misleading in that sense.

Usually these kind of communities probably need that their content should be indexable by Google or other search engines in order to be discovered by new users. So in my mind it shouldn't dilute the attention of the community members. Of course it's still a proof of concept and every feedback is super welcomed to understand better the environment

New comment by adileo in "Using forums vs. Discord: why not both"

adileo — Tue, 09 Nov 2021 13:15:33 +0000

That's a very good point, the idea is to allow the moderators to pick the best content through the help of a Discord bot. Of course I recognize the content shared won't be on par with the one you can find on a Forum but that depends a lot on how the community is using threads. I'm working also on a way to filter out meaningless content or at least help moderators in repurposing only the best content they have on Discord. The other way around seems also a very good idea, I'll think about it for sure

New comment by adileo in "Using forums vs. Discord: why not both"

adileo — Tue, 09 Nov 2021 12:35:40 +0000

I've seen a trending post on HN about the disavantages of using Discord vs a Forum. Coincidentally I've been working on a solution for that in the past weeks that allows you to create a mirrored version of your Discord server as an online forum.

Original thread: https://news.ycombinator.com/item?id=29154216

Using forums vs. Discord: why not both

adileo — Tue, 09 Nov 2021 12:35:40 +0000

Article URL: https://www.channelsync.chat/

Comments URL: https://news.ycombinator.com/item?id=29160885

Points: 2

# Comments: 6

New comment by adileo in "Use forums rather than Slack/Discord to support developer community"

adileo — Tue, 09 Nov 2021 12:22:48 +0000

Or maybe you can do both, that's the reason behind the tool I'm building right now: https://www.channelsync.chat/ In this way you can mitigate #1 "the memory hole" and also the #2 "Google can’t see inside chats" while creating a mirrored forum version of the best content you have on Discord.

It's still in closed alpha right now. But I would love to know what you think about it.

MicroFrontier – an open source URL frontier for Web Crawlers built with Redis

adileo — Tue, 02 Nov 2021 20:05:57 +0000

Article URL: https://github.com/adileo/MicroFrontier

Comments URL: https://news.ycombinator.com/item?id=29086715

Points: 2

# Comments: 0