But I'll post it in a hacker news comment and maybe you all will give it enough traffic I can get excited about it again, lol

https://www.unscatter.com

I wish I had time to mess with it more. Job and life has taken over. My first goal with AI would be to use it to for key word and phrase extraction and also analyzing all the links I pull in hourly to see if there is a larger story I could make visible.

It's not monetized but it's also only costing me less than $50 a month in hosting and cloudflare costs to support.

Did that to some degree. Unscatter.com pulls from reddit and twitter to source links.

I found reddit only created an echo chamber bubble of obvious bias and twitter only diluted it a little.

Kanye West - Gold Digger Kanye wants Billie Eilish to say sorry or he'll pull out of Coachella Kanye West: ‘Stop Asking Me to Do NFTs... Ask Me Later’ Kanye West Does Not Want to Get Involved With NFTs Kanye West Rejects NFTs, Tells Fans To Stop Asking: 'I Make Music In The Real World'

So long story short, I think I may need to consider increasing my pull. Going from the top 100 of the top 100 to maybe the top 1000 of the top 100 or the top 100 of the top 1000. I'll have to do some research and also validate my crawl can support it.

The lack of Kanye West content is interesting. I'm going to try to find some time this weekend to dive into that. The only thing I can think of is it's so well known less people are sharing links and more people are just making text posts on reddit about it.

However, it could be an indexing issue too. I'm using postgres for the index so maybe there is something there. I'll research that. Thanks for noticing and calling it out!

This discussion did make me poke around some more. I may consider using the free tier of Bing's api just to pull in trending topics.

The concern of it being an echo chamber is one of the major reasons I added Twitter and I still look for more sources. For most of Trump's presidency some form of his name was the top trend 24 hours a day. Crypto is another trend, that while it's great for me because I'm interested in it as well, I question if it's really reflective of what the world is talking about.

I have considered creating some sub-sites as well to try and dig more. Focusing on subreddits for specific categories, but the Twitter api (at least what I can afford which means free) isn't quite as flexible for doing that kind of thing while staying inside my api call limits.

I don't think it's a "better" search engine. It's a different lens through which to search. Reddit and Twitter are an information source for what people are talking about. This is why I limit my index to articles that have popped in my Reddit/Twitter input in the last 30 days, deleting anything older.

I've actually had it up for years now, just don't know what to do with it. Been focused on my career in IT rather than entrepreneurism because well, life. I can say just this morning I saw "Stanytsia Luhanska" pop as a trending term on the front page of Unscatter and at the time mainstream media has not picked up the story of the school being hit by Russian shells.

I think over all the quality results still come from Reddit. Twitter often gets gamed and I see content terms pop up in the trending list. However, Twitter overnight (my time, US East) gets a more international flavor with lots of Korean and other Asia Pac country content bubbling to the top during that time because of Twitter.

I use it as a sql database and full text search for little personal project I work on off and on and it works great. I haven't touched it except to check every few weeks for security updates for months since I got a promotion and it, the golang app server and python scripts have had no issue just churning along keeping a 30 day archive of links found via reddit and twitter. Postgres is great.

It's really fast, I like that. The amount of tags to choose from is a bit overwhelming.

Hope you get good responses here, the couple times I've posted my search engine I haven't gotten a lot of feedback.

Comments URL: https://news.ycombinator.com/item?id=25037495

Points: 1

# Comments: 0

Comments URL: https://news.ycombinator.com/item?id=22804854

Points: 3

# Comments: 0

For the past several years I've been working on https://www.unscatter.com as a hobby. Used it first as a project to keep up to date with python and a few years ago rewrote it to learn go.

For the past several years it's primarily been not much more than a proxy for APIs for sites like Faroo, Reddit, Youtube and Tumblr.

I recently just started a rebuild of the site that's now live. Instead of just being a proxy for API's, I now use the reddit api to determine what news is trending. Mostly I'm pulling from r/all, r/worldnews and r/news. I'm then pulling and analyzing the stories and creating a searchable index of them.

My goal is to have it act a 1 month archive of what news has been trending. What's driving me is what I have perceived as a lack of trust of the press based on my interactions with people. My goal with the Unscatter brand is to provide tools people can use to see if the press is giving them news or driving a message. This index is just the first tool I'm pushing out.

I am doing a Show HN in the hopes of getting some feed back. My goal is for it to be a 1 month archive, articles that haven't been seen by my fetcher in over a month will be deleted. I don't have the full 1 month archive and probably won't start deleting until June as I'm still tuning.

Another reason I'm doing the Show HN is to see if anyone has some suggestions on other sites that might have an API I can work with? I realize that pulling just from reddit I still risk getting a bias based off of the visitors of that site being their own small society. I'm hoping to find other sources to pull from in an attempt to try and avoid bias.

I should also note if you have a great tool you wish to sell me, at this time I don't have a real monetization strategy. I do serve adsense adds but I also have /search blocked in robots.txt so it's not like google can really tune the ads that well. This is 100% pure hobby, I'm only paying $20 a month for hosting.

Comments URL: https://news.ycombinator.com/item?id=16792992

Points: 2

# Comments: 0