I was talking about healthcare price transparency with a friend. He pointed me to a hearing in congress and I was surprised by how much I learned from one of the witnesses' testimonies so I built a "serendipity engine" for congress hearings.

My goal this week has been to index all insurers that publish machine readable files. For now, my project helps researchers and founders in the space access the data via API, it is not consumer-grade yet. But if you are interested in this data I would love to brainstorm ideas or share my knowledge. Shoot me a message.

Comments URL: https://news.ycombinator.com/item?id=48587531

Points: 2

# Comments: 0

I recently wrote a blog post using Min Hashing to estimate that at least 90% of the 1.17 petabyte dataset are duplicates and I keep investigating new ways of making this dataset manageable. https://www.felixhaba.com/writing/simplifying-healthcare-pri...

I will say, it would be great to see the color labeling done on domain url alone, to see how much of the topography of the map is driven simply by the different formatting characteristics of the websites you're gathering data from.

A silly example. Making GPT write a rap battle between Keynes and Mises goes beyond a performative remix, it is transformational work, nothing is copied explicitly. If a human were to write it that would not violate copyright.

I think that to tackle this we need a new lens other than copyright in the long term.