Good example of a medical QA dataset shifting but not a good example of a medical "fact" since it is an opinion. Another way to think about shifting medical targets over time would be things like environmental or behavioral risk factors changing.

Anyways, thank you for putting this dataset together, certainly we need more third-party benchmarks with careful annotations done. I think it would be wise if you segregate tasks between factual observations of data, population-scale opinions (guidelines/recommendations), and individual-scale opinions (prognosis/diagnosis). Ideally there would be some formal taxonomy for this eventually like OMOP CDM, maybe there is already in some dusty corner of pubmed.

Location: Utica, NY Remote: Yes Relocation: Yes

Technologies: - Languages: Python, C, Java, Javascript, Haskell, R, LaTeX - Tools: Jupyter, Docker, Git, Slurm - Machine learning toolkits: Scikit-learn, PyTorch, Tensorflow, Pandas, Numpy

Resume: https://drive.google.com/file/d/0B9ld6yEz58mYenRYbW9nMFJLS1k...

I have experience reading and implementing state of the art deep learning papers within the domains of object detection, image generation and text understanding. I'm open to any job tangentially related to machine learning.

Remote: Yes

Willing to Relocate: Yes

Technologies: Python (PyTorch, Pandas, Scikit-Learn, Numpy, Jupyter), Java, R, C

Resume: https://pek.is

Email: arda@pek.is

I am a recent graduate from Georgia Tech. I have experience with machine learning workflows and I have deep knowledge of image generation methods. I am open to learning new technologies and domains as needed to support your business objectives.