Sam Margolis

Projects

Research and open-source work led or built by Sam Margolis

DrugTargetWorld leaderboard
DrugTargetWorld
Simulated biobanks for training and grading AI scientists. First author.
OpenScribe
OpenScribe
Open-source, self-hostable AI medical scribe. Founder.
28% vs 2–3%
low-acuity over-triage, branded health AI vs the rest
TriageBench
9 patient-facing AI products, 540 simulated encounters. First author.

DrugTargetWorld

Sam Margolis is first author. Each world is a simulated biobank of 54,000 people (genotypes, proteins, records, outcomes, synthetic MRI) whose causal structure the agent can't see. Across 9 agents and 540 episodes, the top two scored 39.98 and 35.38 of 100; none reliably rejected decoy proteins.

paper · code · data · site · announcement

OpenScribe

Founded and maintained by Sam Margolis. An MIT-licensed AI scribe that turns a clinical encounter into a structured note and runs on hardware the clinic controls. 222 stars on GitHub; contributors include clinicians from NewYork-Presbyterian.

openscribe.org · GitHub · launch post

TriageBench

Led by Sam Margolis. 9 patient-facing AI products, 60 physician-written cases, 540 simulated conversations. Triage accuracy was similar across product types; referral behavior was not, and branded health apps steered patients to their own paid services.

preprint

On GitHub

Preclinical
Safety testing
Simulates adversarial patients against a healthcare agent, stores transcripts, and grades them against safety rubrics.
OpenEvals
Evaluation
An open set of evaluations for healthcare conversational agents.
allele-mech-pilot
Genomics
Predicts whether KCNQ1 variants cause long-QT or short-QT/AF, from public data.
GI-Board-Examination
Benchmark
The pipeline behind the gastroenterology model benchmark in npj Digital Medicine.
clinicaltrialqualifier
Trials
Checks whether a patient qualifies for a clinical trial.
Dr-GPT
Diagnosis
Takes a patient's symptoms and returns a differential diagnosis.
Mentat
Q&A
A bot that answers medical science questions.
github-stargazer-export
Tool
Exports a repo's stargazers to CSV with their public profile data.

Earlier

MediBand
2018–2020
Low-cost bracelet that manages prescriptions. Presented at the House of Lords; $15k+ in funding.
Anti-Facenet
2020
Poisoning a FaceNet model with FGSM adversarial examples.
AWS Comprehend Hackathon
3rd place
Classified Missouri nonprofits from IRS 990 filings for social-worker referrals.

Everything else is on GitHub.