Doesn't look like the scale is there, even for HN: > Currently have embedded: po... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		eamag 2 days ago \| parent \| context \| favorite \| on: Show HN: Use Claude Code to Query 600 GB Indexes o... Doesn't look like the scale is there, even for HN: > Currently have embedded: posts: 1.4M / 4.6M comments: 15.6M / 38M That's with Voyage-3.5-lite

Xyra 2 days ago [–]

The scale is there. I'm scraping, cleaning, token efficientizing dozens of sources every single hour. The lack of monies for embedding everything was a temporary problem.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact