Raunak (@raunakdoesdev) / X

Raunak

1,572 posts

Raunak

@raunakdoesdev

I’m into open science, elegant software architecture, and well-crafted interfaces. Building reducto.ai

San Diego, California

Joined July 2017

已置顶
Raunak
@raunakdoesdev
2025年10月14日
Big milestone for Reducto: we’ve raised a $75M Series B led by a16z, bringing our total funding to $108M. Since our launch, we’ve been obsessed with pushing the limits of what’s possible when AI meets the real-world messiness of documents. We’ve now processed 1B+ pages, nearly
60.9K
Raunak
@raunakdoesdev
2023年6月17日
A recent work from @iddo claimed GPT4 can score 100% on MIT's EECS curriculum with the right prompting. My friends and I were excited to read the analysis behind such a feat, but after digging deeper, what we found left us surprised and disappointed. dub.sh/gptsucksatmit 🧵
No, GPT4 can’t ace MIT | Notion
From flower-nutria-41d.notion.site
3M
Raunak
@raunakdoesdev
2025年8月30日
claude code makes new computer setup so nice
301K
Raunak
@raunakdoesdev
2023年9月8日
I just built an infinite memory system for LLM chats: Remembrall. Add a UID to your OpenAI call and I'll manage inserting past chat history into the context window with < 100ms latency. 2 lines of code to integrate. @helicone_ai style monitoring for free. DM for beta access.
555K
Raunak
@raunakdoesdev
2023年6月18日
Update: we've started replicating their experiments directly with GPT4 calls, and somehow it only gets worse. We've finished running zero-shot GPT 4 on the dataset, and after hand grading the first 30% of the dataset, the results don't seem to match the paper. 🧵
Raunak
@raunakdoesdev
2023年6月17日
A recent work from @iddo claimed GPT4 can score 100% on MIT's EECS curriculum with the right prompting. My friends and I were excited to read the analysis behind such a feat, but after digging deeper, what we found left us surprised and disappointed. dub.sh/gptsucksatmit 🧵
652K
Raunak
@raunakdoesdev
2023年6月17日
Replying to @raunakdoesdev
We hope our work encourages skepticism for GPT as eval ground truth, and encourages folk to look a little deeper into preprint papers before sharing. Much thanks to @NeilDeshmukh and @David_Koplow for working w/ me on this and @willwjack for the review.
No, GPT4 can’t ace MIT | Notion
From flower-nutria-41d.notion.site
92K
Raunak
@raunakdoesdev
2023年6月17日
Replying to @raunakdoesdev
Well... it didn't. The authors evaluation uses GPT 4 to score itself, and continues to prompt over and over until the correct answer is reached. This is analogous to someone with the answer sheet telling the student if they’ve gotten the answer right until they do. (2/4)
229K
Raunak
@raunakdoesdev
2023年7月25日
105 ML papers were published on @arxiv today. It's getting harder and harder to keep up with the latest ML research. Today we're making it a bit easier with a free LLM powered app that goes from PDFs to beautiful markdown summaries in seconds. Try it yourself below 👇 (1/4)
173K
Raunak
@raunakdoesdev
2023年6月17日
Replying to @raunakdoesdev
That's not all. In our analysis of the few-shot prompts, we found significant leakage and duplication in the uploaded dataset, such that full answers were being provided directly to GPT 4 within the prompt for it to parrot out as its own. (3/4)
102K
Raunak
@raunakdoesdev
2023年7月31日
🏆 We* won 1st place at the @AnthropicAI hackathon today with ClaudeScholar, a research assistant for science that can synthesize data, extract insights, and automate scientific workflows. Try it @ claudescholar.com * @AbrahamAdit, @johnyang100, @tinahhong 🧵 (1/5)
00:00
109K