Jim Fan

This is by far my favorite post on the AI executive order. Andrew says it best: The right place to regulate AI is at the APPLICATION layer. Requiring AI apps like healthcare, self-driving, etc. to meet stringent requirements, even pass audits, can ensure safety. But adding burdens to foundation model development unnecessarily slows down AI’s progress.

Thank you Sharon for featuring Eureka in the wonderful article on VentureBeat!

Great minds think alike! Awesome work on your end too!

Everyone should read the celebrated mathematician Terence Tao's blog on LLM. He predicts that AI will be a trustworthy co-author in mathematical research by 2026, when combined with search and symbolic math tools. I believe math will be the first scientific discipline to see major breakthroughs enabled by AI, because math: ▸ can be expressed conveniently as a coding problem. Strings are naturally first-class citizens. ▸ can be rigorously verified by theorem provers like Lean, rather than relying on empirical results. ▸ does not require physical experiments like biology & medicine. Robotics isn't ready yet. We are already seeing big progress: ▸ LeanDojo from my colleagues @NVIDIAAI & @Caltech is among the first steps towards this grand challenge. ▸ Last year, OpenAI used Lean to solve some math olympiad problems: ▸ ChemCrow is another example, but for chemistry. It integrates GPT-4 with professional tools like molecular synthesis planner and reaction prediction: ▸Terrance Tao's blog:

A well-written thread by Shawn on the trend of GPT becoming a proficient tool *maker*, in addition to the usual tool user mode. We used to design a shell layer on top of LLMs, but now LLMs can act as a shell "controller" on top of codebases they implement on the fly. Nice…

Very well-written thread, thanks Shawn!

Really well-written piece on the evolution of prompt engineering! We are moving from magic incantations that make no sense to a regular human, to intricate no-gradient stacks around an LLM that avoids under-specifying a task.

His introductory thread:

Read the excellent cookbook for self-supervised learning, from the godfather of deep learning himself @ylecun. The recipes in this freely available paper will truly help your business. Not the "top 10 ChatGPT tricks you shouldn't miss". 4/

Don't watch AI FOMO and fear-mongering videos on YouTube. Watch the excellent talk from John Schulman @johnschulman2, creator of RLHF that powers GPT-4. Now *this* qualifies as "insane" ingenuity, if you ask me.

Excellent blog post on the speed and convergence of GPT training runs on H100 (FP8)

LLaMA spearheaded the age of community-driven midsize LMs. It’s game-changing for many use cases that don’t require GPT-4’s full firepower. Great blog post that covers Alpaca, Vicuna, Koala, WizardLM, OpenAssistant, and more!