The efficient frontier of LLM inference

Related Stories

• NYC's Department of Education adopts a policy barring public school students from using AI until high school, banning companion chatbots in all grades, and more
• Source: OpenAI's Astra model uses "recurrent depth", a technique that improves cost and performance but obscures the AI's reasoning, making it harder to monitor
• Anthropic prices Fable 5.1 at $10/1M input tokens and $50/1M output tokens, unchanged from Fable 5, and cuts cache read pricing by 75% to $0.25/1M tokens
• Fermi Explorer Mission plans to launch a spacecraft to Alpha Centauri, the Sun's nearest star system, by 2029, using a trajectory discovered by PSI's AI system
• Google needs Hollywood more than the studios need AI