Today in AI ·

Hugging Face #Evaluation #Research #AI2

Ai2 releases XYBench to test misguided user requests

Ai2 introduced XYBench on November 13 with more than 8,000 questions testing how assistants handle requests based on misconceptions. The benchmark evaluates whether models can address the underlying goal instead of simply following a mistaken approach.

Read at Hugging Face
Anthropic #Claude #Collaboration #Agents

Claude Meetings enters beta for live team collaboration

Anthropic began rolling out Claude Meetings on November 12 for Team and Enterprise plans, initially supporting Google Meet. Claude can take notes, answer questions and build shared artifacts during calls, with permission controls for connected tools.

Read at Anthropic
MIT News #Research #Engineering #HumanInTheLoop

MIT develops an AI copilot for structural design

MIT reported on November 13 a system that identifies regions of algorithmically generated structures for engineer feedback during design. Its demonstrations improved manufacturability and buckling performance, suggesting a more practical route to using topology optimization in engineering.

Read at MIT News
GitHub #GitHub #Security #DeveloperTools

GitHub adds REST controls for repository AI Scan

GitHub announced on November 13 that organizations can enable or disable repository AI Scan through its REST API at both organization and repository levels. The controls let security teams automate scan configuration across their repositories.

Read at GitHub
OpenAI #AISafety #Research #ChildSafety

OpenAI pledges funding for research on children and AI

OpenAI announced on November 12 a $2 million commitment to a scientific network studying AI and children’s safety after signing a charter at the Paris Peace Forum. The work supports shared measurement tools, with research teams retaining control of conclusions and publishing negative or inconclusive findings.

Read at OpenAI
Microsoft #EnterpriseAI #Research #Measurement

Microsoft shares IDC findings on enterprise AI returns

Microsoft published commissioned IDC research on November 12 drawing on more than 5,200 business and IT leaders. Only 61% of surveyed organizations reported high confidence in measuring AI’s business value, underscoring the difficulty of assessing returns as deployment expands.

Read at Microsoft
Rackspace #EnterpriseAI #Governance #Research

HFS and Rackspace report gaps in enterprise AI value

A November 12 HFS Research study with Rackspace found that 33% of 502 surveyed AI decision-makers said their main AI program met or exceeded its business case. The survey of AI-active enterprises highlights fragmented accountability and governance gaps; it does not measure market-wide adoption.

Read at Rackspace

Free · 29 episodes · no sign-up

Learn AI system design, one diagram at a time

60-second Shorts and long-form deep dives on how real AI systems are built, how they break, and how to fix them: caching, RAG, agents, security and decision models.

A holographic architecture diagram glowing in a dark control room

Newest episodes

All 29 episodes

The learning path

Five stages, from the edge of the network to the security of your agents.

Open the learning path

0 of 27 episodes done

Mark episodes as done from their page. Progress stays in this browser.

Start with stage 1
  1. 1 Foundations Edge & Caching Why far servers feel fast, where edge rendering backfires, and how one cache expiry can take down an AI app. 2 episodes · 2 coming 0 of 2 done
  2. 2 Core Decision Models When a typed decision beats generated text, and how to route between a decision model and an LLM. 3 episodes · 1 coming 0 of 3 done
  3. 3 Advanced Agents in Production Context, memory, cost guardrails and the workspace an autonomous coding agent needs. 9 episodes · 5 coming 0 of 9 done
  4. 4 Hands-on Hands-On: Coding Agents from Your Phone Step-by-step tutorials: build and ship real apps from the Claude app, with the prompts and the code for every step. 3 episodes · 2 coming 0 of 3 done
  5. 5 Hands-on AI Coding Agent Tips One practical tip per Short for Claude Code and the other coding agents, each one tested in a real run. 2 episodes 0 of 2 done
  6. 6 Extra Code Stories Picture-led stories from the history of programming, and what they say about where coding goes next. 3 episodes 0 of 3 done
  7. 7 Advanced AI Security Stolen tokens, poisoned tools and the other ways an AI system gets turned against its users. 5 episodes · 2 coming 0 of 5 done

Four ways to watch

Get the next episode first

Shorts and deep dives on AI system design land on @AI.JoinDev first. Subscribe, or follow the RSS feed.

Teaching someone younger?

Code Quest Kids: Coding for kids aged 6 to 12, with Bit the robot. Same team, same no-ads rules.

Visit kids.join.dev