Claude's new AI report card tool gives companies a closer look at costs — and flags 'inefficiencies'

• Companies using Claude Enterprise can get a closer look at their employees’ AI usage with a new tool.
• Claude’s “smart reports” not only show how teams use AI — including flagging “off-topic” sessions — but also what it costs.
• Anthropic says the reports “should not be used for evaluating individual performance.”

The AI giant announced “smart reports” for Claude Enterprise users last week. The interactive chart tool is designed to analyze a sample of a team’s AI session transcripts and group work into categories, including the types of tasks employees use Claude for, the outputs it generates, and the cost.

The reports can also — and this is the part that is undoubtedly making teams sit up straight — flag “inefficiencies” to employers, including sessions that produced “no work value” or were “personal or off-topic,” according to a Claude support webpage.

In effect, the smart reports tool offers companies equipped with Claude Enterprise something of an AI report card. Each organization can run up to 10 reports a month at no charge.

One caveat that Anthropic highlighted as “important” in its support documentation: “Smart reports help you understand adoption and plan your investment in Claude. They aren’t designed and should not be used for evaluating individual performance or making employment decisions.”

To produce a report, bosses can select a team, a time range of up to the last 28 days, the Claude products to include, focus areas for analysis, and any custom questions they want Claude to answer while analyzing the transcripts.

“Claude then reads a sample of transcripts in that scope, groups them into workstreams and types of outputs, attaches spend to each group, and writes up what it found,” the Claude support page says.

According to Anthropic, sessions involving “restricted topics” — including personal conversations related to race, ethnicity, health, legal issues, union activity, and political or religious views — are “used only for aggregate analysis and don’t include summaries.”

“Personal conversations also don’t include individual sessions or names,” the Claude support page says.

An Anthropic spokesperson told Business Insider on Monday that smart reports do not show employees’ names by default, but those settings can be changed.

“A report groups a team’s work with Claude into workstreams and shows what each one cost. Opening a workstream shows short session summaries, not transcripts,” the spokesperson said.

The spokesperson added, “An organization’s owner can turn on a setting that allows names to be shown with those summaries. When that setting is turned on, names remain hidden until someone viewing the report chooses to reveal them, and each reveal is logged.”

Sessions Claude identifies as personal or off-topic won’t appear with names, the spokesperson said.

Bloomberg reported Monday that Goldman Sachs recently limited access to Anthropic’s Claude Code and Microsoft’s GitHub coding tools to engineers only after assessing productivity and risk concerns. The move reportedly rankled some Goldman traders who used the tools for their work.

Read the original article on Business Insider