Box CEO says companies will need to figure out how to budget for workers running up AI token bills
Briefly

Box CEO says companies will need to figure out how to budget for workers running up AI token bills
""This will of course start in engineering, where we already know developers can run multiple agents in parallel, or have projects going over night.""
""That $500,000 engineer at the end of the year, I'm going to ask them how much did you spend in tokens? If that person said $5,000, I will go ape something else.""
""Their compute budgets are just going to monotonically go up over time.""
""These aren't chatbot workflows answering a simple question, but agents that are running and processing through incredible amounts of data at scale, and generating all new forms of information.""
AI budgets are expected to rise significantly across tech companies, starting with engineering and expanding to other knowledge work sectors like legal and sales. Tokens, which measure AI usage, will play a crucial role in this increase. Companies charge more for advanced models and complex queries. Workers leveraging AI will consume more tokens over time, leading to higher compute budgets. Agents, capable of processing vast amounts of data, will become major token consumers, generating new information and insights.
Read at www.businessinsider.com
Unable to calculate read time
[
|
]