""For me right now, I'm like, 'Yeah, we should probably waste a lot of tokens because that means that we're trying new things.'""
""You have to decide, do you want that to be a long-running prompt? Do you have to be a long-running agent?""
""These questions won't be solved until we can actually find a way to build data center capacity.""
Aaron Levie, CEO of Box, views high token usage by engineers as a positive indicator of innovation and experimentation. He believes that companies should not be overly concerned about token waste, as it reflects a willingness to explore new ideas. Levie emphasizes that the challenges of token usage extend beyond engineering teams and impact overall AI deployment strategies. He notes that decisions regarding long-running prompts and agentic AI will remain unresolved until data center capacity issues are addressed, potentially leading to lower token costs in the future.
Read at www.businessinsider.com
Unable to calculate read time
Collection
[
|
...
]