11 upvotes
Drex proposes a non-autoregressive decision model to cut LLM waste
What is Towards Foundation Decision Models: Drex?
Drex is a new foundation model that makes decisions directly, without generating long text explanations. It aims to deliver consistent answers while reducing inference cost and removing the need to parse output strings.
Who it is for
Developers building production AI services should watch Drex for a cheaper, more reliable alternative to chain-of-thought LLMs.