async-bulkhead-llm - v3.17.0
    Preparing search index...

    Type Alias ProgressiveReconciliationOptions

    Optional progressive reconciliation applied alongside cumulative usage.

    Use only after the caller knows prefill/input processing has completed. remainingOutputTokens represents the maximum future output still expected for this active request. safetyMarginTokens retains extra headroom until final release. Both values are non-negative safe integers.

    type ProgressiveReconciliationOptions = {
        remainingOutputTokens: number;
        safetyMarginTokens?: number;
    }
    Index
    remainingOutputTokens: number
    safetyMarginTokens?: number