async-bulkhead-llm - v3.17.0
    Preparing search index...

    Type Alias LLMAcquireOptions

    LLMAcquireOptions: AcquireOptions & {
        admissionClass?: string;
        priority?: LLMPriority;
        reservation?: LLMReservationOverride;
    }

    Options accepted by acquire() / run() (base options + priority).

    Type Declaration

    • OptionaladmissionClass?: string

      Bounded policy-class ID used for hierarchical admission.

      Omit to use admissionClasses.defaultClass. Passing this option without configuring admissionClasses, or passing an unknown class, throws a configuration error rather than creating unbounded runtime state.

    • Optionalpriority?: LLMPriority
    • Optionalreservation?: LLMReservationOverride

      Per-call token reservation override (v3.7).

      When provided and tokenBudget is configured, admission reserves input + maxOutput from this value verbatim and the bulkhead's estimator is not consulted for this call. Intended for callers — typically gateways — that already compute a more accurate estimate from the full provider request (tool schemas, response formats, provider-priced media) than any character-ratio estimator could.

      Both fields must be non-negative integers. Ignored when tokenBudget is not configured (no reservation participates in admission in that mode). Not reflected by estimate(), which always previews the estimator path.

      v3.8: the object returned by bulkhead.estimate() can be passed here directly. When a reserved field is present it must equal input + maxOutput (see LLMReservationOverride).