xinference.client.Client.query_engine_by_model_name#

Client.query_engine_by_model_name(model_name: str, model_type: str | None = 'LLM', enable_virtual_env: bool | None = None)[código-fonte]#

Get the engine parameters with the model name registered on the server.

Parâmetros:

  • model_name (str) – The name of the model.

  • model_type (str) – Model type, LLM by default.

Retorna:

The supported engine parameters of registered models on the server.

Tipo de retorno:

Dict[str, List[Dict[str, Any]]]