AbstractOptionalstreaming: booleanThe version of the API functions. Part of the path.
Hostname for the API call (if this is running on GCP)
Region where the LLM is stored (if this is running on GCP)
Model to use
Model to use
Alias for model
What platform to run the service on. If not specified, the class should determine this from other means. Either way, the platform actually used will be in the "platform" getter.
Whether or not to stream.
AbstractbuildAbstractformat
Parameters needed to setup the client connection. AuthOptions are something like GoogleAuthOptions (from google-auth-library) or WebGoogleAuthOptions.