dhnSSKrSSKJrJr SSKJr SSKJr \R"\ 5r "SS\5r g)N)AnyOptional)LLM)IpexLLMc\rSrSrSr\SSSSS.S\S\\S\\S \ S \\S \ S \ 4S jjj5r \SSS.S\S\\S\\S \ S \ 4 Sjjj5r \S \4Sj5rSrg)BigdlLLM zWrapper around the BigdlLLM model Example: .. code-block:: python from langchain_community.llms import BigdlLLM llm = BigdlLLM.from_model_id(model_id="THUDM/chatglm-6b") NT) tokenizer_id load_in_4bitload_in_low_bitmodel_id model_kwargsr r r kwargsreturnc p[RS5 SSKJnJn SSKJn Jn Ub[RS5 U(d [S5eU=(d 0n U=(d Un U R"U 40U D6n UR"U4SS 0U D6nS U ;a-U R5VVs0sHunnUS :wdMUU_M n nnU"S UUU U S .UD6$![a [S5ef=f![a U R"U 40U D6n Nf=f![a UR"U4SS 0U D6nNf=fs snnf) a Construct object from model_id Args: model_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder. tokenizer_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. 4BigdlLLM was deprecated. Please use IpexLLM instead.r AutoModelAutoModelForCausalLM AutoTokenizerLlamaTokenizerpCould not import bigdl-llm or transformers. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.z`load_in_low_bit` option is not supported in BigdlLLM and is ignored. For more data types support with `load_in_low_bit`, use IpexLLM instead.zBigdlLLM only supports loading in 4-bit mode, i.e. load_in_4bit = True. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.r Ttrust_remote_coder model tokenizerr) loggerwarningbigdl.llm.transformersrr transformersrr ImportError ValueErrorfrom_pretrained Exceptionitems)clsr rr r r rrrrr _model_kwargs _tokenizer_idrrkvs Z/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/bigdl_llm.py from_model_idBigdlLLM.from_model_ids2 MN   C  & NN(  W  %* $0  W%55mU}UI (88'+/<E - /!.!4!4!6!6A!?R:R1!6  &     U W  2 W&66}V VI W --'+/<E  s;C(C*<D * D2:D2C'*D  D  D/.D/)r c [RS5 SSKJnJn SSKJnJn U=(d 0n U=(d Un UR"U 40U D6n UR"U40U D6n SU ;a+U R5V Vs0sHupU S:wdM X_M n n nU"SUU U U S.UD6$![a [S5ef=f![a UR"U 40U D6n Nf=f![a UR"U40U D6n Nf=fs snn f) a Construct low_bit object from model_id Args: model_id: Path for the bigdl-llm transformers low-bit model folder. tokenizer_id: Path for the huggingface repo id or local model folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. rrrrrrrr) rr r!rrr"rrr#r%r& load_low_bitr')r(r rr rrrrrr)r*rrr+r,s r-from_model_id_low_bitBigdlLLM.from_model_id_low_bitisK0 MN   C%* $0  W%55mU}UI F(55hP-PE - /!.!4!4!6!6!?R:R!6  &     1 W   W&66}V VI W  F**8E}EE Fs:B#B<C> D D#B9<CCC?>C?cg)Nz bigdl-llmr)selfs r- _llm_typeBigdlLLM._llm_typesr)N)__name__ __module__ __qualname____firstlineno____doc__ classmethodstrrdictboolrrr.r2propertyr6__static_attributes__rr8r-rr s(,Q '+!)-Q Q tnQ sm Q  Q "#Q Q  Q Q f(,> '+ > > tn> sm >  >  > > @3r8r) loggingtypingrr#langchain_core.language_models.llmsr!langchain_community.llms.ipex_llmr getLoggerr9rrrr8r-rIs/ 35   8 $awar8