dh9SSKJr SSKJrJrJrJrJrJr SSK J r SSK J r J r "SS\5r"SS\5r"S S \\5r"S S \ 5r"S S\ 5rg))Enum)AnyDictListOptionalSetUnion) Embeddings) BaseModel ConfigDictc\rSrSrSrSrg)TakeoffEmbeddingExceptionz>Custom exception for interfacing with Takeoff Embedding class.N__name__ __module__ __qualname____firstlineno____doc____static_attributes__rd/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/embeddings/titan_takeoff.pyrrsHrrc\rSrSrSrSrg)MissingConsumerGroup zoException raised when no consumer group is provided on initialization of TitanTakeoffEmbed or in embed request.rNrrrrrr s.rrc \rSrSrSrSrSrSrg)Devicez)Device to use for inference, cuda or cpu.cudacpurN)rrrrrr r!rrrrrrs3 D Crrcd\rSrSr%Sr\"SS9r\\S'\ Rr \ \S'Sr \\S'Sr g ) ReaderConfigz7Configuration for the reader to be deployed in Takeoff.r)protected_namespaces model_namedeviceprimaryconsumer_groupN)rrrrrr model_configstr__annotations__rr r'r)rrrrr#r#s:ALO&[[FF 6#NC#5rr#c F^\rSrSr%SrSr\\S'Sr\ \S'Sr \ \S'S r \ \S '\ "5r\\\S 'SSS/4S\S\ S\ S \\4U4S jjjrS\\\\4S\\S\\\ 44SjrSS\\S\\S\\\4SjjrSS\S\\S\\4SjjrSrU=r$)TitanTakeoffEmbed)a:Interface with Takeoff Inference API for embedding models. Use it to send embedding requests and to deploy embedding readers with Takeoff. Examples: This is an example how to deploy an embedding model and send requests. .. code-block:: python # Import the TitanTakeoffEmbed class from community package import time from langchain_community.embeddings import TitanTakeoffEmbed # Specify the embedding reader you'd like to deploy reader_1 = { "model_name": "avsolatorio/GIST-large-Embedding-v0", "device": "cpu", "consumer_group": "embed" } # For every reader you pass into models arg Takeoff will spin up a reader # according to the specs you provide. If you don't specify the arg no models # are spun up and it assumes you have already done this separately. embed = TitanTakeoffEmbed(models=[reader_1]) # Wait for the reader to be deployed, time needed depends on the model size # and your internet speed time.sleep(60) # Returns the embedded query, ie a List[float], sent to `embed` consumer # group where we just spun up the embedding reader print(embed.embed_query( "Where can I see football?", consumer_group="embed" )) # Returns a List of embeddings, ie a List[List[float]], sent to `embed` # consumer group where we just spun up the embedding reader print(embed.embed_document( ["Document1", "Document2"], consumer_group="embed" )) zhttp://localhostbase_urli porti mgmt_portNclientembed_consumer_groupsmodelsc>XlX lX0lSSKJn U"URURURS9UlUHnUR RU5 [U[5(a,URRURS55 M_URRUR5 M [[U]C5 g![ a [ S5ef=f)axInitialize the Titan Takeoff embedding wrapper. Args: base_url (str, optional): The base url where Takeoff Inference Server is listening. Defaults to "http://localhost". port (int, optional): What port is Takeoff Inference API listening on. Defaults to 3000. mgmt_port (int, optional): What port is Takeoff Management API listening on. Defaults to 3001. models (List[ReaderConfig], optional): Any readers you'd like to spin up on. Defaults to []. Raises: ImportError: If you haven't installed takeoff-client, you will get an ImportError. To remedy run `pip install 'takeoff-client==0.4.0'` r) TakeoffClientzjtakeoff-client is required for TitanTakeoff. Please install it with `pip install 'takeoff-client==0.4.0'`.)r1r2r)N)r0r1r2takeoff_clientr7 ImportErrorr3 create_reader isinstancedictr4addgetr)superr.__init__)selfr0r1r2r5r7model __class__s rr@TitanTakeoffEmbed.__init__ds.!  "  4 $ MM T^^  E KK % %e ,%&&**..uyy9I/JK**..u/C/CD  /1 P  s C##C9inputr)returncU(da[UR5S:Xa[UR5SnO/[UR5S:a [S5e[S5eURR X5$)aEmbed text. Args: input (Union[List[str], str]): prompt/document or list of prompts/documents to embed consumer_group (Optional[str]): what consumer group to send the embedding request to. If not specified and there is only one consumer group specified during initialization, it will be used. If there are multiple consumer groups specified during initialization, you must specify which one to use. Raises: MissingConsumerGroup: The consumer group can not be inferred from the initialization and must be specified with request. Returns: Dict[str, Any]: Result of query, {"result": List[List[float]]} or {"result": List[float]} rziTakeoffEmbedding was initialized with multiple embedding readergroups, you must specify which one to use.zYou must specify what consumer group you want to send embeddingresponse to as TitanTakeoffEmbed was not initialized with an embedding reader.)lenr4listrr3embed)rArEr)s r_embedTitanTakeoffEmbed._embeds,4--.!3!%d&@&@!A!!DT//014*A +( {{  77rtextsc*URX5S$)aEmbed documents. Args: texts (List[str]): List of prompts/documents to embed consumer_group (Optional[str], optional): Consumer group to send request to containing embedding model. Defaults to None. Returns: List[List[float]]: List of embeddings resultrL)rArNr)s rembed_documents!TitanTakeoffEmbed.embed_documentss{{51(;;rtextc*URX5S$)zEmbed query. Args: text (str): Prompt/document to embed consumer_group (Optional[str], optional): Consumer group to send request to containing embedding model. Defaults to None. Returns: List[float]: Embedding rPrQ)rArTr)s r embed_queryTitanTakeoffEmbed.embed_querys{{40::r)r0r3r2r1)N)rrrrrr0r+r,r1intr2r3rsetr4rrr#r@r rrrLfloatrRrVr __classcell__)rCs@rr.r.)s2)V'Hc&WD#EIsPFCE&)e3s8+G+%' *2*2*2 *2 \" *2*2X$849c>*$8 ; ;)1# ; e ; ;rr.N)enumrtypingrrrrrr langchain_core.embeddingsr pydanticr r Exceptionrrr+rr#r.rrrrasW880*I I.4. S$696"i; i;r