mxi$dZddlmZddlmZddlZddlmZmZm Z ddl Z ddl Z ddl mZddl mZddl mZdd lmZdd lmZdd lmZdd lmZd ZdZGddZGddZy)z+Classes for working with the Gemini models.) annotations)IterableN)AnyUnionoverload)protos)client)caching) content_types)generation_types) helper_types) safety_typesusermodelceZdZdZ d ddZeddZedZdZeZ ddd ddZ dd Z e e ddd dd Ze e ddd dd Ze ddd dd Zddd dddd ddZddd dddd ddZ d dddddd d!dZ d dddddd d!dZdd d d"dZy)#GenerativeModela The `genai.GenerativeModel` class wraps default parameters for calls to `GenerativeModel.generate_content`, `GenerativeModel.count_tokens`, and `GenerativeModel.start_chat`. This family of functionality is designed to support multi-turn conversations, and multimodal requests. What media-types are supported for input and output is model-dependant. >>> import google.generativeai as genai >>> import PIL.Image >>> genai.configure(api_key='YOUR_API_KEY') >>> model = genai.GenerativeModel('models/gemini-1.5-flash') >>> result = model.generate_content('Tell me a story about a magic backpack') >>> result.text "In the quaint little town of Lakeside, there lived a young girl named Lily..." Multimodal input: >>> model = genai.GenerativeModel('models/gemini-1.5-flash') >>> result = model.generate_content([ ... "Give me a recipe for these:", PIL.Image.open('scones.jpeg')]) >>> result.text "**Blueberry Scones** ..." Multi-turn conversation: >>> chat = model.start_chat() >>> response = chat.send_message("Hi, I have some questions for you.") >>> response.text "Sure, I'll do my best to answer your questions..." To list the compatible model names use: >>> for m in genai.list_models(): ... if 'generateContent' in m.supported_generation_methods: ... print(m.name) Arguments: model_name: The name of the model to query. To list compatible models use safety_settings: Sets the default safety filters. This controls which content is blocked by the api before being returned. generation_config: A `genai.GenerationConfig` setting the default generation parameters to use. Ncld|vrd|z}||_tj||_t j ||_tj||_ |d|_ ntj||_ |d|_ ntj||_ d|_d|_y)N/zmodels/) _model_namerto_easy_safety_dict_safety_settingsr to_generation_config_dict_generation_configr to_function_library_tools _tool_configto_tool_config_system_instruction to_content_client _async_client)self model_namesafety_settingsgeneration_configtools tool_configsystem_instructions \/home/htdocs/ttos/venv/lib/python3.12/site-packages/google/generativeai/generative_models.py__init__zGenerativeModel.__init__Is j "Z/J% , @ @ Q"2"L"LM^"_#77>   $D  - < <[ ID   %'+D $'4'?'?@R'SD $ !ct|ddS)N_cached_content)getattrr"s r)cached_contentzGenerativeModel.cached_contentfst.55r+c|jSN)rr/s r)r#zGenerativeModel.model_namejsr+cd}tjd|jd|jd|jd|j d||j d|jd S) Nc|r;t|jr&|jdjx}r t|S|SNr)lenpartstextrepr)contentts r) maybe_textz+GenerativeModel.__str__..maybe_textos73w}}- a8H8M8M3M13MAwNr+z? genai.GenerativeModel( model_name='z%', generation_config=z", safety_settings=z, tools=z%, system_instruction=z!, cached_content=z ))textwrapdedentr#rrrrr0)r"r<s r)__str__zGenerativeModel.__str__ns  !__-.##'#:#:";>> model = genai.GenerativeModel('models/gemini-1.5-flash') >>> response = model.generate_content('Tell me a story about a magic backpack') >>> response.text ### Streaming This method supports streaming with the `stream=True`. The result has the same type as the non streaming case, but you can iterate over the response chunks as they become available: >>> response = model.generate_content('Tell me a story about a magic backpack', stream=True) >>> for chunk in response: ... print(chunk.text) ### Multi-turn This method supports multi-turn chats but is **stateless**: the entire conversation history needs to be sent with each request. This takes some manual management but gives you complete control: >>> messages = [{'role':'user', 'parts': ['hello']}] >>> response = model.generate_content(messages) # "Hello, how can I help" >>> messages.append(response.candidates[0].content) >>> messages.append({'role':'user', 'parts': ['How does quantum physics work?']}) >>> response = model.generate_content(messages) For a simpler multi-turn interface see `GenerativeModel.start_chat`. ### Input type flexibility While the underlying API strictly expects a `list[protos.Content]` objects, this method will convert the user input into the correct type. The hierarchy of types that can be converted is below. Any of these objects can be passed as an equivalent `dict`. * `Iterable[protos.Content]` * `protos.Content` * `Iterable[protos.Part]` * `protos.Part` * `str`, `Image`, or `protos.Blob` In an `Iterable[protos.Content]` each `content` is a separate message. But note that an `Iterable[protos.Part]` is taken as the parts of a single message. Arguments: contents: The contents serving as the model's prompt. generation_config: Overrides for the model's generation config. safety_settings: Overrides for the model's safety settings. stream: If True, yield response chunks as they are generated. tools: `protos.Tools` more info coming soon. request_options: Options for the request. contents must not be emptyrAr%r$r&r'N'Request payload size exceeds the limit: The file size is too large. Please use the File API to upload your files instead. Example: `f = genai.upload_file(path); m.generate_content(['tell me about this file:', f])`) TypeErrorrOrArole _USER_ROLEr r get_default_generative_clientr rewrite_stream_errorstream_generate_contentGenerateContentResponse from_iteratorgenerate_content from_responsegoogleapi_core exceptionsInvalidArgumentmessage startswith r"rAr%r$r`r&r'rarequestiteratorresponsees r)rpz GenerativeModel.generate_contentsxB89 9''/+# (    G$4$4R$8$=$=(2G  R % << !??ADL  " O %::<Ct||CC ) H (??MMhWW84<<88%(??MMhWW))99 yy##$MN r    s6 D.!D"?&D.&;D."D+'D..'F 1FF c`K|s td|j|||||}|jr1|jdjst|jd_|j t j|_|i} |ritj5|j j|fi|d{} dddtjj d{S|j j|fi|d{} tjj| S7w#1swYvxYw7V73#tj j"j$$r6} | j&j)dr| xj&dz c_d} ~ wwxYww)z8The async version of `GenerativeModel.generate_content`.rcrdreNrfrg)rhrOrArirjr!r #get_default_generative_async_clientr rlrmAsyncGenerateContentResponsefrom_aiteratorrprqrrrsrtrurvrwrxs r)generate_content_asyncz&GenerativeModel.generate_content_asyncXs89 9''/+# (    G$4$4R$8$=$=(2G  R %    %!'!K!K!MD   " O %::<%OT%7%7%O%O&)& H .JJYYZbccc!D!3!3!D!D"%"(DDRRS[\\  d ))99 yy##$MN r    s~B F. E#!D>D<D> *E3E 4E7F.8 EE "E;F.<D>>EE E'F+51F&&F++F.)r%r$r&r'rac |i}|jtj|_tj|j |j |||||}|jj|fi|SNrd)rgenerate_content_request)r r rkrCountTokensRequestr#rO count_tokensr"rAr%r$r&r'rarys r)rzGenerativeModel.count_tokenss  " O << !??ADL++//%)%:%:!"3 /' &;&  )t||((DODDr+c K|i}|jtj|_tj|j |j |||||}|jj|fi|d{S7wr)r!r r~rrr#rOrrs r)count_tokens_asyncz"GenerativeModel.count_tokens_asyncs  " O    %!'!K!K!MD ++//%)%:%:!"3 /' &;&  5T''44WPPPPPsA?BBB)history!enable_automatic_function_callingcr|jjdddkDr tdt|||S)aMReturns a `genai.ChatSession` attached to this model. >>> model = genai.GenerativeModel() >>> chat = model.start_chat(history=[...]) >>> response = chat.send_message("Hello?") Arguments: history: An iterable of `protos.Content` objects, or equivalents to initialize the session. candidate_count`Invalid configuration: The chat functionality does not support `candidate_count` greater than 1.)rrr)rr]rD ChatSession)r"rrs r) start_chatzGenerativeModel.start_chatsH  " " & &'8! ;??C""B"H " 8 " 9 "=":66   $H KODH , -, H , B , 8 , 9,  ', \<6< -< KODH H  B    KODH -H  B    KODH 3H  B   HKODH:>;?BFi,iH i B i  i8i9i@i 2i^KODH:>;?BF4,4H 4 B 4  48494@4 74r04EKODH:>;?BFE,EH E B E 8 E9E@E $E:04QKODH:>;?BFQ,QH Q B Q 8 Q9Q@Q $Q@EI27  B ,0    r+rceZdZdZ d ddZddddddd ddZdZddZ dd Zddddddd dd Z dd Z d Z dd Z e ddZe ddZej dZddZy)raNContains an ongoing conversation with the model. >>> model = genai.GenerativeModel('models/gemini-1.5-flash') >>> chat = model.start_chat() >>> response = chat.send_message("Hello") >>> print(response.text) >>> response = chat.send_message("Hello again") >>> print(response.text) >>> response = chat.send_message(... This `ChatSession` object collects the messages sent and received, in its `ChatSession.history` attribute. Arguments: model: The model to use in the chat. history: A chat history to initialize the object with. NFcp||_tj||_d|_d|_||_yr2)rr rG_history _last_sent_last_receivedr)r"rrrs r)r*zChatSession.__init__s4 ', .;.G.G.P 15SW1R.r+r_c \|i}|jr |r td|jj|}t j |}|j s t|_|jdd} | j|tj|}|jdddkDr td|jj| ||||||} |j| ||jr#|!|j!| | |||||\|_}} ||_| |_| S) aPSends the conversation history with the added message and returns the model's response. Appends the request and response to the conversation history. >>> model = genai.GenerativeModel('models/gemini-1.5-flash') >>> chat = model.start_chat() >>> response = chat.send_message("Hello") >>> print(response.text) "Hello! How can I assist you today?" >>> len(chat.history) 2 Call it with `stream=True` to receive response chunks as they are generated: >>> chat = model.start_chat() >>> response = chat.send_message("Explain quantum physics", stream=True) >>> for chunk in response: ... print(chunk.text, end='') Once iteration over chunks is complete, the `response` and `ChatSession` are in states identical to the `stream=False` case. Some properties are not available until iteration is complete. Like `GenerativeModel.generate_content` this method lets you override the model's `generation_config` and `safety_settings`. Arguments: content: The message contents. generation_config: Overrides for the model's generation config. safety_settings: Overrides for the model's safety settings. stream: If True, yield response chunks as they are generated. NUnsupported configuration: The `google.generativeai` SDK currently does not support the combination of `stream=True` and `enable_automatic_function_calling=True`.rrrrAr%r$r`r&r'rar{r`r{rr%r$r`rLra)rNotImplementedErrorrrEr rrirjrappendr rr]rDrp_check_response _handle_afcrr r"r:r%r$r`r&r'rarLrr{s r) send_messagezChatSession.send_messagesOT  " O  1 1f%u JJ--e4 **73||%GL,,q/w,FFGXY  !2A 6 :r ::../+#+/  hv>  1 1i6K.2.>.>!"3 /# //?/ +DL'8"&r+c|jjrtj|j|s|jdj t jjjt jjjt jjjfvr"tj|jdyyr5) prompt_feedback block_reasonr BlockedPromptException candidates finish_reasonr Candidate FinishReasonFINISH_REASON_UNSPECIFIEDSTOP MAX_TOKENSStopCandidateException)r"r{r`s r)rzChatSession._check_response^s  # # 0 0"99(:R:RS S""1%33  --GG  --22  --88< '==h>Q>QRS>TUU r+c|j}t|dk7rtdt|d|djj}|Dcgc]}|sd|vs |j }}|Scc}w)NrzZInvalid number of candidates: Automatic function calling only works with 1 candidate, but z were provided.r function_call)rr6rDr:r7r)r"r{rr7partfunction_callss r)_get_function_callszChatSession._get_function_callsjs(( z?a lmpq{m|l}~MN 1 %%++9>c$?^bKb$,,ccdsA/A/A/c|j|x}rtfd|Dsn|j|jdjg} |D]$} | } | Jd| j| &t j t| } |j| |jj|||||}|j|||j|x}r|^}} || |fS)Nc3:K|]}t|ywr2callable.0fcrLs r) z*ChatSession._handle_afc..H2x " .HrUnexpected state: The function reference (fr) should never be None. It should only return None if the declaration is not callable, which is checked earlier in the code.rir7rAr%r$r`r&rar) rallrrr:rContentrjrrprr"r{rr%r$r`rLrarfunction_response_partsrfrsendr:s ` r)rzChatSession._handle_afcts!% 8 8 BBnBHHH NN8..q199 :9; #$ 3r]~M~(..r2  3>>z9PQD NN4 zz22 "3 / / 3H  (6 B5!% 8 8 BBnB8$'))r+c K|i}|jr |r td|jj|}t j |}|j s t|_|jdd} | j|tj|}|jdddkDr td|jj| ||||||d{} |j| ||jr+|)|j!| | |||||d{\|_}} ||_| |_| S7^7w) z0The async version of `ChatSession.send_message`.Nrrrrrrr)rrrrEr rrirjrrr rr]rDrr_handle_afc_asyncrrrs r)send_message_asynczChatSession.send_message_asyncsh  " O  1 1f%u JJ--e4 **73||%GL,,q/w,FFGXY  !2A 6 :r ::/+#+;   hv>  1 1i6K484J4J!"3 /# /5K5/ +DL'8"&5 /s%CE!E"AE"E#EEcK|j|x}rtfd|Dsn|j|jdjg} |D]$} | } | Jd| j| &t j t| } |j| |jj|||||d{}|j|||j|x}r|^}} || |fS75w)Nc3:K|]}t|ywr2rrs r)rz0ChatSession._handle_afc_async..rrrrrrr) rrrrr:rrrjrrrrs ` r)rzChatSession._handle_afc_asyncs,!% 8 8 BBnBHHH NN8..q199 :9; #$ 3r]~M~(..r2  3>>z9PQD NN4 !ZZ>> "3 / / ?H  (6 B5!% 8 8 BBnB8$'))sC DD*D; DcVt|jt|jS)N)rr)rrlistrr/s r)__copy__zChatSession.__copy__ s"**&  r+c|j7|jjd|jjf}|S|j|jjdj f}d|_d|_|S)z=Removes the last request/response pair from the chat history.Nr)rrpoprrr:)r"results r)rewindzChatSession.rewindsr    &]]&&r*DMM,=,=,??FM__d&9&9&D&DQ&G&O&OOF"DO"&D Mr+c|jS)z9returns the last received `genai.GenerateContentResponse`)rr/s r)lastzChatSession.lasts"""r+c|j}| |jS|jdjtj j jtj j jtj j jfvr)tj|jd}||_ |j tjd|j|j}|jdj}|j s t"|_|jj%||gd|_d|_|jS)zThe chat history.Nra<Unable to build a coherent chat history due to a broken streaming response. Refer to the previous exception for details. To inspect the last response object, use `chat.last`. To remove the last request/response `Content` objects from the chat, call `last_send, last_received = chat.rewind()` and continue without it.)rrrrrrrrrrr r_errorBrokenResponseErrorrr:ri _MODEL_ROLEextend)r"rerrorsentreceiveds r)rzChatSession.history!s$"" <== ??1  + +    ) ) C C    ) ) . .    ) ) 4 44  %;;DOOA.content_reprNs)$Z__T!W__Q5G%H$IK Kr+zzz, z history=[z, z] )z7 ChatSession( model=)reprlibReprr[rreplacerrr rIncompleteIterationErrorrrrrrjoinr=r>)r"_modelrrr last_receivedrrs @r)rzChatSession.__repr__Js)\\^ TZZ((~> L *4<<(G ?? & NN4?? +,34q<?44++  $##/2389499W+=*>dCC OO        !!446F6_6_` *4==)G * 5sDE8D=<D=)NF)rrrrrr)r:content_types.ContentTyper%%generation_types.GenerationConfigTyper$!safety_types.SafetySettingOptionsr`rr&rr'rrarrr)rzlist[protos.FunctionCall])rzYtuple[list[protos.Content], protos.Content, generation_types.BaseGenerateContentResponse])r:rr%rr$rr`rr&rr'rrarrr)rz%tuple[protos.Content, protos.Content])rz3generation_types.BaseGenerateContentResponse | None)rzlist[protos.Content]r)rrrrr*rrrrrrrrrrrsetterrrRr+r)rrs*EI27 S SB S,0 S DH=A:>;?BF\*\A \ ; \  \8\9\@\ 2\| V)* c)*^DH=A:>;?BF>*>A > ; >  >8>9>@> 7>@)* c)*V  ##  D ^^## ! r+r)r __future__rcollections.abcrr=typingrrrrgoogle.api_core.exceptionsrrgoogle.generativeairr r google.generativeai.typesr r r rrjrrrrRr+r)r sW1"$'' "&&'3622   C C LJ J r+