o }!gk;@srddlZddlZddlZddlZddlmZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZddlmZmZmZddlmZddlmZmZmZdd lmZmZmZdd l m!Z!dd l"m#Z#dd l$m%Z%dd l&m'Z'ddl(m)Z)ddl*m+Z+ddl,m-Z-ddl.m/Z/ddl0m1Z1ddZ2dZ3de4fddZ5d dee4de4fddZ6Gddde'Z7GdddeZ8dS)!N)ArgumentParser)iglob)Path)AnyCallableDictListOptionalUnioncast)SettingsSimpleDirectoryReaderVectorStoreIndex) BaseEmbedding) RESPONSE_TYPEResponseStreamingResponse) BaseModelFieldfield_validator)CondenseQuestionChatEngine)IngestionPipeline)LLM)CustomQueryEngine) FnComponent) QueryPipeline) BaseReader)CompactAndRefine) get_cache_dircCs2z ddlm}|dddWStytdw)NrOpenAIz gpt-3.5-turboT)model streamingz]`llama-index-llms-openai` package not found, please run `pip install llama-index-llms-openai`)llama_index.llms.openair ImportErrorrr%Z/mnt/skqttb/ctump_chatbot/chatbot/lib/python3.10/site-packages/llama_index/cli/rag/base.py_try_load_openai_llm!s  r'zfiles_history.txtreturncCstttdS)Nrag_cli)strrrr%r%r%r&default_ragcli_persist_dir0sr+ query_strcCs|pdS)Nr%r,r%r%r& query_input4sr/c@sDeZdZUeddZeed<dedefddZ dedefdd Z d S) QueryPipelineQueryEngineQuery Pipeline to use for Q&A. descriptionquery_pipeliner,r(cCs|jj|dSNr.)r4runselfr,r%r%r& custom_query=sz%QueryPipelineQueryEngine.custom_querycs|jj|dIdHSr5)r4arunr7r%r%r& acustom_query@sz&QueryPipelineQueryEngine.acustom_queryN) __name__ __module__ __qualname__rr4r__annotations__r*rr9r;r%r%r%r&r08s r0c@seZdZUdZeddZeed<edddZe ed<ed e d Z e ed <ed d dd Z eed<edddZeeed<edddZeeed<edddZeee efed<GdddZeddddedee efdeefddZeddddedee efdeefdd Z      d3d!eee d"ee d#e de d$e d%e d&ee efddfd'd(Zd"e ddfd)d*Zd4d+d,Ze d-e!e"efd.ee#gdfddfd/d0Z$d4d1d2Z%dS)5RagCLIzW CLI tool for chatting with output of a IngestionPipeline via a QueryPipeline. z,Ingestion pipeline to run for RAG ingestion.r2ingestion_pipeline:Whether to print out verbose information during execution.F)r3defaultverbosez(Directory to persist ingestion pipeline.)r3default_factory persist_dirz.Language model to use for response generation.cCstSN)r'r%r%r%r&VszRagCLI.llmr1Nr4z Chat engine to use for chatting. chat_enginez5File extractor to use for extracting text from files.file_extractorc@seZdZdZdS)z RagCLI.ConfigTN)r<r=r>arbitrary_types_allowedr%r%r%r&ConfigesrMbefore)modevaluesr(c Cs|dur|Stt|d}|jdurdStt|d}ttddhd}tt|d}d}|jdur@|jD] }t|t r?|}nq4|t _ |t _ t |jjdd } td |d } t|d }||| | d |dd|jdddd|jdddd|S)zX If query_pipeline is not provided, create one from ingestion_pipeline. NrArDoutputr,)fn output_key req_paramsrI)similarity_top_kT)r"rD)rD)query retriever summarizerrWrXrYnodes)dest_key)r r vector_storeboolrr/rtransformations isinstancerr rI embed_modelrfrom_vector_store as_retrieverrr add_modulesadd_link) clsr4rPrArDquery_componentrIr`transformationrXresponse_synthesizerr%r%r&&query_pipeline_from_ingestion_pipelinehsH       z-RagCLI.query_pipeline_from_ingestion_pipelinecCs||dur|S|ddur|jd|d|d<tt|d}|dur#dSt|d}tt|d}tt|d}tj|||dS)zQ If chat_engine is not provided, create one from query_pipeline. Nr4)r4rP)r4rDrI) query_enginerIrD) getrir rr0r]rr from_defaults)rerJrPr4rjrDrIr%r%r&chat_engine_from_query_pipelines  z&RagCLI.chat_engine_from_query_pipelinefilesquestionchatclear create_llamakwargscs|r2tj|jr*td|jd}|dkr!tddStd|jtd|j||_ t t |j } |j rDtd|j|durg} |D] } | t| d d qLg} | D])} tj| } tj| rst| d |jd }n t| gd |jd }| |j|d q\| j|| dIdH| j|jdt|jdtd}|D] }|t|dqWdn1swY|rYtddurtdnt|jdt}|stdnwt|}dd|D}Wdn1swYt|dkr tdnPt|dkrtdnD|}d|vr#tdn6tj|s3td|dn&td|d dd!d"d#d$d%d&d'd(d)d*d+d,d-t |g}td.!||durf|"|IdH|rr|#IdHdSdS)/z= Entrypoint for local document RAG CLI tool. z,Are you sure you want to delete data within z? [y/N] yzAborted.Nzrm -rf zSuccessfully cleared z!Saving/Loading from persist_dir: T) recursive) input_dirfilename_as_idrK) input_filesrwrK) show_progress)ry documents)rF/a npxzI`npx` is not installed. Please install it by calling `npm install -g npx`zLNo data has been ingested, please specify `--files` to create llama dataset.cSsh|] }|r|qSr%)strip).0liner%r%r& sz$RagCLI.handle_cli..rzMultiple files or folders were ingested, which is not supported by create-llama. Please call `llamaindex-cli rag --clear` to clear the cache first, then call `llamaindex-cli rag --files` again with a single folder or file*zGlob pattern is not supported by create-llama. Please call `llamaindex-cli rag --clear` to clear the cache first, then call `llamaindex-cli rag --files` again with a single folder or file.z The path z does not exist. Please call `llamaindex-cli rag --clear` to clear the cache first, then call `llamaindex-cli rag --files` again with a single folder or file.z%Calling create-llama using data from z ...zcreate-llama@latestz --frontendz --templater"z --frameworkfastapiz--uishadcnz --vector-dbnonez--enginecontextz--files  )$ospathexistsrFinputrlowerprintsystemrDr rrAextendrabspathisdirr rK load_datar:persistopenRAG_HISTORY_FILE_NAMEwriter*shutilwhichrlenpopshlexquotejoinhandle_questionstart_chat_repl)r8rnrorprDrqrrrsresponserAexpanded_filespatternrz_filereaderffilehistory_file_path stored_pathsr command_argsr%r%r& handle_clis          zRagCLI.handle_clicsj|jdur tdtt|j}|j|_tt|j}||}t|t r*| dStt |}t |dS)Nquery_pipeline is not defined.) r4 ValueErrorr rrDrrJrpr_rprint_response_streamrr)r8ror4rJrr%r%r&r/s        zRagCLI.handle_questioncs,|jdur tdtt|j}|dS)z; Start a REPL for chatting with the agent. Nr)r4rr rrJstreaming_chat_repl)r8rJr%r%r&r=s    zRagCLI.start_chat_replparserinstance_generatorcsrE|jddtddd|jddtdd d |jd d d dd|jddddd|jdddd|jddddd|jfddddSdS)Nz-qz --questionzThe question you want to ask.F)typehelprequiredz-fz--files+zuThe name of the file(s) or directory you want to ask a question about,such as "file.pdf". Supports globs like "*.py".)rnargsrz-cz--chatz&If flag is present, opens a chat REPL. store_true)ractionz-vz --verboserBz--clearz'Clears out all currently embedded data.z--create-llamaz8Create a LlamaIndex application with your embedded data.)rrrcstjdit|S)Nr%)asyncior6rvars)argsrr%r&rHwsz(RagCLI.add_parser_args..)func) add_argumentr* set_defaults)rerrr%rr&add_parser_argsFsT   zRagCLI.add_parser_argscsRtdd}|jdddd}|jddd }|fd d |}||d S) z* Entrypoint for CLI tool. zLlamaIndex RAG Q&A tool.r2commandscommandT)titledestrragz8Ask a question to a document / a directory of documents.)rcsSrGr%r%r8r%r&rHszRagCLI.cli..N)radd_subparsers add_parserr parse_argsr)r8r subparsersllamarag_parserrr%rr&cli|s z RagCLI.cli)NNFFFF)r(N)&r<r=r>__doc__rrArr?rDr]r+rFr*rIrr4r rrJrrKrrrMrrrirmrrrr classmethodr rrrrr%r%r%r&r@Ds    0     }    5r@rG)9rrrrargparserglobrpathlibrtypingrrrrr r r llama_index.corer r r%llama_index.core.base.embeddings.baser%llama_index.core.base.response.schemarrr llama_index.core.bridge.pydanticrrrllama_index.core.chat_enginerllama_index.core.ingestionrllama_index.core.llmsrllama_index.core.query_enginer3llama_index.core.query_pipeline.components.functionr%llama_index.core.query_pipeline.queryrllama_index.core.readers.baser&llama_index.core.response_synthesizersrllama_index.core.utilsrr'rr*r+r/r0r@r%r%r%r&s6   $