OpenAI嵌入

Installation

```console git clone https://github.com/FullStackWithLawrence/openai-embeddings.git cd openai-embeddings make init

Developer setup

git clone https://github.com/lpm0073/automatic-models.git
cd automatic-models
make init
make activate

OpenAI Embeddings Example

🤖 Retrieval Augmented Generation and Hybrid Search 🤖

<br> <br>

A Hybrid Search and Augmented Generation prompting solution using Python OpenAI API Embeddings persisted to a Pinecone vector database index and managed by LangChain. Demonstrates the following:

- System Prompting. How do use the system prompt to modify LLM text completion behavior. - Templates. How to create templates in order keep your prompts DRY. - LangChain. How to setup a project using LangChain as an alternative to vendor specific LLM PyPi packages. - PDF Loader. a command-line pdf loader program that extracts text, vectorizes, and loads into a Pinecone dot product vector database that is dimensioned to match OpenAI embeddings. - Pinecone. How to create, load, and query a Pinecone vector database. - Retrieval Augmented Generation (RAG). A chatGPT prompt based on a hybrid search retriever that locates relevant documents from the vector database and includes these in OpenAI prompts.

Secondarily, I also use this repo for demonstrating how to setup Pydantic to manage your project settings and how to safely work with sensitive credentials data inside your project.

Usage

```console

example 1 - generic assistant

python3 -m models.examples.prompt "you are a helpful assistant" "What analytics and accounting courses does Wharton offer?"

example 2 - assistant with improved system prompting

python3 -m models.examples.prompt "You are a student advisor at University of Pennsylvania. You provide concise answers of 100 words or less." "What analytics and accounting courses does Wharton offer?"

example 3 - templated assistant: Online courses

python3 -m models.examples.online_courses "analytics and accounting"

example 4 - templated assistant: Certification programs

python3 -m models.examples.certification_programs "analytics and accounting"

example 5 - Retrieval Augmented Generation

python3 -m models.examples.load "/path/to/your/pdf/documents" python3 -m models.examples.rag "What analytics and accounting courses does Wharton offer?" ```

Configuration defaults

Set these as environment variables on the command line, or in a .env file that should be located in the root of the repo.

```console

OpenAI API

OPENAI_API_ORGANIZATION=ADD-ME-PLEASE OPENAI_API_KEY=ADD-ME-PLEASE OPENAI_CHAT_MODEL_NAME=gpt-4 OPENAI_PROMPT_MODEL_NAME=gpt-4 OPENAI_CHAT_TEMPERATURE=0.0 OPENAI_CHAT_MAX_RETRIES=3

Pinecone API

PINECONE_API_KEY=ADD-ME-PLEASE PINECONE_ENVIRONMENT=gcp-starter PINECONE_INDEX_NAME=openai-embeddings PINECONE_VECTORSTORE_TEXT_KEY=lc_id PINECONE_METRIC=dotproduct PINECONE_DIMENSIONS=1536

This package

DEBUG_MODE=False ```