(perhaps rename to AI practice and experience (as a nod to an early software journal))
2023-04-26 Explore Gmail messages with OpenAI
2023-05-07 text-generation-webui
Using langchain to query local documents with a local model
2023-05-22 OpenAI experiments diary
2023-06-04 some GPT4All observations
2023-07-17 OpenAI Experiments diary entry
2023-07-28 OpenAI model comparison
2023-08-03 Emily Bender interview
2023-08-09 project diary entry
2023-09-04 Ollama and langchain and HTML files
LLM in a browser (Simon Willison): "I don’t need a language model that can answer any question I have about the world from its baked in training data. I need want something that can manipulate language in useful ways. I care about summarization, and fact extraction, and answering questions about larger text."
https://simonwillison.net/2023/Apr/16/web-llm/
What’s in the RedPajama-Data-1T LLM training set: https://simonwillison.net/2023/Apr/17/redpajama-data/
good documentation on using SimpleVectorIndex with a service_context
and with inserting more content into the index:
LlamaIndex Usage Pattern - LlamaIndex (gpt-index.readthedocs.io)
question answering over documents: https://python.langchain.com/en/latest/use_cases/question_answering.html
and from reddit r/LocalLLaMA (the "prompt engineering" caution seems interesting)
https://www.reddit.com/r/LocalLLaMA/comments/133vfk3/i_recently_tested_the_mpt_1b_redpajama_dolly/
https://www.reddit.com/r/LocalLLaMA/comments/12x1g24/how_to_install_vicuna_language_model_on_mac_2_ways/
https://agi-sphere.com/vicuna-mac/
using HuggingFace, OpenAI, Cohere models with langchain: https://medium.com/the-techlife/using-huggingface-openai-and-cohere-models-with-langchain-db57af14ac5b
HuggingFace Transformers documentation:
https://huggingface.co/docs/transformers/task_summary