Installing a private self hosted AI

Network-Chuck-Private-AI-project

This is for WSL on Windows or Linux or MacOS.
See HERE for guide to fresh install Ubuntu on Windows.

Guide to creating your own private AI.
Download Ollama
(ONLY USE IF LINUX COMMAND DOESN'T WORK BELOW)
https://ollama.com/download

Linux Command to install it instead of the website.
curl -fsSL https://ollama.com/install.sh | sh

Go to the website:
huggingface.co

It is a community dedicated to providing and sharing AI Models.
Search for Llama-2-7b (This is the latest version on 3/14/24)
Link
https://huggingface.co/meta-llama/Llama-2-7b

Here is an uncensored version of llama2
https://huggingface.co/georgesung/llama2_7b_chat_uncensored

FULL OUTPUT TO JUST GET IT UP AND RUNNING

Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.

Install the latest PowerShell for new features and improvements! https://aka.ms/PSWindows

PS C:\Users\aonat> wsl --install
Installing: Ubuntu
Ubuntu has been installed.
Launching Ubuntu...
Installing, this may take a few minutes...
Please create a default UNIX user account. The username does not need to match your Windows username.
For more information visit: https://aka.ms/wslusers
Enter new UNIX username: zippyb
New password:
Retype new password:
passwd: password updated successfully
The operation completed successfully.
Installation successful!
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.

Welcome to Ubuntu 22.04.3 LTS (GNU/Linux 5.15.146.1-microsoft-standard-WSL2 x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

This message is shown once a day. To disable it please create the
/home/zippyb/.hushlogin file.
zippyb@Nates-Big-Rig:~$ curl -fsSL https://ollama.com/install.sh | sh
>>> Downloading ollama...
######################################################################## 100.0%#=#=#
######################################################################## 100.0%
>>> Installing ollama to /usr/local/bin...
[sudo] password for zippyb:
>>> Creating ollama user...
>>> Adding ollama user to render group...
>>> Adding ollama user to video group...
>>> Adding current user to ollama group...
>>> Creating ollama systemd service...
>>> Enabling and starting ollama service...
Created symlink /etc/systemd/system/default.target.wants/ollama.service → /etc/systemd/system/ollama.service.
>>> NVIDIA GPU installed.
zippyb@Nates-Big-Rig:~$ ollama run llama2
pulling manifest
pulling 8934d96d3f08... 100% ▕████████████████████████████████████████████████████████▏ 3.8 GB
pulling 8c17c2ebb0ea... 100% ▕████████████████████████████████████████████████████████▏ 7.0 KB
pulling 7c23fb36d801... 100% ▕████████████████████████████████████████████████████████▏ 4.8 KB
pulling 2e0493f67d0c... 100% ▕████████████████████████████████████████████████████████▏   59 B
pulling fa304d675061... 100% ▕████████████████████████████████████████████████████████▏   91 B
pulling 42ba7f8a01dd... 100% ▕████████████████████████████████████████████████████████▏  557 B
verifying sha256 digest
writing manifest
removing any unused layers
success
>>> Tell me about yourself?

I'm just an AI, I don't have personal experiences or emotions like humans do. However, I'm here to help answer any
questions you may have, provide information on a wide range of topics, and assist with tasks such as language
translation, text summarization, and more! Is there something specific you would like to know or discuss?

>>> Can you code?

I'm just an AI, I don't have the ability to write or execute code in the classical sense. However, I can process
and generate text based on patterns and algorithms programmed into me. My training data includes a wide range of
texts and languages, which I can use to generate responses to questions or prompts. Is there something specific
you would like me to help with?

>>> If I tell you things, can you take them into memory in this convo?

Yes, I can certainly keep track of the information you provide during our conversation! I'm designed to process
and retain large amounts of text-based data, so feel free to share anything you'd like to discuss or ask about. Is
there something specific you'd like to talk about or ask?

>>> Send a message (/? for help)