An offline ChatGPT-like software integrated to Visual Studios.
EdgeLlama is able to run your llama models (alpaca, vicuna and codellama) directly on your pc without need for internet connection.
Data kept within your PC and safe for use within your organization.
This is a Visual Studios Professional Port of llama.cpp which aims to bring LLM to edge devices.
This version of edgellama works on Intel Based CPU with AVX-2 support.