ohh thanks for the reporting, we'll solve asap;.
Posts made by root
-
RE: The third-party login system is not working on LankaDevelopers.lk.
-
RE: Mora UXplore 1.0 - University of Moratuwa IEEE Student Branch
Glad here that, thanks for the sharing ,
-
LocalAI: A drop-in replacement for OpenAI
LocalAI LaMA, alpaca, gpt4all, vicuna, koala, gpt4all-j
Self-hosted, community-driven simple local OpenAI-compatible API written in go. Can be used as a drop-in replacement for OpenAI, running on CPU with consumer-grade hardware. Supports ggml compatible models: LLaMA, alpaca, gpt4all, vicuna, koala, gpt4all-j
Using LocalAI is straightforward and easy. You can simply install LocalAI on your local machine or server via docker and start performing inferencing tasks immediately, no more talkings let's start ,
-
Install docker in your pc or server ( installation depend on the os type, check here)
-
Open terminal or cmd and clone the LocalAi repo from github
git clone https://github.com/go-skynet/LocalAI
-
Go to the
LocalAi/models
folder in terminalcd LocalAi/models
-
Download the model ( in here i use
gpt4all-j model
, this model coming with Apache 2.0 Licensed , it can be used for commercial purposes.)wget https://gpt4all.io/models/ggml-gpt4all-j.bin
in here i use wget for download, you can download bin file manually and copy paste to the
LocalAi/models
folder -
Come back to the
LocalAi
root -
Start with docker-compose
docker compose up -d --build
After above process finished, let's call our LocalAi via terminal or cmd , in here i use curl you can use also any other tool can perform http request ( postman, etc.. )
curl http://localhost:8080/v1/models
This request showing what are the models we have added to the models directory
Let's call the AI with actual Prompt.
curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{ "model": "ggml-gpt4all-j", "prompt": "Explain AI to me like A five-year-old", "temperature": 0.7 }'
Windows compatibility
It should work, however you need to make sure you give enough resources to the container. See
Kubernetes
You can run the API in Kubernetes, see an example deployment in kubernetes
API Support
LocalAI provides an API for running text generation as a service, that follows the OpenAI reference and can be used as a drop-in. The models once loaded the first time will be kept in memory.Example of starting the API with
docker
:docker run -p 8080:8080 -ti --rm quay.io/go-skynet/local-api:latest --models-path /path/to/models --context-size 700 --threads 4
Then you'll see:
┌───────────────────────────────────────────────────┐ │ Fiber v2.42.0 │ │ http://127.0.0.1:8080 │ │ (bound on host 0.0.0.0 and port 8080) │ │ │ │ Handlers ............. 1 Processes ........... 1 │ │ Prefork ....... Disabled PID ................. 1 │ └───────────────────────────────────────────────────┘
if you want more info about API, go to the github page
https://github.com/go-skynet/LocalAI#api -
-
RE: How To Clone A Private Github Repo To A cPanel Server
is this can apply to the plesk ?
-
RE: What are good technologies to learn in sri lanka
i think rust, python and go lang is the best for future .
-
RE: Golang: Beego vs Revel. How to Choose?
if you a nodejs express developer go for Fiber
-
How to fix $supabase does not exist on type in NUXTJS
I'm getting this error when i access my $supabase nuxt plugin in pages/index.vue
~/plugins/supabase.js
import {createClient} from '@supabase/supabase-js' export default ({ app },inject) => { const supabaseUrl = app.$config.supabaseUrl const supabaseKey = app.$config.supabaseApi const supabase = createClient(supabaseUrl, supabaseKey) inject('supabase', supabase) }
i loaded plugin in nuxt config
plugins: [ {src: '~/plugins/supabase.js', mode : 'client'} ],
Anyone can help to fix this issue, i use typescript with nuxtjs
-
Secure Your Laravel Website: A Guide on How to Force Redirect HTTP to HTTPS for Better SEO
In this article, i'll explain how to redirect HTTP to HTTPS in Laravel. Whether you're using Laravel 6, 7, 8, 9 or 10 we've got you covered!
We have to modify AppServiceProvider boot method, i also disable HTTPS redirect in local.
in app/Providers/AppServiceProvider.php.
<?php namespace App\Providers; use Illuminate\Support\ServiceProvider; use Illuminate\Pagination\Paginator; class AppServiceProvider extends ServiceProvider { /** * Register any application services. * * @return void */ public function register() { } /** * Bootstrap any application services. * * @return void */ public function boot() { if ($this->app->environment('production')) { \URL::forceScheme('https'); } Paginator::useBootstrap(); } }
-
RE: Europe රටකට IT related business idea එකක්
pm ekak damma balala kiyanna
-
RE: Hi. I'm new here. I'm looking for few developers for project in KOREA.
hello what kind of project do you have ?
-
RE: Static website nuxtjs or nextjs
both are same bro the only difference is react and nextjs developed by big companies.
-
How to Fix "nvm not found" Error in MacOS
When you install NVM using Homebrew, you still need to add the following lines to your shell configuration file (.bashrc, .zshrc, etc.)
export NVM_DIR="$HOME/.nvm" . "/usr/local/opt/nvm/nvm.sh"
If you are using the Bash shell, open the ~/.bashrc file in your favorite text editor, and add the following lines at the end of the file:
export NVM_DIR="$HOME/.nvm" . "/usr/local/opt/nvm/nvm.sh"
If you are using the Zsh shell, open the ~/.zshrc file in your favorite text editor, and add the following lines at the end of the file:
export NVM_DIR="$HOME/.nvm" . "/usr/local/opt/nvm/nvm.sh"
After adding the lines to the appropriate file, save it and close the editor. Then, restart your terminal or run the source command to load the changes:
source ~/.bashrc
source ~/.zshrc
-
How to Flush DNS on Mac – MacOS Clear DNS Cache
MacOS Version Command macOS 12 (Monterey and above) sudo dscacheutil -flushcache; sudo killall -HUP mDNSResponder macOS 11 (Big Sur) sudo dscacheutil -flushcache; sudo killall -HUP mDNSResponder macOS 10.15 (Catalina) sudo dscacheutil -flushcache; sudo killall -HUP mDNSResponder macOS 10.14 (Mojave) sudo killall -HUP mDNSResponder macOS 10.13 (High Sierra) sudo killall -HUP mDNSResponder macOS 10.12 (Sierra) sudo killall -HUP mDNSResponder OS X 10.11 (El Capitan) sudo killall -HUP mDNSResponder OS X 10.10 (Yosemite) sudo discoveryutil udnsflushcaches OS X 10.9 (Mavericks) sudo killall -HUP mDNSResponder OS X 10.8 (Mountain Lion) sudo killall -HUP mDNSResponder Mac OS X 10.7 (Lion) sudo killall -HUP mDNSResponder Mac OS X 10.6 (Snow Leopard) sudo dscacheutil -flushcache Mac OS X 10.5 (Leopard) sudo lookupd -flushcache Mac OS X 10.4 (Tiger) lookupd -flushcache -
RE: Sampath payment gateway response issue
documentation eka danna balanna