Remix AI Tools and Services

Implements AI endpoints for the Remix-IDE

Install Requirements and Download Models

Make sure you are logged in using the hugginface-cli if requested.

sh install_reqs.sh
sh download_models.sh

Code Completion

This service provides the endpoint for code completion at localhost:7860

Run

cd src/code_completion
git fetch && git pull && TOKENIZERS_PARALLELISM=true SERVERTYPE=flask  gunicorn --workers=1 --bind=0.0.0.0:7851 main:app --access-logfile - --workers 6 --threads 1 --timeout 600

to start the multiworker service.

Other AI services

The folder services implements the services

• Code Generation
• Code Explaining
• Error Correction and Explaining

First install node js and then run

cd services
yarn install 
git fetch && git pull && MODEL=llama3_1 TOKENIZERS_PARALLELISM=true gunicorn main:app --worker-class uvicorn.workers.UvicornWorker --bind 0.0.0.0:7861 --access-logfile - --workers 3 --threads 64 --timeout 600

Here is the list of supported models

• llama13b - default
• mistral
• deepseek
• stability

Test the server load

cd experiments
locust -f load_test.py  -u 10 -r 5 -t 5m --html report.html

Curl test

 curl --connect-timeout 1 -m 5 -H 'Content-Type: application/json' \
    -d '{"data":["pragma solidity 0.8.0 //function add 3 numbers\n", "", false,200,1,0.8,50]}' \
    -X POST http://0.0.0.0:7861/ai/api/code_completion

 curl --connect-timeout 1 -m 5 -H 'Content-Type: application/json' \
    -d '{"data":["pragma solidity 0.8.0\n", "", false,200,1,0.8,50]}' \
    -X POST http://0.0.0.0:7860/ai/api/code_completion