Prompt with AI
Prompt engineering
Prompt engineering involves the design and creation of prompts that are used to elicit specific responses or actions from AI models or interactive systems. These prompts are carefully crafted to guide the behavior or generate particular outputs from the AI, such as generating natural language responses, providing recommendations, or completing specific tasks.
Definition
In the context of AI language models, prompt engineering is especially important for shaping the model's behavior and output. By designing prompts effectively, engineers can influence the model's responses and ensure that it generates coherent, relevant, and accurate content.
There are four main areas to consider when writing an effective prompt. You don’t need to use all four, but using a few will help!
Persona: Who is the user you're writing for? What are their skills and knowledge?Task: What specific action do you want the user to perform?Context: What information does the user need to know to complete the task?Format: What is the desired output of the task?
Example Prompt:
- [
Persona] You are a Google Cloud program manager. - [
Task] Draft an executive summary email - [
Context] to [person description] based on [details about relevant program docs]. - [
Format] Limit to bullet points.
By using "act as," you are establishing a specific context for the language model and guiding it to understand the type of task or request you are making. This helps to set the right expectations and provides the language model with the necessary context to generate a response tailored to the defined role.
"Act as a creative writing assistant and generate a short story based
+on a prompt about a futuristic world where robots have become sentient."
+Summarize
Summary is a prompt engineering technique that involves providing a summary of a given document or text. It can helps for summarizing changelogs, articles, or other technical documents.
Help me write an article of this document [Insert or copy paste document text]
+Generate 5 titles out of the following topic….
+Generate a subtitle to catch readers’ attention on the following
+topic [describe the topic]
+Write
Write is a prompt engineering technique that involves providing a step-by-step guide or instructions for a given task or process. Its useful for developers to create functional and technical documentations.
Create a template of an email response to customer inquiring about ….
+Create a guide that explains how to use ….
+Write step by step instructions
+For Developers
Code explanation
Code explanation is a prompt engineering technique that involves providing a detailed explanation of a code snippet or function. This technique is useful for developers who want to understand the inner workings of a codebase or for those who want to document their code.
cf. Preformatted prompts for an example of code explanation
Generation
Act as a code generator. Generate a Python function that takes a list of
+numbers as input and returns the sum of all the numbers.
+Completion
Code completion is a prompt engineering technique that involves providing a list of possible completions for a given code snippet or function. This technique is useful for developers who want to suggest possible code changes or improvements based on their existing code.
Conversion
Code conversion is a prompt engineering technique that involves providing a conversion of a code snippet or function from one programming language to another. This technique is useful for developers who want to migrate their code from one language to another or for those who want to use a different programming language for their projects.
Review
Code review is a prompt engineering technique that involves providing a code review of a given code snippet or function. This technique is useful for developers who want to review their code for potential issues,bugs, or for those who want to provide feedback on their code.
Fixing
Code fixing is a prompt engineering technique that involves providing a code fix for a given code snippet or function. This technique is useful for developers who want to fix bugs or issues in their code or for those who want to improve the quality of their code.
Help me find mistakes in my code [insert your code]
+Explain what this snippet of code does [insert code snippet]
+What it the correct syntax for a [statement or function]
+in [programming language]
+How do I fix the following programming language code
+[program language] code which explain the functioning [Insert code snippet]
+Refactoring
Code refactor is a prompt engineering technique that involves providing a code refactoring of a given code snippet or function within a specific scope. This technique is useful for developers who want to refactor their code within a specific context or for those who want to improve the readability and maintainability of their code.
Data mocking
Mock data generation is a prompt engineering technique that involves providing a mock data set for a given code snippet or function. This technique is useful for developers who want to test their code with mock data or for those who want to generate test data for their projects. It avoid creating manually fake data for testing.
Go further
Testing
Testing is a prompt engineering technique that involves providing a test case for a given code snippet or function. This technique is useful for developers who want to test their code or for those who want to ensure the correctness of their code.
System design and architecture
System design and architecture is a prompt engineering technique that involves providing a system design or architecture for a given code snippet or function. This technique is useful for developers who want to design their code or for those who want to understand the overall architecture of their projects.
Documentation generation
Documentation generation is a prompt engineering technique that involves providing a documentation for a given code snippet or function. This technique is useful for developers who want to document their code or for those who want to provide documentation for their projects. It can be used to generate documentation in various formats such as Markdown, HTML, or PDF.
Commit Message Generation
Commit message generation is a prompt engineering technique that involves providing a commit message for a given code snippet or function. This technique is useful for developers who want to generate commit messages for their code or for those who want to ensure that their commit messages are clear and concise.
Vulnerability checking
Vulnerability checking is a prompt engineering technique that involves providing a vulnerability check for a given code snippet or function. This technique is useful for developers who want to check for vulnerabilities in their code or for those who want to ensure that their code is secure.
Warning
This prompt is not recommended for production use. It is intended for testing and debugging purposes only and is not a proof of security or safety of your app.
Shell/CLI commands manual
As a developer, you’re not limited to only writing code. LLMs can assist with CLI such as shell commands and version control using Git.
Regular expression explanation
You can understand complex regular expressions and generate ones that match specific patterns in text. This technique is useful for developers who want to write complex regular expressions or for those who want to understand the syntax of regular expressions.
Explain this regular expression in JavaScript: const regex =
+/^[A-Za-z0–9._%+-]+@[A-Za-z0–9.-]+\\\\.[A-Za-z]{2,}$/;
+🧪 Exercises
Exercise 1: Basic Function Creation
- Create a function that calculates the factorial of a number.
- Handle both positive integers and zero, with error handling for negative inputs.
Expected Output (python)
def factorial(n):
+ if n < 0:
+ raise ValueError("Input must be a non-negative integer.")
+ if n == 0:
+ return 1
+ result = 1
+ for i in range(1, n + 1):
+ result *= i
+ return result
+Exercise 2: API Request Handling
- Write a function to fetch data from a given URL using the Fetch API.
- Return the JSON response and handle any potential errors.
Expected Output (javascript)
async function fetchData(url) {
+ try {
+ const response = await fetch(url);
+ if (!response.ok) {
+ throw new Error(\`HTTP error! status: \${response.status}\`);
+ }
+ const data = await response.json();
+ return data;
+ } catch (error) {
+ console.error("Error fetching data:", error);
+ }
+}
+Exercise 3: Class Definition
- Define a class representing a book with properties for title, author, and publication year.
- Include a method to display the book's details.
Expected Output (C#)
public class Book
+{
+ public string Title { get; set; }
+ public string Author { get; set; }
+ public int PublicationYear { get; set; }
+
+ public void DisplayDetails()
+ {
+ Console.WriteLine($"Title: {Title}, Author: {Author}, Year: {PublicationYear}");
+ }
+}
+Exercise 4: Simple Web Server
- Set up a basic web server that listens on port 3000.
- Respond with a simple message when accessed.
Expected Output (Javascript)
const http = require('http');
+
+const server = http.createServer((req, res) => {
+ res.statusCode = 200;
+ res.setHeader('Content-Type', 'text/plain');
+ res.end('Hello, World!\\n');
+});
+
+server.listen(3000, () => {
+ console.log('Server running at http://localhost:3000/');
+});
+Exercise 5: Data Validation
Details:
- Write a method to validate if a given string is a valid email address.
- Use a regular expression for the validation.
Expected Output (Ruby)
def valid_email?(email)
+ regex = /\\A[\\w+\\-.]+@[a-z\\d\\-.]+\\.[a-z]+\\z/i
+ !!(email =~ regex)
+end
+Exercise 6: Mock Data Generation
Create prompts that can generate mock user profiles. The language used is JavaScript.
The profile should include:
- Name
- Age
- Address (Street, City, State, Zip Code)
- Phone Number
Solutions
Exercise 1: Basic Function Creation
Persona: Python Developer
Task: Create a function
Context: You need to calculate the factorial of a number.
As a Python Developer, create a function named factorial that takes a single integer input and returns its factorial. The function should handle both positive integers and zero. Include error handling for negative inputs.
Exercise 2: API Request Handling
Persona: JavaScript Developer
Task: Write a function to handle API requests
Context: You need to fetch data from a given URL.
As a JavaScript Developer, write a function named fetchData that takes a URL as an argument and fetches data from that URL using the Fetch API. The function should return the JSON response and handle any errors that may occur during the fetch operation.
Exercise 3: Class Definition
Persona: C# Developer
Task: Define a class
Context: You are creating a representation of a book.
As a C# Developer, create a class named Book that has properties for Title, Author, and PublicationYear. Include a method named DisplayDetails that prints the book's details in a formatted string.
Exercise 4: Simple Web Server
Persona: JavaScript Developer
Task: Set up a web server
Context: You need to create a simple server that responds to requests.
As a JavaScript Developer, set up a simple web server using the http module that listens on port 3000 and responds with "Hello, World!" when accessed.
Exercise 5: Data Validation
Persona: Ruby Developer
Task: Write a validation method
Context: You need to validate email addresses.
As a Ruby Developer, write a method named valid_email? that takes a string as input and returns true if it is a valid email address, and false otherwise. Use a regular expression for validation.
Exercise 6: Mock Data Generation
As a JavaScript Developer, write a function named generateUserProfile that generates a mock user profile with the following details: name, age, email, address, and phone number. The function should return an object containing the user profile details.
function generateUserProfile() {
+ const names = ["Alice", "Bob", "Charlie", "David", "Eva"];
+ const randomName = names[Math.floor(Math.random() * names.length)];
+ const randomAge = Math.floor(Math.random() * 50) + 18; // Age between 18 and 67
+ const randomEmail = \`\${randomName.toLowerCase()}@example.com\`;
+ const randomAddress = {
+ street: \`\${Math.floor(Math.random() * 1000)} Main St\`,
+ city: "Sample City",
+ state: "CA",
+ zip: "12345"
+ };
+ const randomPhone = \`(\${Math.floor(Math.random() * 900) + 100})-\${Math.floor(Math.random() * 900) + 100}-\${Math.floor(Math.random() * 9000) + 1000}\`;
+
+ return {
+ name: randomName,
+ age: randomAge,
+ email: randomEmail,
+ address: randomAddress,
+ phone: randomPhone
+ };
+}
+
+// Example usage
+console.log(generateUserProfile());
+Disclamer
LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time.
AI for devs | Tech at Worldline
Who we are
We design payments technology that powers the growth of millions of businesses around the world. Engineering the next frontiers in payments technology
- Leader in payment and secured transactions.
- Over 50bn transactions/year
- 7000+ engineers in over 40 countries
- A huge & diverse tech-stack
Follow trainers of this Hands-on Lab
Gharbi Ibrahim
🔗 @__brah
🔗 cv.gharbi.org
Follow our Tech team
',10)]))}const d=t(l,[["render",s],["__file","index.html.vue"]]),p=JSON.parse(`{"path":"/","title":"AI for devs | Tech at Worldline","lang":"en-US","frontmatter":{"home":true,"heroImage":"./logo.png","heroText":"Hands-on Lab - AI for Devs","tagline":"Discover AI in practice.","actions":[{"text":"Start the Hands-on Lab →","link":"/overview/","type":"primary"}],"features":[{"title":"Let's start","details":"Prerequisites - Definitions - A bit of History - The market"},{"title":"General assistants","details":"Prompt engineering - LibreChat quickstart - Offline prompting"},{"title":"Develop with AI","details":"Github Copilot"},{"title":"AI for services","details":"Cloud LLMs - Advanced RAG"}],"footer":"Worldline © 2024 | tech at Worldline","description":"Disclamer LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time. AI for devs | Tech at Worldline Who we are avatar We de...","head":[["meta",{"property":"og:url","content":"https://worldline.github.io/worldline/learning-ai/learning-ai/"}],["meta",{"property":"og:title","content":"AI for devs | Tech at Worldline"}],["meta",{"property":"og:description","content":"Disclamer LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time. AI for devs | Tech at Worldline Who we are avatar We de..."}],["meta",{"property":"og:type","content":"website"}],["meta",{"property":"og:locale","content":"en-US"}],["meta",{"property":"og:updated_time","content":"2024-11-14T15:16:48.000Z"}],["meta",{"property":"article:modified_time","content":"2024-11-14T15:16:48.000Z"}],["script",{"type":"application/ld+json"},"{\\"@context\\":\\"https://schema.org\\",\\"@type\\":\\"WebPage\\",\\"name\\":\\"AI for devs | Tech at Worldline\\",\\"description\\":\\"Disclamer LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time. AI for devs | Tech at Worldline Who we are avatar We de...\\"}"]]},"headers":[{"level":2,"title":"Who we are","slug":"who-we-are","link":"#who-we-are","children":[{"level":3,"title":"Follow trainers of this Hands-on Lab","slug":"follow-trainers-of-this-hands-on-lab","link":"#follow-trainers-of-this-hands-on-lab","children":[]},{"level":3,"title":"Follow our Tech team","slug":"follow-our-tech-team","link":"#follow-our-tech-team","children":[]}]}],"git":{"updatedTime":1731597408000,"contributors":[{"name":"Brah","email":"brah.gharbi@gmail.com","commits":1,"url":"https://github.com/Brah"},{"name":"Ibrahim Gharbi","email":"brah.gharbi@gmail.com","commits":2,"url":"https://github.com/Ibrahim Gharbi"}]},"filePathRelative":"index.md","autoDesc":true}`);export{d as comp,p as data}; diff --git a/assets/index.html-CRA1Ekr5.js b/assets/index.html-CRA1Ekr5.js new file mode 100644 index 0000000..92203a0 --- /dev/null +++ b/assets/index.html-CRA1Ekr5.js @@ -0,0 +1,4 @@ +import{_ as a,o as t,c as i,a as n}from"./app-DkfO46MA.js";const o={};function r(s,e){return t(),i("div",null,e[0]||(e[0]=[n(`Develop with AI
Github Copilot
Update
Copilot can now use other LLMs than OpenAI, including Google, and Anthropic to provide code suggestions
Github Copilot is a tool that uses the OpenAI language models to provide code suggestions and suggestions for improving code quality.
Alternative code assistance
There is also other producs indegrated to IDEs such as Gitlab Duo, Gemini Code Assist, SuperMaven, AWS CodeWhisperer, and more.
Copilot Chat
Copilot Chat is a chat interface that allows you to ask questions and get suggestions for code improvements.
it's available on :
- JetBrains IDEs
- Visual Studio
- Visual Studio Code
- In Github mobile App
- Web version in github.com (Preview)
It is a similar approach to chat GPT prompting optimised for the developper experience.
CLI
CLI helps you using you command line interpreter You can use it in the terminal with the following command:
gh auth login
+gh extension install github.copilot
+gh copilot explain "traceroute github.com"
+Warning
Github CLI is not supported yet with our Worldline account, so you need to use the web version with the link here
JetBrains integration
Completion
Assistance
Refactoring
Test generation
Documentation
Architecture diagram
VSCode integration
Completion
Assistance
Refactoring
Test generation
Documentation
Architecture diagram
Gihub Spark
GitHub Spark is an AI-powered tool for creating and sharing micro apps (“sparks”), which can be tailored to your exact needs and preferences, and are directly usable from your desktop and mobile devices. Without needing to write or deploy any code.
And it enables this through a combination of three tightly-integrated components:
An NL-based editor, which allows easily describing your ideas, and then refining them over time A managed runtime environment, which hosts your sparks, and provides them access to data storage, theming, and LLMs A PWA-enabled dashboard, which lets you manage and launch your sparks from anywhere
🧪 Exercises
📖 Further readings
*Worldline AI coding assistant
`,36)]))}const h=a(o,[["render",r],["__file","index.html.vue"]]),c=JSON.parse('{"path":"/develop/","title":"Develop with AI","lang":"en-US","frontmatter":{"description":"Develop with AI Github Copilot Update Copilot can now use other LLMs than OpenAI, including Google, and Anthropic to provide code suggestions Github Copilot is a tool that uses ...","head":[["meta",{"property":"og:url","content":"https://worldline.github.io/worldline/learning-ai/learning-ai/develop/"}],["meta",{"property":"og:title","content":"Develop with AI"}],["meta",{"property":"og:description","content":"Develop with AI Github Copilot Update Copilot can now use other LLMs than OpenAI, including Google, and Anthropic to provide code suggestions Github Copilot is a tool that uses ..."}],["meta",{"property":"og:type","content":"article"}],["meta",{"property":"og:locale","content":"en-US"}],["meta",{"property":"og:updated_time","content":"2024-11-20T13:15:23.000Z"}],["meta",{"property":"article:modified_time","content":"2024-11-20T13:15:23.000Z"}],["script",{"type":"application/ld+json"},"{\\"@context\\":\\"https://schema.org\\",\\"@type\\":\\"Article\\",\\"headline\\":\\"Develop with AI\\",\\"image\\":[\\"\\"],\\"dateModified\\":\\"2024-11-20T13:15:23.000Z\\",\\"author\\":[]}"]]},"headers":[{"level":2,"title":"Github Copilot","slug":"github-copilot","link":"#github-copilot","children":[{"level":3,"title":"Copilot Chat","slug":"copilot-chat","link":"#copilot-chat","children":[]},{"level":3,"title":"CLI","slug":"cli","link":"#cli","children":[]},{"level":3,"title":"JetBrains integration","slug":"jetbrains-integration","link":"#jetbrains-integration","children":[]},{"level":3,"title":"VSCode integration","slug":"vscode-integration","link":"#vscode-integration","children":[]}]},{"level":2,"title":"Gihub Spark","slug":"gihub-spark","link":"#gihub-spark","children":[]},{"level":2,"title":"🧪 Exercises","slug":"🧪-exercises","link":"#🧪-exercises","children":[]},{"level":2,"title":"📖 Further readings","slug":"📖-further-readings","link":"#📖-further-readings","children":[]}],"git":{"updatedTime":1732108523000,"contributors":[{"name":"Brah","email":"brah.gharbi@gmail.com","commits":1,"url":"https://github.com/Brah"},{"name":"Ibrahim Gharbi","email":"brah.gharbi@gmail.com","commits":3,"url":"https://github.com/Ibrahim Gharbi"}]},"filePathRelative":"develop/README.md","autoDesc":true}');export{h as comp,c as data}; diff --git a/assets/index.html-D0-PoVlK.js b/assets/index.html-D0-PoVlK.js new file mode 100644 index 0000000..0ad5543 --- /dev/null +++ b/assets/index.html-D0-PoVlK.js @@ -0,0 +1 @@ +import{_ as i,o as a,c as o,a as n}from"./app-DkfO46MA.js";const t={};function r(s,e){return a(),o("div",null,e[0]||(e[0]=[n('AI for services
APIs with LibreChat
For basic APIs exchange with LibreChat, you can use simple HTTP requests. You can use the /api/v1/chat/completions endpoint to send a request to the API and receive a response.
CloudAI with GCP
GCP is a suite of cloud computing services provided by Google. It includes a wide range of tools and services for building and consuming LLMs, such as Vertex AI, Google Colab, and ML Flow.
Large Consumer-Facing
These products are directly available to consumers, often integrating AI capabilities into everyday applications:
- Google Colaboratory (Colab): A free Jupyter Notebook environment hosted by Google. Excellent for learning, experimentation, and sharing machine learning code. While not a "production" platform like Vertex AI, it's extremely popular for its ease of use and free access to compute resources (though with limitations).
- Gemini: Google's large language model (LLM), positioned as a competitor to OpenAI's GPT models. Gemini's capabilities are integrated into various Google products and services, and are also accessible through APIs. Different versions of Gemini (e.g., Gemini Pro, Gemini Ultra) offer varying levels of capability and access. It powers several consumer-facing features across Google's ecosystem.
- AI Studio Cloud-based machine learning platform offered by several companies, most notably Google with its Google AI Studio (now largely integrated into Vertex AI) and Amazon with Amazon SageMaker Studio. While both share the general goal of providing a user-friendly environment for building, training, and deploying machine learning models, their specific features and offerings differ. https://aistudio.google.com/
Vertex AI
This is the central hub for most Google Cloud's AI/ML services. It integrates and supersedes many previous offerings.
- Vertex AI Training: Training machine learning models using various algorithms and frameworks (TensorFlow, PyTorch, scikit-learn, XGBoost, etc.). Provides access to managed compute instances (including TPUs).
- Vertex AI Prediction: Deploying trained models for inference (making predictions). Offers different deployment options based on scale and latency requirements.
- Vertex AI Pipelines: Creating and managing machine learning workflows, including data preprocessing, model training, evaluation, and deployment, as a series of connected steps.
- Vertex AI Model Monitoring: Monitoring deployed models for performance degradation and potential issues (drift).
- Vertex AI Feature Store: Centralized repository for storing, managing, and versioning features used in machine learning models, improving collaboration and reuse.
- Vertex AI Matching Engine: A service for performing similarity searches (for example, recommendation systems).
Google Cloud APIs
Pre-trained Models and APIs: Google offers numerous pre-trained models and APIs for various tasks, making it easier to integrate AI into applications without building models from scratch. Examples include:
- Google Cloud Natural Language API: Processing and understanding text (sentiment analysis, entity recognition, etc.). Google Cloud Vision API: Analyzing images (object detection, image classification, optical character recognition, etc.).
- Google Cloud Speech-to-Text API: Converting audio to text.
- Google Cloud Text-to-Speech API: Converting text to audio.
- Google Cloud Translation API: Translating text between languages.
- Other APIs: Many more APIs exist for various tasks like video intelligence, dialogflow (conversational AI), and more.
Specialized AI Products
Beyond the core platform and APIs, Google offers several specialized AI products:
- TensorFlow: A popular open-source machine learning framework developed by Google. While not strictly a "Google Cloud" product, it's deeply integrated with their services.
- TensorFlow Extended (TFX): A platform for deploying TensorFlow models at scale, often used in conjunction with Vertex AI.
- JAX: A high-performance machine learning library, often used for research and advanced applications.
- Google AI Platform Notebooks (integrated into Vertex AI): Jupyter Notebook environments hosted on Google Cloud. (Previously a separate offering, often confused with Google Colab.)
- Dialogflow CX: A conversational AI platform for building complex conversational experiences.
Manage models (ML Flow)
MLflow provides tools for managing experiments, tracking model versions, deploying models to various environments, and managing models in a central registry. It's designed to be platform-agnostic, meaning it can work with many different cloud providers and even on-premises infrastructure.
Function calling (langchain4j)
Function calling is a feature that allows you to call functions from other services. It is useful for working with functions, such as APIs, and for interacting with models that require function calls.
To use function calling, you need to specify the function name and arguments in the prompt.
Ressouces Jean François James
Structured Outputs (Json Mode)
Json mode is a feature that allows you to send structured data to the model. It is useful for working with structured data, such as JSON objects, and for interacting with models that require structured input.
To use Json mode, you need to specify the input format as JSON in the prompt. You can do this by adding the following line to the beginning of your prompt:
Advanced RAG (llama-index)
RAG with Ollama CLI with Langchain4j and llama-index
Collaborative (Hugging Face)
The platform where the machine learning community collaborates on models, datasets, and applications.
Hugging Face is a platform for researchers and developers to share, explore, and build AI models. It provides a centralized repository for models, datasets, and applications, making it easy to find, use, and contribute to the growing ecosystem of AI technologies.
- Creating/deploy/customize a model
- Pre-trained model, use behind the APIs, also a ML part, training model generation for use
🧪 Exercises
📖 Further readings
',34)]))}const c=i(t,[["render",r],["__file","index.html.vue"]]),d=JSON.parse('{"path":"/services/","title":"AI for services","lang":"en-US","frontmatter":{"description":"AI for services APIs with LibreChat For basic APIs exchange with LibreChat, you can use simple HTTP requests. You can use the /api/v1/chat/completions endpoint to send a request...","head":[["meta",{"property":"og:url","content":"https://worldline.github.io/worldline/learning-ai/learning-ai/services/"}],["meta",{"property":"og:title","content":"AI for services"}],["meta",{"property":"og:description","content":"AI for services APIs with LibreChat For basic APIs exchange with LibreChat, you can use simple HTTP requests. You can use the /api/v1/chat/completions endpoint to send a request..."}],["meta",{"property":"og:type","content":"article"}],["meta",{"property":"og:locale","content":"en-US"}],["meta",{"property":"og:updated_time","content":"2024-11-20T13:15:23.000Z"}],["meta",{"property":"article:modified_time","content":"2024-11-20T13:15:23.000Z"}],["script",{"type":"application/ld+json"},"{\\"@context\\":\\"https://schema.org\\",\\"@type\\":\\"Article\\",\\"headline\\":\\"AI for services\\",\\"image\\":[\\"\\"],\\"dateModified\\":\\"2024-11-20T13:15:23.000Z\\",\\"author\\":[]}"]]},"headers":[{"level":2,"title":"APIs with LibreChat","slug":"apis-with-librechat","link":"#apis-with-librechat","children":[]},{"level":2,"title":"CloudAI with GCP","slug":"cloudai-with-gcp","link":"#cloudai-with-gcp","children":[{"level":3,"title":"Large Consumer-Facing","slug":"large-consumer-facing","link":"#large-consumer-facing","children":[]},{"level":3,"title":"Vertex AI","slug":"vertex-ai","link":"#vertex-ai","children":[]},{"level":3,"title":"Google Cloud APIs","slug":"google-cloud-apis","link":"#google-cloud-apis","children":[]},{"level":3,"title":"Specialized AI Products","slug":"specialized-ai-products","link":"#specialized-ai-products","children":[]}]},{"level":2,"title":"Manage models (ML Flow)","slug":"manage-models-ml-flow","link":"#manage-models-ml-flow","children":[]},{"level":2,"title":"Function calling (langchain4j)","slug":"function-calling-langchain4j","link":"#function-calling-langchain4j","children":[]},{"level":2,"title":"Structured Outputs (Json Mode)","slug":"structured-outputs-json-mode","link":"#structured-outputs-json-mode","children":[]},{"level":2,"title":"Advanced RAG (llama-index)","slug":"advanced-rag-llama-index","link":"#advanced-rag-llama-index","children":[]},{"level":2,"title":"Collaborative (Hugging Face)","slug":"collaborative-hugging-face","link":"#collaborative-hugging-face","children":[]},{"level":2,"title":"🧪 Exercises","slug":"🧪-exercises","link":"#🧪-exercises","children":[]},{"level":2,"title":"📖 Further readings","slug":"📖-further-readings","link":"#📖-further-readings","children":[]}],"git":{"updatedTime":1732108523000,"contributors":[{"name":"Brah","email":"brah.gharbi@gmail.com","commits":1,"url":"https://github.com/Brah"},{"name":"Ibrahim Gharbi","email":"brah.gharbi@gmail.com","commits":4,"url":"https://github.com/Ibrahim Gharbi"}]},"filePathRelative":"services/README.md","autoDesc":true}');export{c as comp,d as data}; diff --git a/assets/index.html-D0QgU6oo.js b/assets/index.html-D0QgU6oo.js new file mode 100644 index 0000000..b8cad0d --- /dev/null +++ b/assets/index.html-D0QgU6oo.js @@ -0,0 +1,6 @@ +import{_ as a,o as t,c as i,a as n}from"./app-DkfO46MA.js";const s="/learning-ai/assets/librechat_interface-CYKYbYEb.png",r="/learning-ai/assets/prompt-D9YI1LJh.png",o="/learning-ai/assets/demo_prompt-BpZVtafc.gif",l="/learning-ai/assets/assistant-BJUR0Mbm.png",p="/learning-ai/assets/multi_plugin-TCdQZhy0.png",c="/learning-ai/assets/result_prompt-C4XLLbdh.png",h={};function d(u,e){return t(),i("div",null,e[0]||(e[0]=[n('Online with Librechat
LibreChat is a free, open source AI chat platform. This Web UI offers vast customization, supporting numerous AI providers, services, and integrations. Serves all AI Conversations in one place with a familiar interface, innovative enhancements, for as many users as you need.
The full librechat documentation is available here
Let's discover how to use LibreChat to create efficient and effective conversations with AI for developers.
Prompts history
Prompts history allows users to save and load prompts for their conversations and easily access them later. Reusing prompts can save time and effort, especially when working with multiple conversations and keep track of the context and details of a conversation.
Favorites
The favorites feature allows users to save and load favorite prompts for their conversations and easily access them later.
Presets
The presets feature allows users to save and load predefined settings for initialise a conversations. Users can import and export these presets as JSON files, set a default preset, and share them with others.
Preformatted prompts
The prompts feature allows users to save and load predefined prompts to use it during their conversations. You can use a prompt with the /[prompt command]. A prompt can have parameters, which are replaced with values when the prompt is used.
Exemple of preformatted prompts : Explain the following code snippet in Java, Kotlin or Javascript
- Click on the
+button to add a new prompt. - name your prompt :
explain - on Text tab, you can write your prompt :
Explain the following {{language:Java|Kotlin|Javascript}} snippet of code:
+{{code}}
+- Now you can use the
/explaincommand to get the explanation of the code snippet.
AI providers
Azure OpenAI
Azure OpenAI Service provides REST API access to OpenAI's powerful language models, including the o1-preview, o1-mini, GPT-4o, GPT-4o mini, GPT-4 Turbo with Vision, GPT-4, GPT-3.5-Turbo, and Embeddings model series.
Google Gemini
Gemini is a large language model (LLM) developed by Google. It's designed to be a multimodal AI, meaning it can work with and understand different types of information, including text, code, audio, and images. Google positions Gemini as a highly capable model for a range of tasks, from answering questions and generating creative content to problem-solving and more complex reasoning. There are different versions of Gemini, optimized for different tasks and scales.
Anthropic Claude
Claude is an Artificial Intelligence, trained by Anthropic. Claude can process large amounts of information, brainstorm ideas, generate text and code, help you understand subjects, coach you through difficult situations, help simplify your busywork so you can focus on what matters most, and so much more.
Assistants
The Assistants API enables the creation of AI assistants, offering functionalities like code interpreter, knowledge retrieval of files, and function execution. The Assistants API allows you to build AI assistants within your own applications for specific needs. An Assistant has instructions and can leverage models, tools, and files to respond to user queries. The Assistants API currently supports three types of tools: Code Interpreter, File Search, and Function calling.
Plugins
The plugins endpoint opens the door to prompting LLMs in new ways other than traditional input/output prompting.
Warning
Every additional plugin selected will increase your token usage as there are detailed instructions the LLM needs for each one For best use, be selective with plugins per message and narrow your requests as much as possible
DALL-E 3
Dall-e 3 is a librechat Plugin for generating images from text. You can use it to generate images from text, such as product descriptions, product images, or even documentation images to illustrate your technical documentation.
Confluence
Ask confluence is a librechat Plugin for Confluence documents.
IT support
Ask for IT support enable you to get support from the IT team and create WLSD tickets from your chats.
WOLF
Wolf is a librechat Plugin for WL Managagement System documents. The sharepoint documention is available here
Ask to WorldLine management system Friend everything you are looking for in the WMS content. AskWOLF plugin is meant to help you navigate through the multitude of information provided by the WMS (Applicable Policies, Processes & Procedures, Transversal & Operations SP pages links, …). This Worldline LibreChat plugin relies on ChatGPT technologies.
Worldline Management System (WMS) is the Group reference for all information pertaining to our operating model such as applicable policies, processes and governance structures. Key responsibilities are :
- consistently address its customers’ and markets’ requirements across all its geographies
- continuous improvement of customer satisfaction through effective application of WMS
- correct interpretation of applicable ISO standards requirements
Example of prompts:
- AskWOLF: What is the WMS?
- AskWOLF: What are the policies?
- AskWOLF: What are the processes?
Browse plugins
Retrieve data from internet and use it to generate a response.
Plugin mixing
You can mix plugins to create more complex prompts. For example, you can use the DALL-E 3 plugin to generate images from text and then use the IT support plugin to get support from the IT team.
Generate the favicon 16x16 pixels based on the content found in
+https://worldline.github.io/learning-ai/overview/ with Browser plugin
+and generate the favicon with DallE. I want no background and black and white image
+RAG
RAG is possible with LibreChat. You can use RAG to create a conversation with the AI. To can add files to the conversation, you go to the file tab and select the file you want to add. Then the file will be added to the file manager and you can use it in the prompt.
The file can be an png, a video, a text file, or a PDF file.
🧪 Exercises
1. Prompt creation
Select one prompt engineering technique and make a prompt in librechat that can be called with the /[prompt_name] command.
2. Plugins mixing
Use the Browse and Dall-E plugins to create a prompt that generates a a favicon based on the content of this learning-ai website.
3. Make your own assistant
Choose your favorite topic ( cooking, travel, sports, etc.) and create an assistant that can answer questions about it. You can share documents, files and instructions to configure your custom assistant and use it.
📖 Further readings
- LibreChat Worldline guides
- LibreChat worldline instance
- LibreChat official website
- LibreChat Github repository
- Gemini Prompting guide
- Azure search
- Google programmable search engine
- Claude AI
- OpenAI Assistant feature
Let's start
Warning
LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time.
Prerequisites
Shell Command Line Skills:
The AI should include support for providing guidance on using shell commands, navigating file systems, and executing command-line operations across different operating systems.
Understanding of HTTP and API:
Proficiency in HTTP protocol, RESTful API concepts, and web service integration is crucial for the AI to provide support on API design, consumption, and troubleshooting common API-related issues.
Basic Cloud Knowledge:
Understanding of cloud computing principles, including basic concepts of cloud infrastructure, services, and deployment models, will enable the AI to offer guidance on cloud-based development, deployment, and best practices.
Warning
Additionnaly, Request Worldline librechat access: send a mail at Generative AI Taskforce email
There is a dedicated sharepoint for basic general assistant quick start at Worldline : LibreChat Worldline guides
Definitions
Large Language Model (LLM)
Large Language Model is a powerful type of AI model trained on massive datasets of text and code. LLMs can understand, generate, and manipulate language. Ex : ChatGPT, Bard, Codex
What are Large Language Models (LLMs)? by Google for developpers
',14),i("iframe",{width:"560",height:"315",src:"https://www.youtube.com/embed/iR2O2GPbB0E",title:"What are Large Language Models (LLMs)? by Google for developpers",frameborder:"0",allow:"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture",allowfullscreen:""},null,-1),a('Multi-Modal LLM (MMLLM)
Multi-Modal Large Language Model is an advanced LLM that can process and generate both text and other data formats like images, audio, or video. Ex: DALL-E 2, Stable Diffusion (for image generation)
Machine Learning (ML)
Machine Learning is a subset of AI that focuses on training algorithms to learn from data and make predictions or decisions without explicit programming. ML powers many AI applications, including image recognition, natural language processing, and predictive analytics.
Deep Learning (DL)
Deep Learning is a type of ML that uses artificial neural networks with multiple layers to learn complex patterns from data.DL has revolutionized fields like computer vision, speech recognition, and machine translation.
Neural Network
A computational model inspired by the structure of the human brain, consisting of interconnected nodes (neurons) organized in layers.Neural networks are the core building blocks of deep learning models.
Natural Language Processing (NLP)
Natural Language Processing is a branch of Artificial Intelligence (AI) that focuses on enabling computers to understand, interpret, and generate human language. It implies :
- Text Analysis
- Language Understanding
- Text Generation
- Translation
- Speech Recognition: Powers voice assistants and speech-to-text technologies
Prompt:
A specific set of instructions or questions given to an LLM to guide its response. Well-crafted prompts are crucial for getting accurate and relevant output from LLMs. Ex : "Write a Python function to check if a string is a palindrome."
Token:
The smallest unit of meaning processed by an LLM. Tokens can be words, parts of words, punctuation marks, or special characters. LLMs process text by analyzing sequences of tokens, making it important to understand how they are broken down. Ex : The sentence "I love programming" would be split into the following tokens: "I", "love", "programming".
Temperature:
A parameter in some LLMs that controls the randomness or creativity of the generated text. Adjust temperature based on the desired level of creativity or accuracy in the LLM's output.
- A higher temperature generate more randomness and unpredictability in the output.
- A lower temperature generate more predictable and coherent output.
RAG: Retrieval Augmented Generation
RAG (Retrieval Augmented Generation) is a powerful technique in the field of Natural Language Processing (NLP) that combines the best of both worlds: information retrieval and language generation.
- The system first retrieves relevant information from a vast knowledge base (often a database or a set of documents) based on the user's query or prompt.
- This retrieved information is then used to augment the language model's input, providing it with more context and specific facts.
- Finally, the language model uses this augmented input to generate a more comprehensive and informative response, leveraging both its knowledge base and its language generation capabilities.
A bit of History
AI's history has been marked by periods of progress and setbacks. Computing power, data availability, and algorithmic advancements have played crucial roles in AI's evolution. AI is no longer limited to expert systems but encompasses a wide range of techniques and applications.
- 1950: Alan Turing proposes the "Turing Test" to assess machine intelligence.
During the turing test, the human questioner asks a series of questions to both respondantes. After the specified time, the questionner tries to decide which terminal is operated bu the human respondant and which terminal is operated by the computer.
1956: Dartmouth Conference establishes the field of "Artificial Intelligence".
1959: Arthur Samuel develops a checkers-playing program that learns and improves over time.
1960s: Research focused on logic-based reasoning and early expert systems.
1972: The first expert system, DENDRAL, is developed for identifying organic molecules.
1980s-1990s: Development of new techniques like machine learning and neural networks.
1997: Deep Blue, a chess-playing computer, defeats Garry Kasparov, the world chess champion.
1990s-2000s: Advances in computing power, data availability, and algorithms as fuel for AI progress.
2010s: Deep learning revolutionizes AI with breakthroughs in image recognition, speech recognition, and natural language processing.
2011: Watson, an IBM supercomputer, wins Jeopardy! against human champions.
2016: AlphaGo, a program developed by Google DeepMind, defeats Go champion Lee Sedol.
2022: First release of ChatGPT : AI continues to evolve rapidly, with advancements in areas like autonomous vehicles, robotics, and personalized medicine.
The market
🧪 Exercises
1. LLMs and MMLLMs are constantly evolving.
2. Multi-Modal LLMs can process and generate only text data.
3. Which of the following are examples of Machine Learning applications?
4. Deep Learning uses artificial neural networks with multiple layers.
5. Natural Language Processing (NLP) includes which of the following?
6. RAG stands for Retrieval Augmented Generation.
7. LLMs can only generate text and cannot understand it.
8. Which of the following is NOT a type of Machine Learning?
9. Deep Learning models require less data than traditional Machine Learning models.
10. Natural Language Processing can be used for sentiment analysis.
11. Which of the following are common applications of Deep Learning?
12. RAG can improve the accuracy of responses generated by LLMs.
13. Which of the following is a benefit of using Cloud Computing for AI?
14. The Turing Test is designed to evaluate a machine's ability to exhibit intelligent behavior.
15. Multi-Modal LLMs can only process text and images.
Solution
1. LLMs and MMLLMs are constantly evolving.
2. Multi-Modal LLMs can process and generate only text data.
3. Which of the following are examples of Machine Learning applications?
4. Deep Learning uses artificial neural networks with multiple layers.
5. Natural Language Processing (NLP) includes which of the following?
6. RAG stands for Retrieval Augmented Generation.
7. LLMs can only generate text and cannot understand it.
8. Which of the following is NOT a type of Machine Learning?
9. Deep Learning models require less data than traditional Machine Learning models.
10. Natural Language Processing can be used for sentiment analysis.
11. Which of the following are common applications of Deep Learning?
12. RAG can improve the accuracy of responses generated by LLMs.
13. Which of the following is a benefit of using Cloud Computing for AI?
14. The Turing Test is designed to evaluate a machine's ability to exhibit intelligent behavior.
15. Multi-Modal LLMs can only process text and images.
📖 Further readings
',35)]))}const m=t(d,[["render",u],["__file","index.html.vue"]]),f=JSON.parse(`{"path":"/overview/","title":"Let's start","lang":"en-US","frontmatter":{"description":"Let's start Warning LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time. Prerequisites Shell Command Line Skills: The ...","head":[["meta",{"property":"og:url","content":"https://worldline.github.io/worldline/learning-ai/learning-ai/overview/"}],["meta",{"property":"og:title","content":"Let's start"}],["meta",{"property":"og:description","content":"Let's start Warning LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time. Prerequisites Shell Command Line Skills: The ..."}],["meta",{"property":"og:type","content":"article"}],["meta",{"property":"og:locale","content":"en-US"}],["meta",{"property":"og:updated_time","content":"2024-11-20T13:15:23.000Z"}],["meta",{"property":"article:modified_time","content":"2024-11-20T13:15:23.000Z"}],["script",{"type":"application/ld+json"},"{\\"@context\\":\\"https://schema.org\\",\\"@type\\":\\"Article\\",\\"headline\\":\\"Let's start\\",\\"image\\":[\\"\\"],\\"dateModified\\":\\"2024-11-20T13:15:23.000Z\\",\\"author\\":[]}"]]},"headers":[{"level":2,"title":"Prerequisites","slug":"prerequisites","link":"#prerequisites","children":[]},{"level":2,"title":"Definitions","slug":"definitions","link":"#definitions","children":[{"level":3,"title":"Large Language Model (LLM)","slug":"large-language-model-llm","link":"#large-language-model-llm","children":[]},{"level":3,"title":"Multi-Modal LLM (MMLLM)","slug":"multi-modal-llm-mmllm","link":"#multi-modal-llm-mmllm","children":[]},{"level":3,"title":"Machine Learning (ML)","slug":"machine-learning-ml","link":"#machine-learning-ml","children":[]},{"level":3,"title":"Deep Learning (DL)","slug":"deep-learning-dl","link":"#deep-learning-dl","children":[]},{"level":3,"title":"Neural Network","slug":"neural-network","link":"#neural-network","children":[]}]},{"level":2,"title":"A bit of History","slug":"a-bit-of-history","link":"#a-bit-of-history","children":[]},{"level":2,"title":"The market","slug":"the-market","link":"#the-market","children":[]},{"level":2,"title":"🧪 Exercises","slug":"🧪-exercises","link":"#🧪-exercises","children":[]},{"level":2,"title":"📖 Further readings","slug":"📖-further-readings","link":"#📖-further-readings","children":[]}],"git":{"updatedTime":1732108523000,"contributors":[{"name":"Brah","email":"brah.gharbi@gmail.com","commits":3,"url":"https://github.com/Brah"},{"name":"Ibrahim Gharbi","email":"brah.gharbi@gmail.com","commits":4,"url":"https://github.com/Ibrahim Gharbi"}]},"filePathRelative":"overview/README.md","autoDesc":true}`);export{m as comp,f as data}; diff --git a/assets/index.html-bbNjYxoL.js b/assets/index.html-bbNjYxoL.js new file mode 100644 index 0000000..dc03679 --- /dev/null +++ b/assets/index.html-bbNjYxoL.js @@ -0,0 +1,12 @@ +import{_ as n,o as s,c as a,a as t}from"./app-DkfO46MA.js";const o="/learning-ai/assets/lmstudio-B6PjFtYg.png",i={};function l(p,e){return s(),a("div",null,e[0]||(e[0]=[t('Offline with LM Studio
Disclamer
Be careful with offline prompting models downloaded from the internet. They can contain malicious code. And also the size of the model can be very large from few Gb to few Tb.
Definitions
If you don't want to use the online AI providers, you can use offline prompting. This technique involves using a local LLM to generate responses to prompts. It is useful for developers who want to use a local LLM for offline prompting or for those who want to experiment with different LLMs without relying on online providers.
LM Studio is a tool that allows developers to experiment with different LLMs without relying on online providers. It provides a user-friendly interface for selecting and configuring LLMs, as well as a chat interface for interacting with the LLMs. It also includes features for fine-tuning and deploying LLMs. This technique is useful for developers who want to experiment with different LLMs.
Installation
For installation, you can follow the instructions here
Model configuration
You can configure the model you want to use in the settings tab. You can select the model you want to use and configure it according to your needs.
Context Length: The context length is the number of tokens that will be used as context for the model. This is important because it determines how much information the model can use to generate a response. A longer context length will allow the model to generate more detailed and relevant responses, but it may also increase the computational cost of the model.
GPU Offload: This option allows you to offload the model to a GPU if available. This can significantly speed up the generation process, especially for longer prompts or complex models.
CPU Threads: This option allows you to specify the number of CPU threads to use for the model. This can be useful for controlling the computational resources used by the model.
Evaluation batch size: This option allows you to specify the batch size for evaluation. This is important for evaluating the performance of the model and can affect the speed and accuracy of the generation process.
RoPE Frequency base: This option allows you to specify the frequency base for RoPE (Range-based Output Embedding). This is important for controlling the output length of the model and can affect the quality of the generated responses.
RoPE Frequency scale: This option allows you to specify the frequency scale for RoPE (Range-based Output Embedding). This is important for controlling the output length of the model and can affect the quality of the generated responses.
Keep model in memory: This option allows you to keep the model in memory after the generation process is complete. This can be useful for generating multiple responses or for using the model for offline prompting.
Try mmap() for faster loading: This option allows you to try using mmap() for faster loading of the model. This can be useful for loading large models or for generating responses quickly.
Seed: This option allows you to specify a seed for the model. This can be useful for controlling the randomness of the generated responses.
Flash Attention: This option allows you to enable flash attention for the model. This can be useful for generating more detailed and accurate responses, but it may also increase the computational cost of the model.
enable APIs
You can use the APIs to generate responses from the models. To enable the API server with LM Studio, you need to set the API Server option to ON in the settings tab. You can then use the API endpoints to generate responses from the models.
2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] Success! HTTP server listening on port 1234
+2024-11-15 18:45:22 [INFO]
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] Supported endpoints:
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> GET http://localhost:1234/v1/models
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> POST http://localhost:1234/v1/chat/completions
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> POST http://localhost:1234/v1/completions
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> POST http://localhost:1234/v1/embeddings
+2024-11-15 18:45:22 [INFO]
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] Logs are saved into /Users/ibrahim/.cache/lm-studio/server-logs
+2024-11-15 18:45:22 [INFO] Server started.
+2024-11-15 18:45:22 [INFO] Just-in-time model loading active.
+You can use the endpoints to generate responses from the models. The endpoints are as follows:
GET /v1/models: This endpoint returns a list of the available models.POST /v1/chat/completions: This endpoint generates responses from the models using the chat format.Chat format is used for tasks such as chatbots, conversational AI, and language learning.POST /v1/completions: This endpoint generates responses from the models using the completion format. Completion format is used for tasks such as question answering, summarization, and text generation.POST /v1/embeddings: This endpoint generates embeddings from the models. Embeddings are used for tasks such as sentiment analysis, text classification, and language translation.
🧪 Exercises
📖 Further readings
`,27)]))}const c=n(i,[["render",l],["__file","index.html.vue"]]),d=JSON.parse('{"path":"/offline/","title":"Offline with LM Studio","lang":"en-US","frontmatter":{"description":"Offline with LM Studio Disclamer Be careful with offline prompting models downloaded from the internet. They can contain malicious code. And also the size of the model can be ve...","head":[["meta",{"property":"og:url","content":"https://worldline.github.io/worldline/learning-ai/learning-ai/offline/"}],["meta",{"property":"og:title","content":"Offline with LM Studio"}],["meta",{"property":"og:description","content":"Offline with LM Studio Disclamer Be careful with offline prompting models downloaded from the internet. They can contain malicious code. And also the size of the model can be ve..."}],["meta",{"property":"og:type","content":"article"}],["meta",{"property":"og:locale","content":"en-US"}],["meta",{"property":"og:updated_time","content":"2024-11-15T17:49:41.000Z"}],["meta",{"property":"article:modified_time","content":"2024-11-15T17:49:41.000Z"}],["script",{"type":"application/ld+json"},"{\\"@context\\":\\"https://schema.org\\",\\"@type\\":\\"Article\\",\\"headline\\":\\"Offline with LM Studio\\",\\"image\\":[\\"\\"],\\"dateModified\\":\\"2024-11-15T17:49:41.000Z\\",\\"author\\":[]}"]]},"headers":[{"level":2,"title":"Definitions","slug":"definitions","link":"#definitions","children":[]},{"level":2,"title":"Installation","slug":"installation","link":"#installation","children":[]},{"level":2,"title":"Model configuration","slug":"model-configuration","link":"#model-configuration","children":[]},{"level":2,"title":"enable APIs","slug":"enable-apis","link":"#enable-apis","children":[]},{"level":2,"title":"🧪 Exercises","slug":"🧪-exercises","link":"#🧪-exercises","children":[]},{"level":2,"title":"📖 Further readings","slug":"📖-further-readings","link":"#📖-further-readings","children":[]}],"git":{"updatedTime":1731692981000,"contributors":[{"name":"Brah","email":"brah.gharbi@gmail.com","commits":1,"url":"https://github.com/Brah"}]},"filePathRelative":"offline/README.md","autoDesc":true}');export{c as comp,d as data}; diff --git a/assets/jeopardy-CySJ857r.jpg b/assets/jeopardy-CySJ857r.jpg new file mode 100644 index 0000000..e490acb Binary files /dev/null and b/assets/jeopardy-CySJ857r.jpg differ diff --git a/assets/librechat_interface-CYKYbYEb.png b/assets/librechat_interface-CYKYbYEb.png new file mode 100644 index 0000000..21a139b Binary files /dev/null and b/assets/librechat_interface-CYKYbYEb.png differ diff --git a/assets/lmstudio-B6PjFtYg.png b/assets/lmstudio-B6PjFtYg.png new file mode 100644 index 0000000..956e83e Binary files /dev/null and b/assets/lmstudio-B6PjFtYg.png differ diff --git a/assets/logo_worldline-t5KadDQv.png b/assets/logo_worldline-t5KadDQv.png new file mode 100644 index 0000000..6981642 Binary files /dev/null and b/assets/logo_worldline-t5KadDQv.png differ diff --git a/assets/market-C_dAjFms.png b/assets/market-C_dAjFms.png new file mode 100644 index 0000000..3afffea Binary files /dev/null and b/assets/market-C_dAjFms.png differ diff --git a/assets/multi_plugin-TCdQZhy0.png b/assets/multi_plugin-TCdQZhy0.png new file mode 100644 index 0000000..ee1ea76 Binary files /dev/null and b/assets/multi_plugin-TCdQZhy0.png differ diff --git a/assets/prompt-D9YI1LJh.png b/assets/prompt-D9YI1LJh.png new file mode 100644 index 0000000..9ab8068 Binary files /dev/null and b/assets/prompt-D9YI1LJh.png differ diff --git a/assets/result_prompt-C4XLLbdh.png b/assets/result_prompt-C4XLLbdh.png new file mode 100644 index 0000000..fa8a390 Binary files /dev/null and b/assets/result_prompt-C4XLLbdh.png differ diff --git a/assets/setupDevtools-7MC2TMWH-BnF_1LTO.js b/assets/setupDevtools-7MC2TMWH-BnF_1LTO.js new file mode 100644 index 0000000..b753321 --- /dev/null +++ b/assets/setupDevtools-7MC2TMWH-BnF_1LTO.js @@ -0,0 +1 @@ +import{s as T,w as E}from"./app-DkfO46MA.js";var l="org.vuejs.vuepress",v="VuePress",I=v,r=l,N=v,i="client-data",a="Client Data",g=(p,n)=>{T({app:p,id:l,label:v,packageName:"@vuepress/client",homepage:"https://vuepress.vuejs.org",logo:"https://vuepress.vuejs.org/images/hero.png",componentStateTypes:[I]},t=>{const c=Object.entries(n),u=Object.keys(n),d=Object.values(n);t.on.inspectComponent(e=>{e.instanceData.state.push(...c.map(([s,o])=>({type:I,editable:!1,key:s,value:o.value})))}),t.addInspector({id:r,label:N,icon:"article"}),t.on.getInspectorTree(e=>{e.inspectorId===r&&(e.rootNodes=[{id:i,label:a,children:u.map(s=>({id:s,label:s}))}])}),t.on.getInspectorState(e=>{e.inspectorId===r&&(e.nodeId===i&&(e.state={[a]:c.map(([s,o])=>({key:s,value:o.value}))}),u.includes(e.nodeId)&&(e.state={[a]:[{key:e.nodeId,value:n[e.nodeId].value}]}))}),E(d,()=>{t.notifyComponentUpdate(),t.sendInspectorState(r)})})};export{g as setupDevtools}; diff --git a/assets/style-D1zXtE8K.css b/assets/style-D1zXtE8K.css new file mode 100644 index 0000000..b6d1278 --- /dev/null +++ b/assets/style-D1zXtE8K.css @@ -0,0 +1 @@ +.vp-back-to-top-button{position:fixed!important;inset-inline-end:1rem;bottom:4rem;z-index:100;width:48px;height:48px;padding:12px;border-width:0;border-radius:50%;background:var(--back-to-top-c-bg);color:var(--back-to-top-c-accent-bg);box-shadow:2px 2px 10px 4px var(--back-to-top-c-shadow);cursor:pointer}@media (max-width: 959px){.vp-back-to-top-button{transform:scale(.8);transform-origin:100% 100%}}@media print{.vp-back-to-top-button{display:none}}.vp-back-to-top-button:hover{color:var(--back-to-top-c-accent-hover)}.vp-back-to-top-button .back-to-top-icon{overflow:hidden;width:24px;height:24px;margin:0 auto;background:var(--back-to-top-c-icon);-webkit-mask-image:var(--back-to-top-icon);mask-image:var(--back-to-top-icon);-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:cover;mask-size:cover}.vp-scroll-progress{position:absolute;right:-2px;bottom:-2px;width:52px;height:52px}.vp-scroll-progress svg{width:100%;height:100%}.vp-scroll-progress circle{opacity:.9;transform:rotate(-90deg);transform-origin:50% 50%}.back-to-top-enter-active,.back-to-top-leave-active{transition:opacity .3s}.back-to-top-enter-from,.back-to-top-leave-to{opacity:0}:root{--back-to-top-z-index: 5;--back-to-top-icon: url("data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%2048%2048'%3e%3cpath%20fill='none'%20stroke='currentColor'%20stroke-linecap='round'%20stroke-linejoin='round'%20stroke-width='4'%20d='M24.008%2014.1V42M12%2026l12-12l12%2012M12%206h24'%20/%3e%3c/svg%3e");--back-to-top-c-bg: var(--vp-c-bg);--back-to-top-c-accent-bg: var(--vp-c-accent-bg);--back-to-top-c-accent-hover: var(--vp-c-accent-hover);--back-to-top-c-shadow: var(--vp-c-shadow);--back-to-top-c-icon: currentcolor}.vp-copy-code-button{position:absolute;top:.5em;right:.5em;z-index:5;width:2.5rem;height:2.5rem;padding:0;border-width:0;border-radius:.5rem;background:#0000;outline:none;opacity:0;cursor:pointer;transition:opacity .4s}@media print{.vp-copy-code-button{display:none}}.vp-copy-code-button:before{content:"";display:inline-block;width:1.25rem;height:1.25rem;padding:.625rem;background:currentcolor;color:var(--copy-code-c-text);font-size:1.25rem;-webkit-mask-image:var(--code-copy-icon);mask-image:var(--code-copy-icon);-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.vp-copy-code-button:focus,.vp-copy-code-button.copied{opacity:1}.vp-copy-code-button:hover,.vp-copy-code-button.copied{background:var(--copy-code-c-hover)}.vp-copy-code-button.copied:before{-webkit-mask-image:var(--code-copied-icon);mask-image:var(--code-copied-icon)}.vp-copy-code-button.copied:after{content:attr(data-copied);position:absolute;top:0;right:calc(100% + .25rem);display:block;height:1.25rem;padding:.625rem;border-radius:.5rem;background:var(--copy-code-c-hover);color:var(--copy-code-c-text);font-weight:500;line-height:1.25rem;white-space:nowrap}.no-copy-code .vp-copy-code-button{display:none}body:not(.no-copy-code) div[class*=language-]:hover:before{display:none}body:not(.no-copy-code) div[class*=language-]:hover .vp-copy-code-button{opacity:1}:root{--code-copy-icon: url("data:image/svg+xml,%3csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24' fill='none' stroke='%23808080' stroke-width='2'%3e%3cpath stroke-linecap='round' stroke-linejoin='round' d='M9 5H7a2 2 0 0 0-2 2v12a2 2 0 0 0 2 2h10a2 2 0 0 0 2-2V7a2 2 0 0 0-2-2h-2M9 5a2 2 0 0 0 2 2h2a2 2 0 0 0 2-2M9 5a2 2 0 0 1 2-2h2a2 2 0 0 1 2 2' /%3e%3c/svg%3e");--code-copied-icon: url("data:image/svg+xml,%3csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24' fill='none' stroke='%23808080' stroke-width='2'%3e%3cpath stroke-linecap='round' stroke-linejoin='round' d='M9 5H7a2 2 0 0 0-2 2v12a2 2 0 0 0 2 2h10a2 2 0 0 0 2-2V7a2 2 0 0 0-2-2h-2M9 5a2 2 0 0 0 2 2h2a2 2 0 0 0 2-2M9 5a2 2 0 0 1 2-2h2a2 2 0 0 1 2 2m-6 9 2 2 4-4' /%3e%3c/svg%3e");--copy-code-c-text: var(--code-c-line-number);--copy-code-c-hover: var(--code-c-highlight-bg)}.hint-container{position:relative;background:var(--hint-c-soft);transition:background var(--vp-t-color),color var(--vp-t-color)}@media print{.hint-container{page-break-inside:avoid}}.hint-container>.hint-container-title{color:var(--hint-c-title)}.hint-container :not(pre)>code{background:var(--hint-c-soft)}.hint-container .hint-container-title{position:relative;margin-block:.75em;font-weight:600;line-height:1.25}.hint-container.important,.hint-container.info,.hint-container.note,.hint-container.tip,.hint-container.warning,.hint-container.caution{margin-block:.75rem;padding:.25em 1em;border-radius:.5em;color:inherit;font-size:var(--hint-font-size)}@media print{.hint-container.important,.hint-container.info,.hint-container.note,.hint-container.tip,.hint-container.warning,.hint-container.caution{border-inline-start-width:.25em;border-inline-start-style:solid}}.hint-container.important .hint-container-title,.hint-container.info .hint-container-title,.hint-container.note .hint-container-title,.hint-container.tip .hint-container-title,.hint-container.warning .hint-container-title,.hint-container.caution .hint-container-title{padding-inline-start:1.75em}@media print{.hint-container.important .hint-container-title,.hint-container.info .hint-container-title,.hint-container.note .hint-container-title,.hint-container.tip .hint-container-title,.hint-container.warning .hint-container-title,.hint-container.caution .hint-container-title{padding-inline-start:0}}.hint-container.important .hint-container-title:before,.hint-container.info .hint-container-title:before,.hint-container.note .hint-container-title:before,.hint-container.tip .hint-container-title:before,.hint-container.warning .hint-container-title:before,.hint-container.caution .hint-container-title:before{content:" ";position:absolute;inset-inline-start:0;top:calc(50% - .6125em);width:1.25em;height:1.25em;font-size:1.25em}@media print{.hint-container.important .hint-container-title:before,.hint-container.info .hint-container-title:before,.hint-container.note .hint-container-title:before,.hint-container.tip .hint-container-title:before,.hint-container.warning .hint-container-title:before,.hint-container.caution .hint-container-title:before{display:none}}.hint-container.important p,.hint-container.info p,.hint-container.note p,.hint-container.tip p,.hint-container.warning p,.hint-container.caution p{line-height:1.5}.hint-container.important a,.hint-container.info a,.hint-container.note a,.hint-container.tip a,.hint-container.warning a,.hint-container.caution a{color:var(--vp-c-accent)}.hint-container.important{--hint-c-accent: var(--important-c-accent);--hint-c-title: var(--important-c-text);--hint-c-soft: var(--important-c-soft)}.hint-container.important>.hint-container-title:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 1024 1024'%3E%3Cpath d='M512 981.333a84.992 84.992 0 0 1-84.907-84.906h169.814A84.992 84.992 0 0 1 512 981.333zm384-128H128v-42.666l85.333-85.334v-256A298.325 298.325 0 0 1 448 177.92V128a64 64 0 0 1 128 0v49.92a298.325 298.325 0 0 1 234.667 291.413v256L896 810.667v42.666zm-426.667-256v85.334h85.334v-85.334h-85.334zm0-256V512h85.334V341.333h-85.334z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 1024 1024'%3E%3Cpath d='M512 981.333a84.992 84.992 0 0 1-84.907-84.906h169.814A84.992 84.992 0 0 1 512 981.333zm384-128H128v-42.666l85.333-85.334v-256A298.325 298.325 0 0 1 448 177.92V128a64 64 0 0 1 128 0v49.92a298.325 298.325 0 0 1 234.667 291.413v256L896 810.667v42.666zm-426.667-256v85.334h85.334v-85.334h-85.334zm0-256V512h85.334V341.333h-85.334z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.hint-container.info{--hint-c-accent: var(--info-c-accent);--hint-c-title: var(--info-c-text);--hint-c-soft: var(--info-c-soft)}.hint-container.info>.hint-container-title:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M12 22C6.477 22 2 17.523 2 12S6.477 2 12 2s10 4.477 10 10-4.477 10-10 10zm-1-11v6h2v-6h-2zm0-4v2h2V7h-2z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M12 22C6.477 22 2 17.523 2 12S6.477 2 12 2s10 4.477 10 10-4.477 10-10 10zm-1-11v6h2v-6h-2zm0-4v2h2V7h-2z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.hint-container.note{--hint-c-accent: var(--note-c-accent);--hint-c-title: var(--note-c-text);--hint-c-soft: var(--note-c-soft)}.hint-container.note>.hint-container-title:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M12 22C6.477 22 2 17.523 2 12S6.477 2 12 2s10 4.477 10 10-4.477 10-10 10zm-1-11v6h2v-6h-2zm0-4v2h2V7h-2z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M12 22C6.477 22 2 17.523 2 12S6.477 2 12 2s10 4.477 10 10-4.477 10-10 10zm-1-11v6h2v-6h-2zm0-4v2h2V7h-2z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.hint-container.tip{--hint-c-accent: var(--tip-c-accent);--hint-c-title: var(--tip-c-text);--hint-c-soft: var(--tip-c-soft)}.hint-container.tip>.hint-container-title:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M7.941 18c-.297-1.273-1.637-2.314-2.187-3a8 8 0 1 1 12.49.002c-.55.685-1.888 1.726-2.185 2.998H7.94zM16 20v1a2 2 0 0 1-2 2h-4a2 2 0 0 1-2-2v-1h8zm-3-9.995V6l-4.5 6.005H11v4l4.5-6H13z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M7.941 18c-.297-1.273-1.637-2.314-2.187-3a8 8 0 1 1 12.49.002c-.55.685-1.888 1.726-2.185 2.998H7.94zM16 20v1a2 2 0 0 1-2 2h-4a2 2 0 0 1-2-2v-1h8zm-3-9.995V6l-4.5 6.005H11v4l4.5-6H13z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.hint-container.warning{--hint-c-accent: var(--warning-c-accent);--hint-c-title: var(--warning-c-text);--hint-c-soft: var(--warning-c-soft)}.hint-container.warning>.hint-container-title:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 1024 1024'%3E%3Cpath d='M576.286 752.57v-95.425q0-7.031-4.771-11.802t-11.3-4.772h-96.43q-6.528 0-11.3 4.772t-4.77 11.802v95.424q0 7.031 4.77 11.803t11.3 4.77h96.43q6.528 0 11.3-4.77t4.77-11.803zm-1.005-187.836 9.04-230.524q0-6.027-5.022-9.543-6.529-5.524-12.053-5.524H456.754q-5.524 0-12.053 5.524-5.022 3.516-5.022 10.547l8.538 229.52q0 5.023 5.022 8.287t12.053 3.265h92.913q7.032 0 11.803-3.265t5.273-8.287zM568.25 95.65l385.714 707.142q17.578 31.641-1.004 63.282-8.538 14.564-23.354 23.102t-31.892 8.538H126.286q-17.076 0-31.892-8.538T71.04 866.074q-18.582-31.641-1.004-63.282L455.75 95.65q8.538-15.57 23.605-24.61T512 62t32.645 9.04 23.605 24.61z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 1024 1024'%3E%3Cpath d='M576.286 752.57v-95.425q0-7.031-4.771-11.802t-11.3-4.772h-96.43q-6.528 0-11.3 4.772t-4.77 11.802v95.424q0 7.031 4.77 11.803t11.3 4.77h96.43q6.528 0 11.3-4.77t4.77-11.803zm-1.005-187.836 9.04-230.524q0-6.027-5.022-9.543-6.529-5.524-12.053-5.524H456.754q-5.524 0-12.053 5.524-5.022 3.516-5.022 10.547l8.538 229.52q0 5.023 5.022 8.287t12.053 3.265h92.913q7.032 0 11.803-3.265t5.273-8.287zM568.25 95.65l385.714 707.142q17.578 31.641-1.004 63.282-8.538 14.564-23.354 23.102t-31.892 8.538H126.286q-17.076 0-31.892-8.538T71.04 866.074q-18.582-31.641-1.004-63.282L455.75 95.65q8.538-15.57 23.605-24.61T512 62t32.645 9.04 23.605 24.61z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.hint-container.caution{--hint-c-accent: var(--caution-c-accent);--hint-c-title: var(--caution-c-text);--hint-c-soft: var(--caution-c-soft)}.hint-container.caution>.hint-container-title:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M12 2c5.523 0 10 4.477 10 10v3.764a2 2 0 0 1-1.106 1.789L18 19v1a3 3 0 0 1-2.824 2.995L14.95 23a2.5 2.5 0 0 0 .044-.33L15 22.5V22a2 2 0 0 0-1.85-1.995L13 20h-2a2 2 0 0 0-1.995 1.85L9 22v.5c0 .171.017.339.05.5H9a3 3 0 0 1-3-3v-1l-2.894-1.447A2 2 0 0 1 2 15.763V12C2 6.477 6.477 2 12 2zm-4 9a2 2 0 1 0 0 4 2 2 0 0 0 0-4zm8 0a2 2 0 1 0 0 4 2 2 0 0 0 0-4z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M12 2c5.523 0 10 4.477 10 10v3.764a2 2 0 0 1-1.106 1.789L18 19v1a3 3 0 0 1-2.824 2.995L14.95 23a2.5 2.5 0 0 0 .044-.33L15 22.5V22a2 2 0 0 0-1.85-1.995L13 20h-2a2 2 0 0 0-1.995 1.85L9 22v.5c0 .171.017.339.05.5H9a3 3 0 0 1-3-3v-1l-2.894-1.447A2 2 0 0 1 2 15.763V12C2 6.477 6.477 2 12 2zm-4 9a2 2 0 1 0 0 4 2 2 0 0 0 0-4zm8 0a2 2 0 1 0 0 4 2 2 0 0 0 0-4z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat}.hint-container.details{position:relative;display:block;margin-block:.75rem;padding:1.25rem 1rem;border-radius:.5rem;background:var(--detail-c-bg);transition:background var(--vp-t-transform),color var(--vp-t-transform)}.hint-container.details h4{margin-top:0}.hint-container.details figure:last-child,.hint-container.details p:last-child{margin-bottom:0;padding-bottom:0}.hint-container.details a{color:var(--vp-c-accent)}.hint-container.details :not(pre)>code{background:var(--detail-c-soft)}.hint-container.details summary{position:relative;margin:-1rem;padding-block:1em;padding-inline:3em 1.5em;list-style:none;font-size:var(--hint-font-size);cursor:pointer}.hint-container.details summary::-webkit-details-marker{display:none}.hint-container.details summary::marker{color:#0000;font-size:0}.hint-container.details summary:before{background-color:currentColor;-webkit-mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M7.41 15.41L12 10.83l4.59 4.58L18 14l-6-6-6 6z'/%3E%3C/svg%3E");mask-image:url("data:image/svg+xml;utf8,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 24 24'%3E%3Cpath d='M7.41 15.41L12 10.83l4.59 4.58L18 14l-6-6-6 6z'/%3E%3C/svg%3E");-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:1em;mask-size:1em;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat;content:" ";position:absolute;inset-inline-start:.8em;top:calc(50% - .5em);width:1em;height:1em;font-size:1.25rem;line-height:normal;transition:color,var(--vp-t-color),transform var(--vp-t-transform);transform:rotate(90deg)}.hint-container.details[open]>summary{margin-bottom:.5em}.hint-container.details[open]>summary:before{transform:rotate(180deg)}:root{--hint-font-size: .92rem;--important-c-accent: var(--vp-c-purple-bg);--important-c-text: var(--vp-c-purple-text);--important-c-soft: var(--vp-c-purple-soft);--info-c-accent: var(--vp-c-blue-bg);--info-c-text: var(--vp-c-blue-text);--info-c-soft: var(--vp-c-blue-soft);--note-c-accent: var(--vp-c-grey-bg);--note-c-text: var(--vp-c-grey-text);--note-c-soft: var(--vp-c-grey-soft);--tip-c-accent: var(--vp-c-green-bg);--tip-c-text: var(--vp-c-green-text);--tip-c-soft: var(--vp-c-green-soft);--warning-c-accent: var(--vp-c-yellow-bg);--warning-c-text: var(--vp-c-yellow-text);--warning-c-soft: var(--vp-c-yellow-soft);--caution-c-accent: var(--vp-c-red-bg);--caution-c-text: var(--vp-c-red-text);--caution-c-soft: var(--vp-c-red-soft);--detail-c-bg: var(--vp-c-control);--detail-c-icon: var(--vp-c-border);--detail-c-soft: var(--vp-c-grey-soft)}:root{--medium-zoom-z-index: 100;--medium-zoom-c-bg: var(--vp-c-bg-elv, #fff);--medium-zoom-opacity: 1}.medium-zoom-overlay{z-index:var(--medium-zoom-z-index);background-color:var(--medium-zoom-c-bg)!important}.medium-zoom-overlay~img{z-index:calc(var(--medium-zoom-z-index) + 1)}.medium-zoom--opened .medium-zoom-overlay{opacity:var(--medium-zoom-opacity)}:root{--nprogress-c: var(--vp-c-accent);--nprogress-z-index: 1031}#nprogress{pointer-events:none}#nprogress .bar{position:fixed;top:0;left:0;z-index:var(--nprogress-z-index);width:100%;height:2px;background:var(--nprogress-c)}:root{--code-padding-x: 1.25rem;--code-padding-y: 1rem;--code-border-radius: 6px;--code-line-height: 1.6;--code-font-size: 14px;--code-font-family: consolas, monaco, "Andale Mono", "Ubuntu Mono", monospace}div[class*=language-]{position:relative;border-radius:var(--code-border-radius);background-color:var(--code-c-bg)}div[class*=language-]:before{content:attr(data-title);position:absolute;top:.8em;right:1em;z-index:3;color:var(--code-c-text);font-size:.75rem}div[class*=language-] pre{position:relative;z-index:1;overflow-x:auto;margin:0;border-radius:var(--code-border-radius);font-size:var(--code-font-size);font-family:var(--code-font-family);line-height:var(--code-line-height)}div[class*=language-] pre code{display:block;box-sizing:border-box;width:-moz-fit-content;width:fit-content;min-width:100%;padding:var(--code-padding-y) var(--code-padding-x);background-color:#0000!important;color:var(--code-c-text);overflow-wrap:unset;-webkit-font-smoothing:auto;-moz-osx-font-smoothing:auto}:root{--code-c-text: #f8f8f2;--code-c-bg: #2e3440;--code-c-highlight-bg: rgb(51.6454545455, 60.5484848485, 78.3545454545);--code-c-line-number: rgba(248, 248, 242, .67)}.token.comment,.token.prolog,.token.doctype,.token.cdata{color:#636f88}.token.punctuation{color:#81a1c1}.namespace{opacity:.7}.token.property,.token.tag,.token.constant,.token.symbol,.token.deleted{color:#81a1c1}.token.number{color:#b48ead}.token.boolean{color:#81a1c1}.token.selector,.token.attr-name,.token.string,.token.char,.token.builtin,.token.inserted{color:#a3be8c}.token.operator,.token.entity,.token.url,.language-css .token.string,.style .token.string,.token.variable{color:#81a1c1}.token.atrule,.token.attr-value,.token.function,.token.class-name{color:#88c0d0}.token.keyword{color:#81a1c1}.token.regex,.token.important{color:#ebcb8b}.token.important,.token.bold{font-weight:700}.token.italic{font-style:italic}.token.entity{cursor:help}:root{--code-line-number-width: 3rem}div[class*=language-]:not(.line-numbers-mode) .line-numbers{display:none}div[class*=language-].line-numbers-mode:after{content:"";position:absolute;top:0;left:0;width:var(--code-line-number-width);height:100%;border-right:1px solid var(--code-c-highlight-bg, var(--code-c-text));border-radius:var(--code-border-radius) 0 0 var(--code-border-radius);transition:border var(--vp-t-color)}div[class*=language-].line-numbers-mode pre{vertical-align:middle;margin-left:var(--code-line-number-width)}div[class*=language-].line-numbers-mode code{padding-left:1rem}div[class*=language-].line-numbers-mode .line-numbers{counter-reset:line-number;position:absolute;top:0;width:var(--code-line-number-width);padding-top:var(--code-padding-y);color:var(--code-c-line-number, var(--code-c-text));font-size:var(--code-font-size);line-height:var(--code-line-height);text-align:center}div[class*=language-].line-numbers-mode .line-number{position:relative;z-index:3;font-family:var(--code-font-family);-webkit-user-select:none;-moz-user-select:none;user-select:none}div[class*=language-].line-numbers-mode .line-number:before{content:counter(line-number);counter-increment:line-number}div[class*=language-] .line.highlighted{display:inline-block;width:100%;margin:0 calc(-1*var(--code-padding-x));padding:0 var(--code-padding-x);background-color:var(--code-c-highlight-bg)}div[class*=language-].has-collapsed-lines.collapsed{overflow-y:hidden;height:calc(var(--vp-collapsed-lines)*var(--code-line-height)*var(--code-font-size) + var(--code-padding-y) + 28px)}div[class*=language-].has-collapsed-lines .collapsed-lines{--vp-collapsed-lines-bg: var(--code-c-bg);position:absolute;right:0;bottom:0;left:0;z-index:4;display:flex;align-items:center;justify-content:center;height:28px;background:linear-gradient(to bottom,transparent 0%,var(--vp-collapsed-lines-bg) 55%,var(--vp-collapsed-lines-bg) 100%);cursor:pointer;transition:--vp-collapsed-lines-bg var(--vp-t-color)}div[class*=language-].has-collapsed-lines .collapsed-lines:hover{--vp-collapsed-lines-bg: rgb(0 0 0 / 10%) !important}div[class*=language-].has-collapsed-lines[data-highlighter=shiki] .collapsed-lines{--vp-collapsed-lines-bg: var(--code-c-bg, var(--shiki-light-bg))}[data-theme=dark] div[class*=language-].has-collapsed-lines[data-highlighter=shiki] .collapsed-lines{--vp-collapsed-lines-bg: var(--code-c-bg, var(--shiki-dark-bg))}div[class*=language-].has-collapsed-lines .collapsed-lines:before{--icon: url("data:image/svg+xml,%3Csvg xmlns='http://www.w3.org/2000/svg' width='1em' height='1em' viewBox='0 0 24 24'%3E%3Cpath fill='none' stroke='%23000' stroke-width='2' d='m18 12l-6 6l-6-6m12-6l-6 6l-6-6'/%3E%3C/svg%3E");--vp-collapsed-lines-rotate: 0deg;content:"";display:inline-block;width:24px;height:24px;background-color:var(--code-c-text);-webkit-mask-image:var(--icon);mask-image:var(--icon);-webkit-mask-position:50%;mask-position:50%;-webkit-mask-size:20px;mask-size:20px;-webkit-mask-repeat:no-repeat;mask-repeat:no-repeat;pointer-events:none;animation:code-collapsed-lines 1.2s infinite alternate-reverse ease-in-out}div[class*=language-].has-collapsed-lines:not(.collapsed) code{padding-bottom:max(var(--code-padding-y),28px)}div[class*=language-].has-collapsed-lines:not(.collapsed) .collapsed-lines:hover{--vp-collapsed-lines-bg: transparent !important}div[class*=language-].has-collapsed-lines:not(.collapsed) .collapsed-lines:before{--vp-collapsed-lines-rotate: 180deg}@property --vp-collapsed-lines-bg{inherits:false;initial-value:#fff;syntax:"
Develop with AI
Github Copilot
Update
Copilot can now use other LLMs than OpenAI, including Google, and Anthropic to provide code suggestions
Github Copilot is a tool that uses the OpenAI language models to provide code suggestions and suggestions for improving code quality.
Alternative code assistance
There is also other producs indegrated to IDEs such as Gitlab Duo, Gemini Code Assist, SuperMaven, AWS CodeWhisperer, and more.
Copilot Chat
Copilot Chat is a chat interface that allows you to ask questions and get suggestions for code improvements.
it's available on :
- JetBrains IDEs
- Visual Studio
- Visual Studio Code
- In Github mobile App
- Web version in github.com (Preview)
It is a similar approach to chat GPT prompting optimised for the developper experience.
CLI
CLI helps you using you command line interpreter You can use it in the terminal with the following command:
gh auth login
+gh extension install github.copilot
+gh copilot explain "traceroute github.com"
+Warning
Github CLI is not supported yet with our Worldline account, so you need to use the web version with the link here
JetBrains integration
Completion
Assistance
Refactoring
Test generation
Documentation
Architecture diagram
VSCode integration
Completion
Assistance
Refactoring
Test generation
Documentation
Architecture diagram
Gihub Spark
GitHub Spark is an AI-powered tool for creating and sharing micro apps (“sparks”), which can be tailored to your exact needs and preferences, and are directly usable from your desktop and mobile devices. Without needing to write or deploy any code.
And it enables this through a combination of three tightly-integrated components:
An NL-based editor, which allows easily describing your ideas, and then refining them over time A managed runtime environment, which hosts your sparks, and provides them access to data storage, theming, and LLMs A PWA-enabled dashboard, which lets you manage and launch your sparks from anywhere
🧪 Exercises
📖 Further readings
Hands-on Lab - AI for Devs
Discover AI in practice.
Let's start
Prerequisites - Definitions - A bit of History - The market
General assistants
Prompt engineering - LibreChat quickstart - Offline prompting
Develop with AI
Github Copilot
AI for services
Cloud LLMs - Advanced RAG
Disclamer
LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time.
AI for devs | Tech at Worldline
Who we are
We design payments technology that powers the growth of millions of businesses around the world. Engineering the next frontiers in payments technology
- Leader in payment and secured transactions.
- Over 50bn transactions/year
- 7000+ engineers in over 40 countries
- A huge & diverse tech-stack
Follow trainers of this Hands-on Lab
Gharbi Ibrahim
🔗 @__brah
🔗 cv.gharbi.org
Follow our Tech team
Online with Librechat
LibreChat is a free, open source AI chat platform. This Web UI offers vast customization, supporting numerous AI providers, services, and integrations. Serves all AI Conversations in one place with a familiar interface, innovative enhancements, for as many users as you need.
The full librechat documentation is available here
Let's discover how to use LibreChat to create efficient and effective conversations with AI for developers.
Prompts history
Prompts history allows users to save and load prompts for their conversations and easily access them later. Reusing prompts can save time and effort, especially when working with multiple conversations and keep track of the context and details of a conversation.
Favorites
The favorites feature allows users to save and load favorite prompts for their conversations and easily access them later.
Presets
The presets feature allows users to save and load predefined settings for initialise a conversations. Users can import and export these presets as JSON files, set a default preset, and share them with others.
Preformatted prompts
The prompts feature allows users to save and load predefined prompts to use it during their conversations. You can use a prompt with the /[prompt command]. A prompt can have parameters, which are replaced with values when the prompt is used.
Exemple of preformatted prompts : Explain the following code snippet in Java, Kotlin or Javascript
- Click on the
+button to add a new prompt. - name your prompt :
explain - on Text tab, you can write your prompt :
Explain the following {{language:Java|Kotlin|Javascript}} snippet of code:
+{{code}}
+
- Now you can use the
/explaincommand to get the explanation of the code snippet.
AI providers
Azure OpenAI
Azure OpenAI Service provides REST API access to OpenAI's powerful language models, including the o1-preview, o1-mini, GPT-4o, GPT-4o mini, GPT-4 Turbo with Vision, GPT-4, GPT-3.5-Turbo, and Embeddings model series.
Google Gemini
Gemini is a large language model (LLM) developed by Google. It's designed to be a multimodal AI, meaning it can work with and understand different types of information, including text, code, audio, and images. Google positions Gemini as a highly capable model for a range of tasks, from answering questions and generating creative content to problem-solving and more complex reasoning. There are different versions of Gemini, optimized for different tasks and scales.
Anthropic Claude
Claude is an Artificial Intelligence, trained by Anthropic. Claude can process large amounts of information, brainstorm ideas, generate text and code, help you understand subjects, coach you through difficult situations, help simplify your busywork so you can focus on what matters most, and so much more.
Assistants
The Assistants API enables the creation of AI assistants, offering functionalities like code interpreter, knowledge retrieval of files, and function execution. The Assistants API allows you to build AI assistants within your own applications for specific needs. An Assistant has instructions and can leverage models, tools, and files to respond to user queries. The Assistants API currently supports three types of tools: Code Interpreter, File Search, and Function calling.
Plugins
The plugins endpoint opens the door to prompting LLMs in new ways other than traditional input/output prompting.
Warning
Every additional plugin selected will increase your token usage as there are detailed instructions the LLM needs for each one For best use, be selective with plugins per message and narrow your requests as much as possible
DALL-E 3
Dall-e 3 is a librechat Plugin for generating images from text. You can use it to generate images from text, such as product descriptions, product images, or even documentation images to illustrate your technical documentation.
Confluence
Ask confluence is a librechat Plugin for Confluence documents.
IT support
Ask for IT support enable you to get support from the IT team and create WLSD tickets from your chats.
WOLF
Wolf is a librechat Plugin for WL Managagement System documents. The sharepoint documention is available here
Ask to WorldLine management system Friend everything you are looking for in the WMS content. AskWOLF plugin is meant to help you navigate through the multitude of information provided by the WMS (Applicable Policies, Processes & Procedures, Transversal & Operations SP pages links, …). This Worldline LibreChat plugin relies on ChatGPT technologies.
Worldline Management System (WMS) is the Group reference for all information pertaining to our operating model such as applicable policies, processes and governance structures. Key responsibilities are :
- consistently address its customers’ and markets’ requirements across all its geographies
- continuous improvement of customer satisfaction through effective application of WMS
- correct interpretation of applicable ISO standards requirements
Example of prompts:
- AskWOLF: What is the WMS?
- AskWOLF: What are the policies?
- AskWOLF: What are the processes?
Browse plugins
Retrieve data from internet and use it to generate a response.
Plugin mixing
You can mix plugins to create more complex prompts. For example, you can use the DALL-E 3 plugin to generate images from text and then use the IT support plugin to get support from the IT team.
Generate the favicon 16x16 pixels based on the content found in
+https://worldline.github.io/learning-ai/overview/ with Browser plugin
+and generate the favicon with DallE. I want no background and black and white image
+
RAG
RAG is possible with LibreChat. You can use RAG to create a conversation with the AI. To can add files to the conversation, you go to the file tab and select the file you want to add. Then the file will be added to the file manager and you can use it in the prompt.
The file can be an png, a video, a text file, or a PDF file.
🧪 Exercises
1. Prompt creation
Select one prompt engineering technique and make a prompt in librechat that can be called with the /[prompt_name] command.
2. Plugins mixing
Use the Browse and Dall-E plugins to create a prompt that generates a a favicon based on the content of this learning-ai website.
3. Make your own assistant
Choose your favorite topic ( cooking, travel, sports, etc.) and create an assistant that can answer questions about it. You can share documents, files and instructions to configure your custom assistant and use it.
📖 Further readings
Offline with LM Studio
Disclamer
Be careful with offline prompting models downloaded from the internet. They can contain malicious code. And also the size of the model can be very large from few Gb to few Tb.
Definitions
If you don't want to use the online AI providers, you can use offline prompting. This technique involves using a local LLM to generate responses to prompts. It is useful for developers who want to use a local LLM for offline prompting or for those who want to experiment with different LLMs without relying on online providers.
LM Studio is a tool that allows developers to experiment with different LLMs without relying on online providers. It provides a user-friendly interface for selecting and configuring LLMs, as well as a chat interface for interacting with the LLMs. It also includes features for fine-tuning and deploying LLMs. This technique is useful for developers who want to experiment with different LLMs.
Installation
For installation, you can follow the instructions here
Model configuration
You can configure the model you want to use in the settings tab. You can select the model you want to use and configure it according to your needs.
Context Length: The context length is the number of tokens that will be used as context for the model. This is important because it determines how much information the model can use to generate a response. A longer context length will allow the model to generate more detailed and relevant responses, but it may also increase the computational cost of the model.
GPU Offload: This option allows you to offload the model to a GPU if available. This can significantly speed up the generation process, especially for longer prompts or complex models.
CPU Threads: This option allows you to specify the number of CPU threads to use for the model. This can be useful for controlling the computational resources used by the model.
Evaluation batch size: This option allows you to specify the batch size for evaluation. This is important for evaluating the performance of the model and can affect the speed and accuracy of the generation process.
RoPE Frequency base: This option allows you to specify the frequency base for RoPE (Range-based Output Embedding). This is important for controlling the output length of the model and can affect the quality of the generated responses.
RoPE Frequency scale: This option allows you to specify the frequency scale for RoPE (Range-based Output Embedding). This is important for controlling the output length of the model and can affect the quality of the generated responses.
Keep model in memory: This option allows you to keep the model in memory after the generation process is complete. This can be useful for generating multiple responses or for using the model for offline prompting.
Try mmap() for faster loading: This option allows you to try using mmap() for faster loading of the model. This can be useful for loading large models or for generating responses quickly.
Seed: This option allows you to specify a seed for the model. This can be useful for controlling the randomness of the generated responses.
Flash Attention: This option allows you to enable flash attention for the model. This can be useful for generating more detailed and accurate responses, but it may also increase the computational cost of the model.
enable APIs
You can use the APIs to generate responses from the models. To enable the API server with LM Studio, you need to set the API Server option to ON in the settings tab. You can then use the API endpoints to generate responses from the models.
2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] Success! HTTP server listening on port 1234
+2024-11-15 18:45:22 [INFO]
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] Supported endpoints:
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> GET http://localhost:1234/v1/models
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> POST http://localhost:1234/v1/chat/completions
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> POST http://localhost:1234/v1/completions
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] -> POST http://localhost:1234/v1/embeddings
+2024-11-15 18:45:22 [INFO]
+2024-11-15 18:45:22 [INFO] [LM STUDIO SERVER] Logs are saved into /Users/ibrahim/.cache/lm-studio/server-logs
+2024-11-15 18:45:22 [INFO] Server started.
+2024-11-15 18:45:22 [INFO] Just-in-time model loading active.
+You can use the endpoints to generate responses from the models. The endpoints are as follows:
GET /v1/models: This endpoint returns a list of the available models.POST /v1/chat/completions: This endpoint generates responses from the models using the chat format.Chat format is used for tasks such as chatbots, conversational AI, and language learning.POST /v1/completions: This endpoint generates responses from the models using the completion format. Completion format is used for tasks such as question answering, summarization, and text generation.POST /v1/embeddings: This endpoint generates embeddings from the models. Embeddings are used for tasks such as sentiment analysis, text classification, and language translation.
🧪 Exercises
📖 Further readings
Let's start
Warning
LLMs and MMLLMs are constantly evolving, and new applications for developer training are emerging all the time.
Prerequisites
Shell Command Line Skills:
The AI should include support for providing guidance on using shell commands, navigating file systems, and executing command-line operations across different operating systems.
Understanding of HTTP and API:
Proficiency in HTTP protocol, RESTful API concepts, and web service integration is crucial for the AI to provide support on API design, consumption, and troubleshooting common API-related issues.
Basic Cloud Knowledge:
Understanding of cloud computing principles, including basic concepts of cloud infrastructure, services, and deployment models, will enable the AI to offer guidance on cloud-based development, deployment, and best practices.
Warning
Additionnaly, Request Worldline librechat access: send a mail at Generative AI Taskforce email
There is a dedicated sharepoint for basic general assistant quick start at Worldline : LibreChat Worldline guides
Definitions
Large Language Model (LLM)
Large Language Model is a powerful type of AI model trained on massive datasets of text and code. LLMs can understand, generate, and manipulate language. Ex : ChatGPT, Bard, Codex
What are Large Language Models (LLMs)? by Google for developpers
Multi-Modal LLM (MMLLM)
Multi-Modal Large Language Model is an advanced LLM that can process and generate both text and other data formats like images, audio, or video. Ex: DALL-E 2, Stable Diffusion (for image generation)
Machine Learning (ML)
Machine Learning is a subset of AI that focuses on training algorithms to learn from data and make predictions or decisions without explicit programming. ML powers many AI applications, including image recognition, natural language processing, and predictive analytics.
Deep Learning (DL)
Deep Learning is a type of ML that uses artificial neural networks with multiple layers to learn complex patterns from data.DL has revolutionized fields like computer vision, speech recognition, and machine translation.
Neural Network
A computational model inspired by the structure of the human brain, consisting of interconnected nodes (neurons) organized in layers.Neural networks are the core building blocks of deep learning models.
Natural Language Processing (NLP)
Natural Language Processing is a branch of Artificial Intelligence (AI) that focuses on enabling computers to understand, interpret, and generate human language. It implies :
- Text Analysis
- Language Understanding
- Text Generation
- Translation
- Speech Recognition: Powers voice assistants and speech-to-text technologies
Prompt:
A specific set of instructions or questions given to an LLM to guide its response. Well-crafted prompts are crucial for getting accurate and relevant output from LLMs. Ex : "Write a Python function to check if a string is a palindrome."
Token:
The smallest unit of meaning processed by an LLM. Tokens can be words, parts of words, punctuation marks, or special characters. LLMs process text by analyzing sequences of tokens, making it important to understand how they are broken down. Ex : The sentence "I love programming" would be split into the following tokens: "I", "love", "programming".
Temperature:
A parameter in some LLMs that controls the randomness or creativity of the generated text. Adjust temperature based on the desired level of creativity or accuracy in the LLM's output.
- A higher temperature generate more randomness and unpredictability in the output.
- A lower temperature generate more predictable and coherent output.
RAG: Retrieval Augmented Generation
RAG (Retrieval Augmented Generation) is a powerful technique in the field of Natural Language Processing (NLP) that combines the best of both worlds: information retrieval and language generation.
- The system first retrieves relevant information from a vast knowledge base (often a database or a set of documents) based on the user's query or prompt.
- This retrieved information is then used to augment the language model's input, providing it with more context and specific facts.
- Finally, the language model uses this augmented input to generate a more comprehensive and informative response, leveraging both its knowledge base and its language generation capabilities.
A bit of History
AI's history has been marked by periods of progress and setbacks. Computing power, data availability, and algorithmic advancements have played crucial roles in AI's evolution. AI is no longer limited to expert systems but encompasses a wide range of techniques and applications.
- 1950: Alan Turing proposes the "Turing Test" to assess machine intelligence.
During the turing test, the human questioner asks a series of questions to both respondantes. After the specified time, the questionner tries to decide which terminal is operated bu the human respondant and which terminal is operated by the computer.
1956: Dartmouth Conference establishes the field of "Artificial Intelligence".
1959: Arthur Samuel develops a checkers-playing program that learns and improves over time.
1960s: Research focused on logic-based reasoning and early expert systems.
1972: The first expert system, DENDRAL, is developed for identifying organic molecules.
1980s-1990s: Development of new techniques like machine learning and neural networks.
1997: Deep Blue, a chess-playing computer, defeats Garry Kasparov, the world chess champion.
1990s-2000s: Advances in computing power, data availability, and algorithms as fuel for AI progress.
2010s: Deep learning revolutionizes AI with breakthroughs in image recognition, speech recognition, and natural language processing.
2011: Watson, an IBM supercomputer, wins Jeopardy! against human champions.
2016: AlphaGo, a program developed by Google DeepMind, defeats Go champion Lee Sedol.
2022: First release of ChatGPT : AI continues to evolve rapidly, with advancements in areas like autonomous vehicles, robotics, and personalized medicine.
The market
🧪 Exercises
1. LLMs and MMLLMs are constantly evolving.
2. Multi-Modal LLMs can process and generate only text data.
3. Which of the following are examples of Machine Learning applications?
4. Deep Learning uses artificial neural networks with multiple layers.
5. Natural Language Processing (NLP) includes which of the following?
6. RAG stands for Retrieval Augmented Generation.
7. LLMs can only generate text and cannot understand it.
8. Which of the following is NOT a type of Machine Learning?
9. Deep Learning models require less data than traditional Machine Learning models.
10. Natural Language Processing can be used for sentiment analysis.
11. Which of the following are common applications of Deep Learning?
12. RAG can improve the accuracy of responses generated by LLMs.
13. Which of the following is a benefit of using Cloud Computing for AI?
14. The Turing Test is designed to evaluate a machine's ability to exhibit intelligent behavior.
15. Multi-Modal LLMs can only process text and images.
Solution
1. LLMs and MMLLMs are constantly evolving.
2. Multi-Modal LLMs can process and generate only text data.
3. Which of the following are examples of Machine Learning applications?
4. Deep Learning uses artificial neural networks with multiple layers.
5. Natural Language Processing (NLP) includes which of the following?
6. RAG stands for Retrieval Augmented Generation.
7. LLMs can only generate text and cannot understand it.
8. Which of the following is NOT a type of Machine Learning?
9. Deep Learning models require less data than traditional Machine Learning models.
10. Natural Language Processing can be used for sentiment analysis.
11. Which of the following are common applications of Deep Learning?
12. RAG can improve the accuracy of responses generated by LLMs.
13. Which of the following is a benefit of using Cloud Computing for AI?
14. The Turing Test is designed to evaluate a machine's ability to exhibit intelligent behavior.
15. Multi-Modal LLMs can only process text and images.
📖 Further readings
AI for services
APIs with LibreChat
For basic APIs exchange with LibreChat, you can use simple HTTP requests. You can use the /api/v1/chat/completions endpoint to send a request to the API and receive a response.
CloudAI with GCP
GCP is a suite of cloud computing services provided by Google. It includes a wide range of tools and services for building and consuming LLMs, such as Vertex AI, Google Colab, and ML Flow.
Large Consumer-Facing
These products are directly available to consumers, often integrating AI capabilities into everyday applications:
- Google Colaboratory (Colab): A free Jupyter Notebook environment hosted by Google. Excellent for learning, experimentation, and sharing machine learning code. While not a "production" platform like Vertex AI, it's extremely popular for its ease of use and free access to compute resources (though with limitations).
- Gemini: Google's large language model (LLM), positioned as a competitor to OpenAI's GPT models. Gemini's capabilities are integrated into various Google products and services, and are also accessible through APIs. Different versions of Gemini (e.g., Gemini Pro, Gemini Ultra) offer varying levels of capability and access. It powers several consumer-facing features across Google's ecosystem.
- AI Studio Cloud-based machine learning platform offered by several companies, most notably Google with its Google AI Studio (now largely integrated into Vertex AI) and Amazon with Amazon SageMaker Studio. While both share the general goal of providing a user-friendly environment for building, training, and deploying machine learning models, their specific features and offerings differ. https://aistudio.google.com/
Vertex AI
This is the central hub for most Google Cloud's AI/ML services. It integrates and supersedes many previous offerings.
- Vertex AI Training: Training machine learning models using various algorithms and frameworks (TensorFlow, PyTorch, scikit-learn, XGBoost, etc.). Provides access to managed compute instances (including TPUs).
- Vertex AI Prediction: Deploying trained models for inference (making predictions). Offers different deployment options based on scale and latency requirements.
- Vertex AI Pipelines: Creating and managing machine learning workflows, including data preprocessing, model training, evaluation, and deployment, as a series of connected steps.
- Vertex AI Model Monitoring: Monitoring deployed models for performance degradation and potential issues (drift).
- Vertex AI Feature Store: Centralized repository for storing, managing, and versioning features used in machine learning models, improving collaboration and reuse.
- Vertex AI Matching Engine: A service for performing similarity searches (for example, recommendation systems).
Google Cloud APIs
Pre-trained Models and APIs: Google offers numerous pre-trained models and APIs for various tasks, making it easier to integrate AI into applications without building models from scratch. Examples include:
- Google Cloud Natural Language API: Processing and understanding text (sentiment analysis, entity recognition, etc.). Google Cloud Vision API: Analyzing images (object detection, image classification, optical character recognition, etc.).
- Google Cloud Speech-to-Text API: Converting audio to text.
- Google Cloud Text-to-Speech API: Converting text to audio.
- Google Cloud Translation API: Translating text between languages.
- Other APIs: Many more APIs exist for various tasks like video intelligence, dialogflow (conversational AI), and more.
Specialized AI Products
Beyond the core platform and APIs, Google offers several specialized AI products:
- TensorFlow: A popular open-source machine learning framework developed by Google. While not strictly a "Google Cloud" product, it's deeply integrated with their services.
- TensorFlow Extended (TFX): A platform for deploying TensorFlow models at scale, often used in conjunction with Vertex AI.
- JAX: A high-performance machine learning library, often used for research and advanced applications.
- Google AI Platform Notebooks (integrated into Vertex AI): Jupyter Notebook environments hosted on Google Cloud. (Previously a separate offering, often confused with Google Colab.)
- Dialogflow CX: A conversational AI platform for building complex conversational experiences.
Manage models (ML Flow)
MLflow provides tools for managing experiments, tracking model versions, deploying models to various environments, and managing models in a central registry. It's designed to be platform-agnostic, meaning it can work with many different cloud providers and even on-premises infrastructure.
Function calling (langchain4j)
Function calling is a feature that allows you to call functions from other services. It is useful for working with functions, such as APIs, and for interacting with models that require function calls.
To use function calling, you need to specify the function name and arguments in the prompt.
Ressouces Jean François James
Structured Outputs (Json Mode)
Json mode is a feature that allows you to send structured data to the model. It is useful for working with structured data, such as JSON objects, and for interacting with models that require structured input.
To use Json mode, you need to specify the input format as JSON in the prompt. You can do this by adding the following line to the beginning of your prompt:
Advanced RAG (llama-index)
RAG with Ollama CLI with Langchain4j and llama-index
Collaborative (Hugging Face)
The platform where the machine learning community collaborates on models, datasets, and applications.
Hugging Face is a platform for researchers and developers to share, explore, and build AI models. It provides a centralized repository for models, datasets, and applications, making it easy to find, use, and contribute to the growing ecosystem of AI technologies.
- Creating/deploy/customize a model
- Pre-trained model, use behind the APIs, also a ML part, training model generation for use
🧪 Exercises
📖 Further readings
Prompt with AI
Prompt engineering
Prompt engineering involves the design and creation of prompts that are used to elicit specific responses or actions from AI models or interactive systems. These prompts are carefully crafted to guide the behavior or generate particular outputs from the AI, such as generating natural language responses, providing recommendations, or completing specific tasks.
Definition
In the context of AI language models, prompt engineering is especially important for shaping the model's behavior and output. By designing prompts effectively, engineers can influence the model's responses and ensure that it generates coherent, relevant, and accurate content.
There are four main areas to consider when writing an effective prompt. You don’t need to use all four, but using a few will help!
Persona: Who is the user you're writing for? What are their skills and knowledge?Task: What specific action do you want the user to perform?Context: What information does the user need to know to complete the task?Format: What is the desired output of the task?
Example Prompt:
- [
Persona] You are a Google Cloud program manager. - [
Task] Draft an executive summary email - [
Context] to [person description] based on [details about relevant program docs]. - [
Format] Limit to bullet points.
By using "act as," you are establishing a specific context for the language model and guiding it to understand the type of task or request you are making. This helps to set the right expectations and provides the language model with the necessary context to generate a response tailored to the defined role.
"Act as a creative writing assistant and generate a short story based
+on a prompt about a futuristic world where robots have become sentient."
+Summarize
Summary is a prompt engineering technique that involves providing a summary of a given document or text. It can helps for summarizing changelogs, articles, or other technical documents.
Help me write an article of this document [Insert or copy paste document text]
+Generate 5 titles out of the following topic….
+Generate a subtitle to catch readers’ attention on the following
+topic [describe the topic]
+Write
Write is a prompt engineering technique that involves providing a step-by-step guide or instructions for a given task or process. Its useful for developers to create functional and technical documentations.
Create a template of an email response to customer inquiring about ….
+Create a guide that explains how to use ….
+Write step by step instructions
+For Developers
Code explanation
Code explanation is a prompt engineering technique that involves providing a detailed explanation of a code snippet or function. This technique is useful for developers who want to understand the inner workings of a codebase or for those who want to document their code.
cf. Preformatted prompts for an example of code explanation
Generation
Act as a code generator. Generate a Python function that takes a list of
+numbers as input and returns the sum of all the numbers.
+Completion
Code completion is a prompt engineering technique that involves providing a list of possible completions for a given code snippet or function. This technique is useful for developers who want to suggest possible code changes or improvements based on their existing code.
Conversion
Code conversion is a prompt engineering technique that involves providing a conversion of a code snippet or function from one programming language to another. This technique is useful for developers who want to migrate their code from one language to another or for those who want to use a different programming language for their projects.
Review
Code review is a prompt engineering technique that involves providing a code review of a given code snippet or function. This technique is useful for developers who want to review their code for potential issues,bugs, or for those who want to provide feedback on their code.
Fixing
Code fixing is a prompt engineering technique that involves providing a code fix for a given code snippet or function. This technique is useful for developers who want to fix bugs or issues in their code or for those who want to improve the quality of their code.
Help me find mistakes in my code [insert your code]
+Explain what this snippet of code does [insert code snippet]
+What it the correct syntax for a [statement or function]
+in [programming language]
+How do I fix the following programming language code
+[program language] code which explain the functioning [Insert code snippet]
+Refactoring
Code refactor is a prompt engineering technique that involves providing a code refactoring of a given code snippet or function within a specific scope. This technique is useful for developers who want to refactor their code within a specific context or for those who want to improve the readability and maintainability of their code.
Data mocking
Mock data generation is a prompt engineering technique that involves providing a mock data set for a given code snippet or function. This technique is useful for developers who want to test their code with mock data or for those who want to generate test data for their projects. It avoid creating manually fake data for testing.
Go further
Testing
Testing is a prompt engineering technique that involves providing a test case for a given code snippet or function. This technique is useful for developers who want to test their code or for those who want to ensure the correctness of their code.
System design and architecture
System design and architecture is a prompt engineering technique that involves providing a system design or architecture for a given code snippet or function. This technique is useful for developers who want to design their code or for those who want to understand the overall architecture of their projects.
Documentation generation
Documentation generation is a prompt engineering technique that involves providing a documentation for a given code snippet or function. This technique is useful for developers who want to document their code or for those who want to provide documentation for their projects. It can be used to generate documentation in various formats such as Markdown, HTML, or PDF.
Commit Message Generation
Commit message generation is a prompt engineering technique that involves providing a commit message for a given code snippet or function. This technique is useful for developers who want to generate commit messages for their code or for those who want to ensure that their commit messages are clear and concise.
Vulnerability checking
Vulnerability checking is a prompt engineering technique that involves providing a vulnerability check for a given code snippet or function. This technique is useful for developers who want to check for vulnerabilities in their code or for those who want to ensure that their code is secure.
Warning
This prompt is not recommended for production use. It is intended for testing and debugging purposes only and is not a proof of security or safety of your app.
Shell/CLI commands manual
As a developer, you’re not limited to only writing code. LLMs can assist with CLI such as shell commands and version control using Git.
Regular expression explanation
You can understand complex regular expressions and generate ones that match specific patterns in text. This technique is useful for developers who want to write complex regular expressions or for those who want to understand the syntax of regular expressions.
Explain this regular expression in JavaScript: const regex =
+/^[A-Za-z0–9._%+-]+@[A-Za-z0–9.-]+\\.[A-Za-z]{2,}$/;
+🧪 Exercises
Exercise 1: Basic Function Creation
- Create a function that calculates the factorial of a number.
- Handle both positive integers and zero, with error handling for negative inputs.
Expected Output (python)
def factorial(n):
+ if n < 0:
+ raise ValueError("Input must be a non-negative integer.")
+ if n == 0:
+ return 1
+ result = 1
+ for i in range(1, n + 1):
+ result *= i
+ return result
+Exercise 2: API Request Handling
- Write a function to fetch data from a given URL using the Fetch API.
- Return the JSON response and handle any potential errors.
Expected Output (javascript)
async function fetchData(url) {
+ try {
+ const response = await fetch(url);
+ if (!response.ok) {
+ throw new Error(`HTTP error! status: ${response.status}`);
+ }
+ const data = await response.json();
+ return data;
+ } catch (error) {
+ console.error("Error fetching data:", error);
+ }
+}
+Exercise 3: Class Definition
- Define a class representing a book with properties for title, author, and publication year.
- Include a method to display the book's details.
Expected Output (C#)
public class Book
+{
+ public string Title { get; set; }
+ public string Author { get; set; }
+ public int PublicationYear { get; set; }
+
+ public void DisplayDetails()
+ {
+ Console.WriteLine($"Title: {Title}, Author: {Author}, Year: {PublicationYear}");
+ }
+}
+Exercise 4: Simple Web Server
- Set up a basic web server that listens on port 3000.
- Respond with a simple message when accessed.
Expected Output (Javascript)
const http = require('http');
+
+const server = http.createServer((req, res) => {
+ res.statusCode = 200;
+ res.setHeader('Content-Type', 'text/plain');
+ res.end('Hello, World!\n');
+});
+
+server.listen(3000, () => {
+ console.log('Server running at http://localhost:3000/');
+});
+Exercise 5: Data Validation
Details:
- Write a method to validate if a given string is a valid email address.
- Use a regular expression for the validation.
Expected Output (Ruby)
def valid_email?(email)
+ regex = /\A[\w+\-.]+@[a-z\d\-.]+\.[a-z]+\z/i
+ !!(email =~ regex)
+end
+Exercise 6: Mock Data Generation
Create prompts that can generate mock user profiles. The language used is JavaScript.
The profile should include:
- Name
- Age
- Address (Street, City, State, Zip Code)
- Phone Number
Solutions
Exercise 1: Basic Function Creation
Persona: Python Developer
Task: Create a function
Context: You need to calculate the factorial of a number.
As a Python Developer, create a function named factorial that takes a single integer input and returns its factorial. The function should handle both positive integers and zero. Include error handling for negative inputs.
Exercise 2: API Request Handling
Persona: JavaScript Developer
Task: Write a function to handle API requests
Context: You need to fetch data from a given URL.
As a JavaScript Developer, write a function named fetchData that takes a URL as an argument and fetches data from that URL using the Fetch API. The function should return the JSON response and handle any errors that may occur during the fetch operation.
Exercise 3: Class Definition
Persona: C# Developer
Task: Define a class
Context: You are creating a representation of a book.
As a C# Developer, create a class named Book that has properties for Title, Author, and PublicationYear. Include a method named DisplayDetails that prints the book's details in a formatted string.
Exercise 4: Simple Web Server
Persona: JavaScript Developer
Task: Set up a web server
Context: You need to create a simple server that responds to requests.
As a JavaScript Developer, set up a simple web server using the http module that listens on port 3000 and responds with "Hello, World!" when accessed.
Exercise 5: Data Validation
Persona: Ruby Developer
Task: Write a validation method
Context: You need to validate email addresses.
As a Ruby Developer, write a method named valid_email? that takes a string as input and returns true if it is a valid email address, and false otherwise. Use a regular expression for validation.
Exercise 6: Mock Data Generation
As a JavaScript Developer, write a function named generateUserProfile that generates a mock user profile with the following details: name, age, email, address, and phone number. The function should return an object containing the user profile details.
function generateUserProfile() {
+ const names = ["Alice", "Bob", "Charlie", "David", "Eva"];
+ const randomName = names[Math.floor(Math.random() * names.length)];
+ const randomAge = Math.floor(Math.random() * 50) + 18; // Age between 18 and 67
+ const randomEmail = `${randomName.toLowerCase()}@example.com`;
+ const randomAddress = {
+ street: `${Math.floor(Math.random() * 1000)} Main St`,
+ city: "Sample City",
+ state: "CA",
+ zip: "12345"
+ };
+ const randomPhone = `(${Math.floor(Math.random() * 900) + 100})-${Math.floor(Math.random() * 900) + 100}-${Math.floor(Math.random() * 9000) + 1000}`;
+
+ return {
+ name: randomName,
+ age: randomAge,
+ email: randomEmail,
+ address: randomAddress,
+ phone: randomPhone
+ };
+}
+
+// Example usage
+console.log(generateUserProfile());
+