Skip to content

@swiss-ai swiss-ai

Change the repository type filter

All

    Repositories list

    16 repositories

    • mmore

      Public
      Massive Multimodal Open RAG & Extraction A scalable multimodal pipeline for processing, indexing, and querying multimodal documents Ever needed to take 8000 PDFs, 2000 videos, and 500 spreadsheets and feed them to an LLM as a knowledge base? Well, MMORE is here to help you!
      Python
      •
      Apache License 2.0
      •4•20•20•2•Updated Dec 25, 2024Dec 25, 2024

    • llm-proxy

      Public
      LLM Serving and User Control
      Python
      •2•0•0•0•Updated Dec 21, 2024Dec 21, 2024

    • lighteval

      Public
      Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
      Python
      •
      MIT License
      •109•0•0•0•Updated Dec 19, 2024Dec 19, 2024

    • ethel-tutor-eval

      Public
      Jupyter Notebook
      •
      Apache License 2.0
      •0•0•0•0•Updated Dec 19, 2024Dec 19, 2024

    • nanotron

      Public
      Minimalistic large language model 3D-parallelism training
      Python
      •
      Apache License 2.0
      •135•7•1•9•Updated Dec 2, 2024Dec 2, 2024

    • containers

      Public
      Containers for multimodal initiative (and maybe more across Swiss AI?)
      Dockerfile
      •0•0•0•0•Updated Nov 29, 2024Nov 29, 2024

    • ml-4m

      Public
      4M: Massively Multimodal Masked Modeling (NeurIPS 2023 Spotlight)
      Python
      •
      Apache License 2.0
      •99•0•13•4•Updated Nov 29, 2024Nov 29, 2024

    • data-tooling

      Public
      Tool set for data preparation and selection in the context of Swiss-AI (forked from DataTrove)
      Python
      •
      Apache License 2.0
      •158•0•0•1•Updated Nov 21, 2024Nov 21, 2024

    • llm-pretrain-data-toxicity-removal

      Public
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Nov 6, 2024Nov 6, 2024

    • nanotron-multilingual

      Public
      A copy of nanotron for multilingual training
      Python
      •
      Apache License 2.0
      •135•0•0•2•Updated Oct 23, 2024Oct 23, 2024

    • video2dataset

      Public
      Easily create large video dataset from video urls
      Python
      •
      MIT License
      •67•1•0•1•Updated Oct 14, 2024Oct 14, 2024

    • ml-4m-v2

      Public
      0•0•0•0•Updated Aug 5, 2024Aug 5, 2024

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •5k•0•0•0•Updated Jul 31, 2024Jul 31, 2024

    • data-PDF-pipeline

      Public
      PDF pipeline for creating training corpora (mainly for llm, multimodal and alignment horizontals)
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated May 8, 2024May 8, 2024

    • MoE

      Public
      some mixture of experts architecture implementations
      Python
      •
      Apache License 2.0
      •2•12•1•0•Updated Mar 22, 2024Mar 22, 2024

    • Megatron-LLM

      Public
      distributed trainer for LLMs
      Python
      •
      Other
      •78•0•0•0•Updated Feb 8, 2024Feb 8, 2024