HPC-AI Tech

All

28 repositories

ColossalAI
Public
Making large AI models cheaper, faster and more accessible
ai hpc distributed-computing inference big-model large-scale data-parallelism model-parallelism pipeline-parallelism foundation-models
Python
•
Apache License 2.0
•4.4k•39k•404•43•Updated Jan 8, 2025Jan 8, 2025
Open-Sora
Public
Open-Sora: Democratizing Efficient Video Production for All
Python
•
Apache License 2.0
•2.3k•23k•8•12•Updated Dec 27, 2024Dec 27, 2024
ColossalAI-Documentation
Public
Documentation for Colossal-AI
JavaScript
•
Apache License 2.0
•10•24•4•1•Updated Dec 23, 2024Dec 23, 2024
TensorNVMe
Public
A Python library transfers PyTorch tensors between CPU and NVMe
deep-learning pytorch nvme colossal-ai
C++
•19•102•4•0•Updated Nov 27, 2024Nov 27, 2024
public_assets
Public
Storing publicly available assets such as images, animations and texts
Python
•
Apache License 2.0
•18•9•0•0•Updated Nov 24, 2024Nov 24, 2024
transformers
Public
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Python
•
Apache License 2.0
•27k•9•0•0•Updated Nov 19, 2024Nov 19, 2024
LLaVA-NeXT
Public
Python
•
Apache License 2.0
•283•0•0•0•Updated Nov 18, 2024Nov 18, 2024
Oh-My-Dockerfile
Public
A collection of dockerfiles for various tasks
Dockerfile
•
Apache License 2.0
•8•19•0•0•Updated Aug 19, 2024Aug 19, 2024
graphrag
Public
A modular graph-based Retrieval-Augmented Generation (RAG) system
Python
•
MIT License
•2.1k•0•0•0•Updated Aug 3, 2024Aug 3, 2024
FastFold
Public
Optimizing AlphaFold Training and Inference on GPU Clusters
gpu protein-structure parallelism protein-folding alphafold2 evoformer habana-gaudi cuda pytorch
Python
•
Apache License 2.0
•84•578•39•5•Updated Jul 16, 2024Jul 16, 2024
Cloud-Platform-Docs
Public
Documentation for our cloud platform
JavaScript
•3•1•0•1•Updated Apr 3, 2024Apr 3, 2024
ColossalAI-Platform-CLI
Public
CLI for ColossalAI Platform
Python
•
Apache License 2.0
•2•10•1•0•Updated Mar 26, 2024Mar 26, 2024
CANN-Installer
Public
This repository contains Huawei Ascend CANN files
Apache License 2.0
•1•1•1•0•Updated Feb 27, 2024Feb 27, 2024
SwiftInfer
Public
Efficient AI Inference & Serving
deep-learning inference artificial-intelligence llama gpt llm-serving llm-inference llama2
Python
•
Apache License 2.0
•26•462•3•0•Updated Jan 8, 2024Jan 8, 2024
EnergonAI
Public archive
Large-scale model inference.
Python
•
Apache License 2.0
•90•629•40•2•Updated Sep 12, 2023Sep 12, 2023
pytest-testmon
Public
Selects tests affected by changed files. Executes the right tests first. Continuous test runner when used with pytest-watch.
Python
•
GNU Affero General Public License v3.0
•58•0•0•0•Updated Jul 25, 2023Jul 25, 2023
Elixir
Public
Elixir: Train a Large Language Model on a Small GPU Cluster
efficient memory-management large-language-models
Python
•3•13•0•1•Updated Jun 8, 2023Jun 8, 2023
ColossalAI-Examples
Public archive
Examples of training models with hybrid parallelism using ColossalAI
Python
•
Apache License 2.0
•103•336•29•2•Updated Mar 23, 2023Mar 23, 2023
mmdetection-examples
Public archive
Train mmdetection models with ColossalAI.
Python
•0•2•1•0•Updated Feb 18, 2023Feb 18, 2023
PaLM-colossalai
Public archive
Scalable PaLM implementation of PyTorch
Python
•
Apache License 2.0
•27•192•7•2•Updated Dec 19, 2022Dec 19, 2022
GPT-Demo
Public archive
GPT Demo with hybrid distributed training
Python
•
Apache License 2.0
•7•10•2•0•Updated Dec 1, 2022Dec 1, 2022
Titans
Public archive
A collection of models built with ColossalAI
Python
•
Apache License 2.0
•15•32•6•1•Updated Nov 22, 2022Nov 22, 2022
ColossalAI-Pytorch-lightning
Public
Python
•6•24•0•0•Updated Nov 22, 2022Nov 22, 2022
OPT-Benchmark
Public archive
Python
•
Apache License 2.0
•5•4•1•0•Updated Nov 22, 2022Nov 22, 2022
CachedEmbedding
Public
A memory efficient DLRM training solution using ColossalAI
nlp embeddings dlrm recommandation-system colossal-ai deep-learning pytorch
Python
•
Apache License 2.0
•14•100•2•0•Updated Nov 22, 2022Nov 22, 2022
SkyComputing
Public archive
Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
Python
•
Apache License 2.0
•21•90•1•0•Updated Nov 22, 2022Nov 22, 2022
torchrec
Public
Pytorch domain library for recommendation systems
Python
•
BSD 3-Clause "New" or "Revised" License
•456•0•0•0•Updated Oct 21, 2022Oct 21, 2022
ColossalAI-Benchmark
Public archive
Performance benchmarking with ColossalAI
Python
•
Apache License 2.0
•17•39•5•0•Updated Jul 6, 2022Jul 6, 2022