Model parallelism 1

Collaborative tool for running large language models by distributing model parts. An open source tool for running large language models like BLOOM-176B collaboratively. Users load a small part of the model and team up with others serving the other parts to run inference or fine-tuning.