In this paper, we look into the potential of using Petals to run large lan- guage models. Petals is a system for running large language models shared across several computers in a peer-to-peer fashion. We explore how to ...