AIis the talk of the town. Sadly, however, most models require excessive amounts of compute power to run locally; even though the collapse in crypto prices and the change in Ethereum mining has somewhat reduced pressure from the GPU market, having to host and purchase GPUs at a large scale still remains expensive.
Over this feature, we’ll look at how a modestly specified MSI GF65 with an RTX 2060 GPU and 6GB of RAM – used to perform an evaluation of various artificial intelligence tasks – can be run completely locally. While none of these tests will bestow a research prize upon you, they will nevertheless return useful and valuable results that have commercial usage value.
We will look at machine translation, generation of texts and various other applications that can be useful in an everyday setting.