• @umbrella@lemmy.ml
    link
    fedilink
    143 months ago

    something i dont see being talked about is the sheer processing power needed for this.

    how are they gonna solve that? just requiring you to casually have a couple 4090s?

    • @ToriborA
      link
      English
      143 months ago

      They’ll require a persistent online connection for cloud compute.

      • @CluelessDude@lemmy.zip
        link
        fedilink
        73 months ago

        Imagine now NPCs in gaming being bound to always being online and a company can choose to turn the cloud computing off for the npcs making the game unplayable after like a year, can’t wait /s

          • @VeganCheesecake@lemmy.blahaj.zone
            link
            fedilink
            5
            edit-2
            3 months ago

            Piracy is gonna get more interesting.

            Cracked, removed AI Server lock, bring your own API key, or host model of choice locally.

            Known Issues: If you use the OpenAI API, the NPCs will sometimes tell you that killing is against the ethics policy while shooting at you.

    • ☆ Yσɠƚԋσʂ ☆
      link
      fedilink
      33 months ago

      Training the models initially is expensive, but running them can be done on commodity hardware nowadays.

    • JackGreenEarth
      link
      fedilink
      English
      13 months ago

      How much processing power is really necessary? I can run any 7B model pretty fast with my 1660 ti