<span class="vcard">/u/Sapessiii</span>
/u/Sapessiii

Replika/Character AI: How is it possible to handle all those predictions so fast?

Hi, as the title suggest, how are they doing? I mean, I have developed a platform for commercial use that use goliath on replicate to run predictions. The problem is, handling 10 messages per second, will take hours to process the last messages. Do you…