Future for corporates self hosting LLMs?
Future for corporates self hosting LLMs?

Future for corporates self hosting LLMs?

Do you guys see a future where corporates and business are investing a lot in self hosted datacenter to run open source LLMs to keep their data secure and in house? I mean a practical and efficient way.

  1. Use Cases:
    1. Internal:
      1. This can be for local developers, managers to do their job easier, getting more productivity without the risk of confidential data being shared to third party LLMs?
    2. In their product and services.
  2. When:
    1. Maybe other players in GPU markets bring GPU prices down leading to this shift.
submitted by /u/pheonix10yson
[link] [comments]