Skip to content

Search for:
Home
Publications
- Process Innovation Imperative
- Built to Thrive
Resources
Advisory
Projects
About

Jay van Zyl @ ecosystem.Ai

Predictive technology: computational social science

Home
Advisory
Projects
- ecosystem.Ai Pre-pivot Platform
- i4j Project
Publications
- Built to Thrive
- Process Innovation Imperative
Resources
Video Gallery
About

New technique to run 70B LLM Inference on a single 4GB GPU

December 3, 2023 December 3, 2023

/u/tinny66666

submitted by /u/tinny66666 [link] [comments]

artificial

New technique to run 70B LLM Inference on a single 4GB GPU

/u/tinny66666

December 3, 2023 December 3, 2023

New technique to run 70B LLM Inference on a single 4GB GPU

submitted by /u/tinny66666
[link] [comments]

Technologist & Computational Social Scientist

Working daily on solving social science prediction challenges using predictive technologies.

PreviousHow Transformers rewrote the rules of an age-old tradition in ML

Nextwhy does alphabet not allow dark mode in gmail on android and probably other platforms?

©2023 Jay van Zyl @ ecosystem.Ai

Powered by Bravada & WordPress.