optimum settings for max throughput for AWS EC2 g4dn.xlarge, g6.xlarge, and g5.xlarge are? #11000
Unanswered
silvacarl2
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
has anyone looked at the optimum settings for max throughput for AWS EC2 g4dn.xlarge, g6.xlarge, and g5.xlarge are for a llama-3 model?
Beta Was this translation helpful? Give feedback.
All reactions