Is the model training on the CPU or GPU?

Course Q&A Generative AI with Large Language Models
1

In the notebook, i don’t see any use of Sagemaker sdk apis. is the model training on CPUs

Harish

2

Such a model should be normally trained on a GPU, especially if it involves large matrices.

3

The ml.m5.2xlarge instance used in the Sagemaker labs does NOT have a GPU, so the labs run on CPU. Only the c instances have GPUs. Presumably, they used GPUs to do teh real tuning.

See Available Studio Instance Types - Amazon SageMaker

1 Like