GPU tensors (to, cuda) in PyTorch - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a GPU tensor in PyTorch?

A GPU tensor is a tensor stored in the GPU's memory, allowing faster computation by using the GPU's parallel processing power.

beginner

How do you move a tensor to the GPU using the to() method?

You call tensor.to('cuda') to move the tensor to the GPU if available.

beginner

What does tensor.cuda() do in PyTorch?

It moves the tensor to the default GPU device, similar to tensor.to('cuda').

intermediate

Why should you check if a GPU is available before moving tensors to it?

Because if no GPU is available, trying to move tensors to GPU will cause errors. Use torch.cuda.is_available() to check.

intermediate

What is the difference between tensor.to('cuda') and tensor.cuda()?

tensor.to('cuda') can specify any device and is more flexible. tensor.cuda() moves tensor to the default GPU device. Both move tensors to GPU memory.

Which PyTorch method moves a tensor to the GPU?

A tensor.numpy()

B tensor.to('cpu')

C tensor.reshape()

D tensor.to('cuda')

The to('cuda') method moves a tensor to the GPU device.

What does torch.cuda.is_available() check?

A If GPU is available

B If CPU is available

C If tensor is on GPU

D If CUDA is installed

It checks if a GPU device is available for PyTorch to use.

What happens if you try to move a tensor to GPU when no GPU is available?

A Tensor moves to GPU anyway

B Tensor stays on CPU

C Error occurs

D Tensor is deleted

Trying to move a tensor to GPU without a GPU causes an error.

Which method is more flexible for moving tensors between devices?

A tensor.cuda()

B tensor.to()

C tensor.cpu()

D tensor.numpy()

tensor.to() can move tensors to any device, not just GPU.

What device does tensor.cuda() move the tensor to?

A Default GPU device

B CPU

C Random device

D Disk storage

tensor.cuda() moves the tensor to the default GPU device.

Explain how to move a tensor to GPU in PyTorch and why it is useful.

Think about device names and checking if GPU exists.

Describe the difference between tensor.to('cuda') and tensor.cuda().

Consider device flexibility and default behavior.

Practice

1. What does the PyTorch method tensor.to('cuda') do?

easy

A. Moves the tensor to the GPU for faster computation

B. Converts the tensor to a CPU tensor

C. Changes the tensor data type to float

D. Deletes the tensor from memory

Solution

1. Step 1: Understand the purpose of to('cuda')

   This method moves the tensor from CPU memory to GPU memory to speed up calculations.

2. Step 2: Recognize the effect on computation

   By moving the tensor to GPU, PyTorch can use GPU cores for faster processing.

3. Final Answer:

   Moves the tensor to the GPU for faster computation -> Option A

4. Quick Check:

   to('cuda') = move tensor to GPU [OK]

Hint: to('cuda') means move tensor to GPU memory [OK]

Common Mistakes:

• Thinking it converts data type
• Assuming it moves tensor to CPU
• Believing it deletes the tensor

2. Which of the following is the correct syntax to move a tensor named x to GPU in PyTorch?

easy

A. x.to('cpu')

B. x.gpu()

C. x.to('cuda')

D. x.cuda('cpu')

Solution

1. Step 1: Identify correct method to move tensor to GPU

   The method to('cuda') moves tensor to GPU.

2. Step 2: Check each option

   x.to('cuda') uses to('cuda'), which is correct. Others either move to CPU or use invalid methods.

3. Final Answer:

   x.to('cuda') -> Option C

4. Quick Check:

   Correct syntax for GPU move = x.to('cuda') [OK]

Hint: Use .to('cuda') to move tensor to GPU [OK]

Common Mistakes:

• Using .to('cpu') instead of 'cuda'
• Calling .cuda('cpu') which is invalid
• Using non-existent .gpu() method

3. What will be the output device of the tensor after running this code?

import torch
x = torch.tensor([1, 2, 3])
if torch.cuda.is_available():
    x = x.cuda()
print(x.device)

medium

A. cuda:0

B. cuda:1

C. cpu

D. None

Solution

1. Step 1: Check if GPU is available

   The code checks torch.cuda.is_available(). If True, it moves tensor to GPU device 0 by default.

2. Step 2: Understand x.device output

   After x.cuda(), the tensor is on GPU device 0, so x.device prints cuda:0.

3. Final Answer:

   cuda:0 -> Option A

4. Quick Check:

   cuda() moves tensor to cuda:0 device [OK]

Hint: cuda() moves tensor to GPU device 0 by default [OK]

Common Mistakes:

• Assuming device is 'cpu' after cuda()
• Thinking cuda() moves to cuda:1 by default
• Expecting None as device

4. Identify the error in this code snippet that tries to move a tensor to GPU:

import torch
x = torch.tensor([1, 2, 3])
x = x.to('gpu')
print(x.device)

medium

A. Tensor cannot be moved to GPU

B. Tensor must be converted to float before moving

C. Missing .cuda() call after .to()

D. The device string 'gpu' is invalid; should be 'cuda'

Solution

1. Step 1: Check device string in to() method

   The string 'gpu' is not recognized by PyTorch; the correct string is 'cuda'.

2. Step 2: Understand correct usage

   Using 'cuda' moves tensor to GPU. Using 'gpu' causes a runtime error.

3. Final Answer:

   The device string 'gpu' is invalid; should be 'cuda' -> Option D

4. Quick Check:

   Use 'cuda' not 'gpu' in to() [OK]

Hint: Use 'cuda' not 'gpu' as device string [OK]

Common Mistakes:

• Using 'gpu' instead of 'cuda'
• Thinking tensor must be float to move
• Missing .cuda() call after .to()

5. You want to write code that safely moves a tensor x to GPU if available, otherwise keeps it on CPU. Which code snippet correctly does this?

hard

A. x = x.to('cuda') if torch.cuda.is_available() else x.to('gpu')

B. if torch.cuda.is_available():
x = x.to('cuda')
else:
x = x.to('cpu')

C. x = x.cuda() if torch.cuda.is_available() else x.cuda()

D. x = x.to('cpu') if torch.cuda.is_available() else x.to('cuda')

Solution

1. Step 1: Understand device check logic

   We must check if GPU is available using torch.cuda.is_available().

2. Step 2: Apply correct device move

   If GPU is available, move tensor to 'cuda', else keep on 'cpu'. if torch.cuda.is_available(): x = x.to('cuda') else: x = x.to('cpu') does this correctly.

3. Final Answer:

   if torch.cuda.is_available(): x = x.to('cuda') else: x = x.to('cpu') -> Option B

4. Quick Check:

   Check GPU availability before moving tensor [OK]

Hint: Check cuda availability before moving tensor [OK]

Common Mistakes:

• Using invalid device string 'gpu'
• Moving to cuda even if unavailable
• Swapping cpu and cuda in else