PyTorch questions and answers
Tensors, autograd and the PyTorch training loop. Page 4 of 4.
ML System Design practice on Codemia
Design recommenders, ranking systems and training pipelines the way ML interviews actually ask for them, with worked solutions.
Answers 181-192
- What is the purpose of with torch.no_grad
- What's the difference between reshape and view in PyTorch?
- What's the difference between tf.nn.ctc_loss with pytorch.nn.CTCLoss
- When does dataloader shuffle happen for Pytorch?
- When does one have to call share_memory_() in Pytorch when using distributed training?
- Where is one supposed to call torch.distributed.destroy_process_group in Pytorch?
- Which PyTorch modules are affected by model.eval and model.train?
- Why do I get CUDA out of memory when running PyTorch model with enough GPU memory?
- Why do we need to call zero_grad in PyTorch?
- Why doesn't my simple pytorch network work on GPU device?
- Why is PyTorch 2x slower than Keras for an identical model and hyperparameters?
- Why torch.sum before doing .backward?
.png&w=3840&q=75)
Free course
Beginner
7 lessons
2 hours
Tackling System Design Interview Problems
A short course that equips you with the skills to approach system design interviews methodically.
Start the free course