Catalyst, Fastai, Ignite and Pytorch-Lightning are all amazing frameworks but which one should I use for project x? I have been asking myself the same question and it is not an easy answer. There are several factors at play and framework selection also depends on your background. I will outline…

This post covers some of the key operations used in pytorch argmax Returns the indices of the maximum value of all elements in the input tensor. This is the second value returned by torch.max() a = torch.randn(4, 3) a >> tensor([[ 2.0149, 1.0420, -1.3816]…

This post covers a quick overview of axes in numpy (NB both numpy and pytorch use same representation) import numpy as np Axes 2D matrices For both numpy and pytorch, axis 0 = row, 1 = column Note how when we specify axis=0 for sum, we are collapsing along that (row) axis np.sum([[1…

I bought a used Supermicro X9DRi-LN4F+ from ebay to use for datascience projects involving large datasets where having >128MB RAM and 20+ cpu cores would speed up data processing. …

A commonly used technique in deep-learning is transfer-learning, whereby the learned weights of a model that was pre-trained on one dataset are used to ‘bootstrap’ training of early or all but the the final layer of a modified version of the model applied to a different dataset. This technique allows…

Gumtree is a UK and Australia website for used item sales, a bit like ebay but more personable. Recently I put an item up for sale, an RTX 2080 GPU (looking to upgrade to an RTX 2080ti). …

Here I am reviewing my experience in the VSB Power Line Fault Detection Kaggle Competition. The aim of the competition was to “detect partial discharge patterns in signals acquired from these power lines with a new meter designed at the ENET Centre at VSB — Technical University of Ostrava”. A…

Here’s another story on building your own deep learning rig, containing the information I wish I had known a couple of years ago. This story is aimed at building a single machine with 3 or 4 GPU’s. The big factors impacting my deep learning training capability has been number of…

This is an article documenting the lessons I have learnt building two watercooled deep learning boxes. There are plenty of youtube videos and articles about watercooling gaming rigs, there is much less information about multi-GPU water-cooling setups. If you research what type of GPU’s to use for multi-GPU deep learning…