When to Use MLP, CNN, and RNN Neural Networks
Tweet Tweet Share Share Last Updated on August 15, 2022 What neural network is appropriate for your predictive modeling problem? It can be difficult for a beginner to the field of deep learning to...
View ArticleWhy Initialize a Neural Network with Random Weights?
Tweet Tweet Share Share Last Updated on August 15, 2022 The weights of artificial neural networks must be initialized to small random numbers. This is because this is an expectation of the stochastic...
View ArticleHow to Make Predictions with Keras
Tweet Tweet Share Share Last Updated on August 23, 2022 Once you choose and fit a final deep learning model in Keras, you can use it to make predictions on new data instances. There is some confusion...
View ArticleLast call: Stefan Krawcyzk’s ‘Mastering MLOps’ Live Cohort
Tweet Tweet Share Share Last Updated on August 19, 2022 Sponsored Post This is your last chance to sign up for Stefan Krawczyk’s exclusive live cohort, starting next week (August 22nd). We already...
View ArticleLoss Functions in TensorFlow
Tweet Tweet Share Share Last Updated on August 6, 2022 The loss metric is very important for neural networks. As all machine learning models are one optimization problem or another, the loss is the...
View ArticleImage Augmentation for Deep Learning with Keras
Tweet Tweet Share Share Last Updated on August 6, 2022 Data preparation is required when working with neural networks and deep learning models. Increasingly, data augmentation is also required on more...
View ArticleHow to Make Predictions with Keras
Tweet Tweet Share Share Last Updated on August 23, 2022 Once you choose and fit a final deep learning model in Keras, you can use it to make predictions on new data instances. There is some confusion...
View ArticleHow to Calculate Precision, Recall, F1, and More for Deep Learning Models
Tweet Tweet Share Share Last Updated on August 23, 2022 Once you fit a deep learning neural network model, you must evaluate its performance on a test dataset. This is critical, as the reported...
View ArticleA Bird’s Eye View of Research on Attention
Tweet Tweet Share Share Last Updated on August 30, 2022 Attention is a concept that is scientifically studied across multiple disciplines, including psychology, neuroscience and, more recently,...
View ArticleWhat is Attention?
Tweet Tweet Share Share Last Updated on August 30, 2022 Attention is becoming increasingly popular in machine learning, but what makes it such an attractive concept? What is the relationship between...
View ArticleThe Attention Mechanism from Scratch
Tweet Tweet Share Share Last Updated on August 30, 2022 The attention mechanism was introduced to improve the performance of the encoder-decoder model for machine translation. The idea behind the...
View ArticleJoin Doug Turnbull’s ‘ML Powered Search’ Live Cohort
Tweet Tweet Share Share Last Updated on August 31, 2022 Sponsored Post Sign up for Doug Turnbull’s exclusive live cohort, starting October 11. Previous Sphere cohorts have had students from Apple,...
View ArticleA Tour of Attention-Based Architectures
Tweet Tweet Share Share Last Updated on September 6, 2022 As the popularity of attention in machine learning grows, so does the list of neural architectures that incorporate an attention mechanism. In...
View ArticleAdding A Custom Attention Layer To Recurrent Neural Network In Keras
Tweet Tweet Share Share Last Updated on September 6, 2022 Deep learning networks have gained immense popularity in the past few years. The ‘attention mechanism’ is integrated with the deep learning...
View ArticleThe Bahdanau Attention Mechanism
Tweet Tweet Share Share Last Updated on September 6, 2022 Conventional encoder-decoder architectures for machine translation encoded every source sentence into a fixed-length vector, irrespective of...
View ArticleThe Luong Attention Mechanism
Tweet Tweet Share Share Last Updated on September 6, 2022 The Luong attention sought to introduce several improvements over the Bahdanau model for neural machine translation, particularly by...
View ArticleAn Introduction To Recurrent Neural Networks And The Math That Powers Them
Tweet Tweet Share Share Last Updated on September 14, 2022 When it comes to sequential or time series data, traditional feedforward networks cannot be used for learning and prediction. A mechanism is...
View ArticleUnderstanding Simple Recurrent Neural Networks In Keras
Tweet Tweet Share Share Last Updated on September 20, 2022 This tutorial is designed for anyone looking for an understanding of how recurrent neural networks (RNN) work and how to use them via the...
View ArticleThe Transformer Attention Mechanism
Tweet Tweet Share Share Last Updated on September 20, 2022 Before the introduction of the Transformer model, the use of attention for neural machine translation was being implemented by RNN-based...
View ArticleThe Transformer Model
Tweet Tweet Share Share Last Updated on September 20, 2022 We have already familiarized ourselves with the concept of self-attention as implemented by the Transformer attention mechanism for neural...
View Article