Ask Slater Machine Learning What is a tensor in physics terminology and what’s the difference from a tensor in machine learning and AI? June 24, 2019 by adamdev Thereās no difference. A tensor is just a very, very generic term for: basically anything. A tensor is a generic term for a way of arranging numbers that generally has some geometric interpretation. A scalar (math speak for a number) is a 0-tensor. A vector (math speak for a list of numbers) is a 1-tensor […] Read more Ā»
Ask Slater Machine Learning How does the ELMo machine learning model work? June 12, 2019 by adamdev At its core, ELMo is an RNN model with an LSTM gating setup thatās trained as a bidirectional language model. But thatās not really what you asked. You asked how it works. Itās often really tough to explain how a machine learning model works. Importantly you have to understand that no part of what I […] Read more Ā»
Ask Slater Machine Learning Should we remove duplicates from a data-set while training a Machine Learning algorithm (shallow and/or deep methods)? February 6, 2019 by adamdev Itā¦depends. Mostly it depends on what your goals are and what your dataset looks like. There are two big divides here on both sides. Data Structured Data – here, duplicates very much come with the territory. In this situation youāve also likely got a lot of implicit ambiguity in your problem. Letās say that you […] Read more Ā»
Ask Slater Should a machine learning beginner go straight for deep learning? September 26, 2018 by adamdev Let me be clear: I love deep learning. It has radically improved the scope of problems that machine learning can be practically applied to. Iāve built a company on the back of deep learning and owe quite a lot to it. DO NOT start with deep learning. Iām not saying that you shouldnāt approach deep […] Read more Ā»
Ask Slater Why do machine learning algorithms require large amounts of computer space for all kinds of datasets? August 29, 2018 by adamdev Depends a bit on which model type youāre talking about, but for the purposes of illustration Iām going to assume that weāre talking about something like a Logistic Regression Model on top of a tf-idf vector. In this situation, as well as many others, model size is more or less constant with dataset size. In […] Read more Ā»
Ask Slater What is one thing that human intelligence can do but artificial intelligence canāt? July 25, 2018 / October 9, 2025 by adamdev Let me tackle this from a slightly more practical perspective. I think the standard issue with this kind of question is that people are very bad at knowing what human intelligence can do and focus on philosophical questions whose answers are unknown both for humans and for AI. A good example of this is the […] Read more Ā»
Ask Slater What are some of the best artificial intelligence/machine learning journals? July 18, 2018 by adamdev Machine learning is a very interesting field. Part of the reason for this is that most of the novel work in the field happens outside of journals. Instead, largely because it advances so quickly, itās a very conference-driven space. The three biggest conferences are NIPS, ICML, and ICLR. There are definitely a few others, but […] Read more Ā»
Ask Slater Is Euclidean distance meaningful for high dimensional data? July 10, 2018 by adamdev The short answer is no. At high dimensions, Euclidean distance loses pretty much all meaning. However, itās not something thatās the fault of Euclidean distance in particular (though there are distance metrics that work better at high dimensions than Euclidean). The main issue is something commonly referred to as the āCurse of Dimensionalityā. Itās very […] Read more Ā»
Ask Slater Is it possible to learn without data (or at least one or two samples)ālike humansāin AI? May 26, 2018 by adamdev Humans do not learn without data, but as youāve said, they can often learn with very small amounts of data. This is an extremely active area of research typically referred to as āone-shot learningā (learning from one example) or even āzero-shot learningā (learning from zero examples and just the name of the label youāre looking […] Read more Ā»
Ask Slater Given a scenario, how can I identify which machine learning algorithm is best suited for this scenario? May 26, 2018 by adamdev Ā You try them and see how well they work. Anything other than experimentation is guesswork. You can make very broad assertions like, “convolutional neural networks work well for image recognition”, but that doesnāt really help you determine which algorithm you should use, and even in this situation thereās no possible way to know ahead of […] Read more Ā»
