Most Popular
1500 questions
9
votes
2 answers
Are there dynamic neural networks?
Are there neural networks that can decide to add/delete neurons (or change the neuron models/activation functions or change the assigned meaning for neurons), links or even complete layers during execution time?
I guess that such neural networks…
TomR
- 843
- 5
- 16
9
votes
2 answers
Why is baseline conditional on state at some timestep unbiased?
In the homework for the Berkeley RL class, problem 1, it asks you to show that the policy gradient is still unbiased if the baseline subtracted is a function of the state at time step $t$.
$$ \triangledown _\theta \sum_{t=1}^T \mathbb{E}_{(s_t,a_t)…
Laura C
- 91
- 2
9
votes
3 answers
What is a support vector machine?
What is a support vector machine (SVM)? Is an SVM a kind of a neural network, meaning it has nodes and weights, etc.? What is it best used for?
Where I can find information about these?
Efthymios Kalyviotis
- 193
- 5
9
votes
2 answers
Reinforcement Learning with asynchronous feedback
I want suggestions on literature on Reinforcement Learning algorithms that perform well with asynchronous feedback from the environment. What I mean by asynchronous feedback is, when an agent performs an action it gets feedback(reward or regret)…
papabiceps
- 191
- 6
9
votes
5 answers
What's a good resource for getting familiar with reinforcement learning?
I am familiar with supervised and unsupervised learning. I did the SaaS course done by Andrew Ng on Coursera.org.
I am looking for something similar for reinforcement learning.
Can you recommend something?
Martin S
- 213
- 1
- 5
9
votes
6 answers
How to evaluate a NEAT neural network?
I'm trying to write my own implementation of NEAT and I'm stuck on the network evaluate function, which calculates the output of the network.
NEAT as you may know contains a group of neural networks with continuously evolving topologies by the…
Chris
- 193
- 2
- 9
9
votes
1 answer
Why does nobody use decision trees for visual question answering?
I'm starting a project that will involve computer vision, visual question answering, and explainability. I am currently choosing what type of algorithm to use for my classifier - a neural network or a decision tree.
It would seem to me that, because…
The Impossible Squish
- 231
- 1
- 5
9
votes
4 answers
Can a neural network work out the concept of distance?
Imagine a game where it is a black screen apart from a red pixel and a blue pixel. Given this game to a human, they will first see that pressing the arrow keys will move the red pixel. The next thing they will try is to move the red pixel onto the…
zooby
- 2,206
- 1
- 13
- 22
9
votes
1 answer
Why aren't there neural networks that connect the output of each layer to all next layers?
Why aren't there neural networks that connect the output of each layer to all next layers?
For example, the output of layer 1 would be fed to the input of layers 2, 3, 4, etc. Beyond computational power considerations, wouldn't this be better than…
Christopher Jernigan
- 91
- 1
9
votes
2 answers
Why should the number of neurons in a hidden layer be a power of 2?
I have read somewhere on the web (I lost the reference) that the number of units (or neurons) in a hidden layer should be a power of 2 because it helps the learning algorithm to converge faster.
Is this a fact? If it is, why is this true? Does it…
dsfx3d
- 215
- 2
- 7
9
votes
1 answer
How does weight normalization work?
I was reading the paper Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks about improving the learning of an ANN using weight normalization.
They consider standard artificial neural networks where the…
Mike AI
- 145
- 2
- 8
9
votes
5 answers
Can prior knowledge be encoded in deep neural networks?
I was reading Gary Marcus's a Critical Appraisal of Deep Learning. One of his criticisms is that neural networks don't incorporate prior knowledge in tackling a problem. My question is: have there been any attempts at encoding prior knowledge in…
Seth Simba
- 1,186
- 1
- 11
- 29
9
votes
1 answer
In YOLO, what exactly do the values associated with each anchor box represent?
I'm going through Andrew NG's course, which talks about YOLO, but he doesn't go into the implementation details of anchor boxes.
After having looked through the code, each anchor box is represented by two values, but what exactly are these values…
moondra
- 209
- 2
- 4
9
votes
2 answers
How can I use neural networks for detecting TV channel logos in video frames?
I am trying to detect a TV channel logo inside a video file. So, simply, given an input .mp4 video, detect if it has that logo present in a specific frame, say the first frame, or not.
Here's the first example of a frame with a logo.
Here's the…
Mary
- 973
- 6
- 13
9
votes
1 answer
Should I use neural networks or genetic algorithms to solve Gomoku?
Currently, I'm doing a project that's about creating an AI to play the game Gomoku (it's like tic tac toe, but played on a 1515 board and requires 5 in a row to win). I have already successfully implemented a perfect tic tac toe AI using Q-learning…
Conway
- 93
- 4