Most Popular
1500 questions
6
votes
1 answer
What difference does it make whether Actor and Critic share the same network or not?
I'm learning about Actor-Critic reinforcement learning algorithms. One source I encountered mentioned that Actor and Critic can either share one network (but use different output layers) or they can use two completely separate networks. In this…
mark mark
- 763
- 4
- 25
6
votes
2 answers
Are convolutional neural networks inspired by the human brain?
The Deep Learning book by Goodfellow et al. states
Convolutional networks stand out as an example of neuroscientific principles influencing deep learning.
Are convolutional neural networks (CNNs) really inspired by the human brain?
If so, how? In…
Single Malt
- 205
- 2
- 11
6
votes
1 answer
What is the difference between Stochastic Hill Climbing and Simulated Annealing?
I am reading about local search: hill climbing, and its types, and simulated annealing
One of the hill climbing versions is "stochastic hill climbing", which has the following definition:
Stochastic hill climbing does not examine for all its…
yaminoyuki
- 217
- 2
- 6
6
votes
2 answers
Are probabilistic models dead ends in AI?
I am a strong believer of Marvin Minsky's idea about Artificial General Intelligence (AGI) and one of his thoughts was that probabilistic models are dead ends in the field of AGI.
I would really like to know the thoughts and ideas of people who…
Parth Raghav
- 345
- 1
- 7
6
votes
1 answer
Why are "Transformers" called this way?
What is the reason behind the name "Transformers", for Multi Head Self-Attention-based neural networks from Attention is All You Need?
I have been googling this question for a long time, and nowhere I can find any explanation.
Leevo
- 305
- 2
- 9
6
votes
3 answers
How close have we come to passing the Turing Test?
The Turing Test has been the classic test of artificial intelligence for a while now. The concept is deceptively simple - to trick a human into thinking it is another human on the other end of a conversation line, not a computer - but from what I've…
auden
- 163
- 6
6
votes
2 answers
What techniques can be used to predict future attendance of students for a particular subject lecture session?
I have data of 30 students attendance for a particular subject class for a week. I have quantified the absence and presence with boolean logic 0 and 1. Also, the reason for absence are provided and I tried to generalise these reason into 3…
Ayan Paul
- 61
- 1
6
votes
1 answer
Smallest possible network to approximate the $sin$ function
The main goal is: Find the smallest possible neural network to approximate the $sin$ function.
Moreover, I want to find a qualitative reason why this network is the smallest possible network.
I have created 8000 random $x$ values with corresponding…
JavAlex
- 75
- 5
6
votes
1 answer
How can we connect artificial intelligence with cognitive psychology?
On page 62 of Artificial Intelligence and Cognitive Psychology Applications, Models (2010), Gabriella Daróczy writes
Psychology is one of the basic sciences of artificial intelligence (AI). The founder of the psychology is Wilhelm Wundt…
quintumnia
- 1,183
- 2
- 10
- 34
6
votes
1 answer
What is the difference between neural networks and other ways of curve fitting?
For simplicity, let's assume we want to solve a regression problem, where we have one independent variable and one dependent variable, which we want to predict. Let's also assume that there is a nonlinear relationship between the independent and…
Igor
- 181
- 11
6
votes
1 answer
How many nodes/hidden layers are required to solve a classification problem where the boundary is a sinusoidal function?
A single neuron is capable of forming a decision boundary between linearly seperable data. Is there any intuition as to how many, and in what configuration, would be necessary to correctly approximate a sinusoidal decision boundary?
Thanks
Ian Larson
- 61
- 1
6
votes
1 answer
What is the return-to-go in reinforcement learning?
In reinforcement learning, the return is defined as some function of the rewards. For example, you can have the discounted return, where you multiply the rewards received at later time steps by increasingly smaller numbers, so that the rewards…
nbro
- 40,472
- 12
- 105
- 192
6
votes
1 answer
Formal definition of the Object Detection problem
For many problems in computer science, there is a formal, mathematical problem defition.
Something like: Given ..., the problem is to ...
How can the Object Detection problem (i.e. detecting objects on an image) be formally defined?
Given a set of…
JavAlex
- 75
- 5
6
votes
2 answers
What is the goal of weight initialization in neural networks?
This is a simple question. I know the weights in a neural network can be initialized in many different ways like: random uniform distribution, normal distribution, and Xavier initialization. But what is the weight initialization trying to…
S2673
- 590
- 4
- 17
6
votes
1 answer
Is a Sobel filter for edge detection a type of Cellular Neural Network?
I have implemented a Sobel filter for edge detection in Matlab without using its toolbox. I am a bit confused:
Is a Sobel filter a type of Cellular Neural Network?
Both Sobel and Cellular Neural Network calculate output via its neighborhood cells.
netizen
- 283
- 1
- 8