Most Popular
1500 questions
5
votes
4 answers
Traffic signs dataset
I'm looking for annotated dataset of traffic signs. I was able to find Belgium, German and many more traffic signs datasets. The only problem is these datasets contain only cropped images, like this:
While i need (for YOLO -- You Only Look Once…
kocica
- 213
- 2
- 10
5
votes
2 answers
How fast is TensorFlow compared to self written neural nets?
I made my first neural net in C++ without any libraries. It was a net to recognize numbers from the MNIST dataset. In a 784 - 784 - 10 net with sigmoid function and 5 epochs with every 60000 samples, it took about 2 hours to train. It was probably…
Evator
- 163
- 2
- 7
5
votes
1 answer
How does L2 regularization make weights smaller?
I'm learning logistic regression and $L_2$ regularization.
The cost function looks like below.
$$J(w) = -\displaystyle\sum_{i=1}^{n} (y^{(i)}\log(\phi(z^{(i)})+(1-y^{(i)})\log(1-\phi(z^{(i)})))$$
And the regularization term is added. ($\lambda$ is a…
Riddle Aaron
- 65
- 3
5
votes
1 answer
Do good approximations produce good gradients?
Let’s say I have a neural net doing classification and I’m doing stochastic gradient descent to train it. If I know that my current approximation is a decent approximation, can I conclude that my gradient is a decent approximation of the gradient of…
Stella Biderman
- 301
- 1
- 13
5
votes
1 answer
Which artificial intelligence algorithms could use tensor specific hardware?
AI algorithms involving neural networks can use tensor specific hardware. Are there any other artificial intelligence algorithms that could benefit from many tensor calculations in parallel? Are there any other computer science algorithms (not part…
bob smith
- 51
- 1
5
votes
2 answers
How can a reinforcement learning agent generalize if it is trained against only one opponent?
I started teaching myself about reinforcement learning a week ago and I have this confusion about the learning experience. Let's say we have the game Go. And we have an agent that we want to be able to play the game and win against anyone. But let's…
Robot0110
- 377
- 1
- 5
5
votes
2 answers
What part of the game is the value network trained to predict a winner on?
The Alpha Zero (as well as AlphaGo Zero) papers say they trained the value head of the network by "minimizing the error between the predicted winner and the game winner" throughout its many self-play games. As far as I could tell, further…
chessprogrammer
- 2,890
- 2
- 15
- 26
5
votes
10 answers
Does AI rely on determinism?
I don’t believe in free will, but most people do. Although I’m not sure how an act of free will could even be described (let alone replicated), is libertarian freewill something that is considered for AI? Or is AI understood to be deterministic?
Cannabijoy
- 171
- 1
- 9
5
votes
2 answers
Why is the derivative of this objective function 0 if the policy is deterministic?
In the Berkeley RL class CS294-112 Fa18 9/5/18, they mention the following gradient would be 0 if the policy is deterministic.
$$
\nabla_{\theta} J(\theta)=E_{\tau \sim \pi_{\theta}(\tau)}\left[\left(\sum_{t=1}^{T} \nabla_{\theta} \log…
jonperl
- 153
- 7
5
votes
2 answers
Why does the clipped surrogate objective work in Proximal Policy Optimization?
In Proximal Policy Optimization Algorithms (2017), Schulman et al. write
With this scheme, we only ignore the change in probability ratio when it would make the objective improve, and we include it when it makes the objective worse.
I don't…
16Aghnar
- 601
- 3
- 11
5
votes
3 answers
How can I detect datetime patterns in text?
I want to explore and experiment the ways in which I could use a neural network to identify patterns in text.
examples:
Prices of XYZ stock went down at 11:00 am today
Retrieve a list of items exchanged on 03/04/2018
Show error logs between 3 - 5…
Amresh Venugopal
- 183
- 1
- 6
5
votes
1 answer
What are the differences between an agent that thinks rationally and an agent that acts rationally?
Stuart Russell and Peter Norvig pointed out 4 four possible goals to pursue in artificial intelligence: systems that think/act humanly/rationally.
What are the differences between an agent that thinks rationally and an agent that acts rationally?
Bayequentist
- 161
- 1
- 6
5
votes
2 answers
How is it possible to teach a neural network to perform addition?
I am trying to understant how it works. How do you teach it say, to add 1 to each number it gets. I am pretty new to the subject and I learned how it works when you teach it to identify a picture of a number. I can understand how it identifies a…
bilanush
- 151
- 2
5
votes
2 answers
Where can I find pre-trained language models in English and German?
Where can I find (more) pre-trained language models? I am especially interested in neural network-based models for English and German.
I am aware only of Language Model on One Billion Word Benchmark and TF-LM: TensorFlow-based Language Modeling…
Lutz Büch
- 161
- 7
5
votes
2 answers
Variable Number of Inputs to Neural Networks
So suppose that you have a real estate appraisal problem. You have some structured data, and some images exterior of home, bedrooms, kitchen, etc. The number of pictures taken is variable per observational unit, i.e. the house.
I understand the…
Ryan
- 161
- 4