Most Popular
1500 questions
6
votes
1 answer
Why is the denominator ignored in the Bayes' rule?
The naïve Bayes' generative algorithm is often represented by the following formula:
$$\text{argmax}_{y} p(y|x) = \text{argmax}_y \frac{p(x|y)p(y)}{p(x)} \approx \text{argmax}_y p(x|y)p(y)$$
Why do we have $p(x)=1$ which allows the approximation…
gcorso
- 366
- 1
- 7
6
votes
5 answers
How does an activation function's derivative measure error rate in a neural network?
A blog post called "Text Classification using Neural Networks" states that the derivative of the output of a sigmoid function is used to measure error rates.
What is the rationale for this?
I thought the derivative of a sigmoid function output is…
tim_xyz
- 301
- 2
- 9
6
votes
2 answers
Current limitations to artificial consciousness
With some knowledge of machine learning and deep learning, it seems very unlikely for AI to develop into the consciousness that we imagine.
To me, consciousness requires a new framework that is very different from what we have today, as current…
sma
- 823
- 4
- 8
6
votes
1 answer
How are LSTM's trained for text generation?
I've seen some articles about text generation using LSTMs (or GRUs) for text generation.
Basically it seems you train them by folding them out, and putting a letter in each input. But say you trained it with text which includes the string:
"The dog…
zooby
- 2,206
- 1
- 13
- 22
6
votes
2 answers
Can Convolutional Neural Networks be applied in domains other than image recognition?
I'm new in this argument, my question is:
Can convolution be applied in other contexts different from image recognition?
Is there a good source to learn from?
Francesco Rizzi
- 169
- 1
- 2
6
votes
1 answer
How to turn a ternary constraint into three binary constraints?
I'm trying to solve problem 6.6 from the book Artificial Intelligence: A Modern Approach, by Peter Norvig and Stuart Russell.
This is in the context of Constraint Satisfaction Problem and how you can re-formulate some problems with the constraints…
Cristóbal Alcázar
- 173
- 1
- 8
6
votes
2 answers
What are examples of resources that describe the basics of Spiking Neural Networks in detail?
I'm very interested in writing a Spiking Neural Network engine (SNN) from scratch, but I can't find the basic information I need to get started.
For example, I've seen pictures of the individual signals that combine to form a neuron pulse in several…
Erin Loy
- 81
- 4
6
votes
1 answer
Is there a way of converting a neural network to another one that represents the same function?
I have read the paper Neural Turing Machines and the paper On the Computational Power of Neural Nets about the computational power of neural networks. However, it isn't still clear to me one thing.
Is there a way of converting a neural network to…
ViniciusArruda
- 179
- 4
6
votes
2 answers
Why is the larger value, as opposed to the smaller one, chosen, in the hill climbing algorithm?
In the hill climbing algorithm, the greater value, compared to the current value, is selected, but I cannot understand why it takes the larger value instead of the smaller one. Why is that?
I greatly appreciate the inclusion of figures in your…
Khan
- 61
- 1
6
votes
1 answer
How does AI 'see' the images it generates- from what perspective?
I've been using AI image generation for a while now, and I've noticed how profoundly AI doesn't seem to see the image as a whole, sometimes generating an image with parts of fingers floating near objects supposed to be being held, VERY warped…
ben svenssohn
- 344
- 1
- 10
6
votes
3 answers
Why can't Lucene search be used to power LLM applications?
w.r.t. LLM applications using the RAG (retriever-augmented-generation) architecture, people have started taken it for granted that it will be powered by a vector database. e.g., see this:
The most important piece of the preprocessing pipeline, from…
morpheus
- 274
- 6
6
votes
3 answers
Is there any artificially intelligent system that really mimics human intelligence?
After having read something that Elon Musk said about artificial intelligence and how it could affect our lives, I've been reading about artificial intelligence, deep learning, etc. The recurrent topic is neural networks, which are used for…
Curious G
- 71
- 3
6
votes
2 answers
Does the quality of training images affect the accuracy of the neural network?
I just got into AI few months ago. I noticed most of the images in training datasets are usually low quality( almost pixelated).
Does the quality of training images affect the accuracy of the neural network?
I tried googling, but I couldn't find…
Jerry U
- 163
- 1
- 6
6
votes
1 answer
What is the difference between local search and global search algorithms?
What is the difference between local search and global (or complete) search algorithms?
Jayani Sumudini
- 171
- 3
- 9
6
votes
1 answer
What is the role of the hidden vectors in restricted Boltzmann machines?
I'm learning about the restricted Boltzmann machine (RBM), and I just came up with two naive understandings of this model. But it seems these two understandings are so different.
My first understanding goes like this.
The hidden units are just…
meTchaikovsky
- 163
- 5