Data Science Stack Exchange
Data Science Stack Exchange

Most Popular

more tags
1500 questions
13
votes
8 answers

Difference between machine learning and artificial intelligence

Is there any difference between machine learning and artificial intelligence? Or do these terms refer to the same thing?
Sairaam Venkatraman
  • 185
  • 10
13
votes
2 answers

How to check for dead relu neurons

Background: While fitting neural networks with relu activation, I found that sometimes the prediction becomes near constant. I believe that this is due to the relu neurons dieing during training as stated here. (What is the "dying ReLU" problem in…
Aveiur
  • 141
  • 1
  • 3
13
votes
3 answers

How to use GAN for unsupervised feature extraction from images?

I have understood how GAN works while two networks (generative and discriminative) compete with each other. I have built a DCGAN (GAN with convolutional discriminator and de-convolutional generator) which now successfully generates handwritten…
exAres
  • 251
  • 2
  • 4
13
votes
2 answers

deep learning for non-image non-NLP tasks?

So far there are many interesting applications for deep learning in computer vision or natural language processing. How is it in other more traditional fields? For example, I have traditional socio-demographic variables plus maybe a lot of lab…
spore234
  • 603
  • 8
  • 14
13
votes
3 answers

CNN memory consumption

I'd like to be able to estimate whether a proposed model is small enough to be trained on a GPU with a given amount of memory If I have a simple CNN architecture like this: Input: 50x50x3 C1: 32 3x3 kernels, with padding (I guess in reality theyre…
Simon
  • 1,071
  • 2
  • 10
  • 28
13
votes
3 answers

Best frequent itemset package in python

Could anyone please recommend a good frequent itemset package in python? I only need to find frequent itemset, no need of finding the association rules.
Edamame
  • 2,745
  • 5
  • 24
  • 33
13
votes
4 answers

Interpreting Decision Tree in context of feature importances

I'm trying to understand how to fully understand the decision process of a decision tree classification model built with sklearn. The 2 main aspect I'm looking at are a graphviz representation of the tree and the list of feature importances. What I…
Tim Lindsey
  • 245
  • 1
  • 2
  • 4
13
votes
1 answer

Reason for square images in deep learning

Most of the advanced deep learning models like VGG, ResNet, etc. require square images as input, usually with a pixel size of $224x224$. Is there a reason why the input has to be of equal shape, or can I build a convnet model with say $100x200$ as…
spore234
  • 603
  • 8
  • 14
13
votes
3 answers

How to do batch inner product in Tensorflow?

I have two tensor a:[batch_size, dim] b:[batch_size, dim]. I want to do inner product for every pair in the batch, generating c:[batch_size, 1], where c[i,0]=a[i,:].T*b[i,:]. How?
HenrySky
  • 161
  • 1
  • 2
  • 9
13
votes
4 answers

Extract information from sentence

I'm creating a simple chatbot. I want to obtain the information from the user response. An example scenario: Bot : Hi, what is your name? User: My name is Edwin. I wish to extract the name Edwin from the sentence. However, the user can response in…
edwin
  • 343
  • 1
  • 3
  • 10
13
votes
4 answers

Large Graphs: NetworkX distributed alternative

I have built some implementations using NetworkX(graph Python module) native algorithms in which I output some attributes which I use them for classification purposes. I want to scale it to a distributed environment. I have seen many approaches like…
20-roso
  • 680
  • 1
  • 5
  • 15
13
votes
2 answers

How to normalize data for Neural Network and Decision Forest

I have a data set with 20000 samples, each has 12 different features. Each sample is either in category 0 or 1. I want to train a neural network and a decision forest to categorize the samples so that I can compare the results and both techniques.…
Merlin1896
  • 245
  • 1
  • 2
  • 5
13
votes
3 answers

Tensorflow Adjusting Cost Function for Imbalanced Data

I have a classification problem with highly imbalanced data. I have read that over and undersampling as well as changing the cost for underrepresented categorical outputs will lead to better fitting. Before this was done tensorflow would categorize…
Cole
  • 181
  • 1
  • 1
  • 7
13
votes
6 answers

Why does prompt engineering work, since prompt engineering questions don't appear as training data?

One can find advice on prompt engineering telling basically the following thing: if you are seeking advice about a topic X, start your prompt to an LLM by You are an expert in X, you have pedagogical skills, and you are very good at synthesizing…
Plop
  • 233
  • 2
  • 7
13
votes
2 answers

Why does data science see class imbalance as a problem for supervised learning when statistics does not?

Why does data science see class imbalance as a problem in supervised learning when statistics says it is not? Data science seems to seem class imbalance as problematic and needing special techniques to remedy this problem. For instance, this DS.SE…
Dave
  • 3,818
  • 1
  • 8
  • 29
1 2 3
…
99 100