Use good ol’ tabular* environment:
\documentclass[twocolumn]{article}
\usepackage{lipsum}
\begin{document}
\lipsum[2]
\begin{table}[htp]
\begin{tabular*}{\columnwidth}{ @{\extracolsep{\fill}} |l||c|c| @{} }
\hline
\textbf{Component} & \textbf{Time in ms} & \textbf{Time in \%} \\
\hline
Data processing & 42 & 33\\
\hline
RANSAC & 2 & 1 \\
\hline
Region Proposals & 82 & 64 \\
\hline
\end{tabular*}
\caption{Breakdown in the running time our system with a single core
machine. Time in ms is averaged across the validation set.}
\label{tab:componentruntime}
\end{table}
\lipsum
\end{document}

The mandatory version with booktabs and no vertical rule. The left alignment in the first column makes the double vertical rule unnecessary (it never is, actually). Since entries are not split across lines, the horizontal rules can be reduced to a bare minimum.
\documentclass[twocolumn]{article}
\usepackage{booktabs}
\usepackage{lipsum}
\begin{document}
\lipsum[2]
\begin{table}[htp]
\begin{tabular*}{\columnwidth}{ @{\extracolsep{\fill}} lcc @{} }
\toprule
\textbf{Component} & \textbf{Time in ms} & \textbf{Time in \%} \\
\midrule
Data processing & 42 & 33\\
RANSAC & 2 & 1 \\
Region Proposals & 82 & 64 \\
\bottomrule
\end{tabular*}
\caption{Breakdown in the running time our system with a single core
machine. Time in ms is averaged across the validation set.}
\label{tab:componentruntime}
\end{table}
\lipsum
\end{document}

By also loading siunitx you can easily get alignment for the figures.
\documentclass[twocolumn]{article}
\usepackage{booktabs}
\usepackage{siunitx}
\usepackage{lipsum}
\begin{document}
\lipsum[2]
\begin{table}[htp]
\begin{tabular*}{\columnwidth}{
@{\extracolsep{\fill}}
l
S[table-format=2.0]
S[table-format=2.0]
@{}
}
\toprule
\textbf{Component} & \textbf{Time in ms} & \textbf{Time in \%} \\
\midrule
Data processing & 42 & 33\\
RANSAC & 2 & 1 \\
Region Proposals & 82 & 64 \\
\bottomrule
\end{tabular*}
\caption{Breakdown in the running time our system with a single core
machine. Time in ms is averaged across the validation set.}
\label{tab:componentruntime}
\end{table}
\lipsum
\end{document}

tabu: just avoid it. – egreg Jan 24 '17 at 14:01