I am working with tick-data on some of the more liquid futures and options which gets millions of ticks every single day. Can I use the normal statistical techniques (like correlation, regression, cointegration, etc) to tick data due to the high noise. If not, can someone please suggest some other techniques which help me do these things?
+-----+---------+---------+----------+------------+
| Seq | Bid | Ask | Mid | IV |
+-----+---------+---------+----------+------------+
| 1 | 25.25 | 25.40 | 25.325 | 0.325569 |
| 2 | 25.25 | 25.45 | 25.350 | 0.325769 |
| 3 | 25.25 | 25.30 | 25.275 | 0.325959 |
| 4 | 25.25 | 25.30 | 25.275 | 0.325909 |
| 5 | 25.25 | 25.45 | 25.350 | 0.325769 |
| 6 | 25.25 | 25.35 | 25.300 | 0.325779 |
| 7 | 25.20 | 25.35 | 25.275 | 0.325799 |
| 8 | 25.25 | 25.35 | 25.300 | 0.325639 |
| 9 | 25.25 | 25.45 | 25.350 | 0.325799 |
| 10 | 25.30 | 25.45 | 25.375 | 0.325639 |
| 11 | 25.30 | 25.50 | 25.400 | 0.325509 |
| 12 | 25.30 | 25.45 | 25.375 | 0.325619 |
| 13 | 25.30 | 25.45 | 25.375 | 0.325669 |
| 14 | 25.30 | 25.45 | 25.375 | 0.325699 |
| 15 | 25.30 | 25.35 | 25.325 | 0.325629 |
| 16 | 25.35 | 25.40 | 25.375 | 0.325679 |
| 17 | 25.35 | 25.40 | 25.375 | 0.325849 |
| 18 | 25.35 | 25.40 | 25.375 | 0.325799 |
| 19 | 25.35 | 25.40 | 25.375 | 0.325999 |
| 20 | 25.35 | 25.40 | 25.375 | 0.325989 |
| 21 | 25.40 | 25.45 | 25.425 | 0.325839 |
| 22 | 25.45 | 25.60 | 25.525 | 0.325969 |
| 23 | 25.45 | 25.55 | 25.500 | 0.325899 |
| 24 | 25.45 | 25.65 | 25.550 | 0.325789 |
| 25 | 25.45 | 25.50 | 25.475 | 0.325879 |
| 26 | 25.40 | 25.50 | 25.450 | 0.325849 |
| 27 | 25.40 | 25.50 | 25.450 | 0.325869 |
| 28 | 25.45 | 25.50 | 25.475 | 0.325689 |
| 29 | 25.45 | 25.60 | 25.525 | 0.325599 |
| 30 | 25.45 | 25.60 | 25.525 | 0.325649 |
+-----+---------+---------+----------+------------+
PS: Sorry if I posted data in wrong format, took me a lot of time to find a good way to do this but I could only find this: https://meta.stackexchange.com/questions/156729/how-to-display-data-in-table-structure-in-stack-overflow
Regards