7

I want to approximate $uu'$ with a finite difference. On the one hand, it seems to be $$(uu')_i=u_i\frac{u_{i+1}-u_{i-1}}{2\Delta t}=\frac{u_iu_{i+1}-u_iu_{i-1}}{2\Delta t}$$ On the other hand, $$(uu')_i=\left(\frac{d}{dx}\frac{u^2}{2}\right)_i=\frac{u^2_{i+1}-u^2_{i-1}}{4\Delta x}$$ I might be wrong but I think that they both have truncation error $\mathcal{O}(\Delta x)^2$. Which of these finite differences should I use?

cfdlab
  • 3,028
  • 13
  • 19
  • Unfortunately this is going to be somewhat dependent on the context. Do you have a particular problem in mind? – Kyle Mandli Jan 10 '21 at 14:26
  • @KyleMandli E.g. Kuramoto-Sivashinsky $u_t=-uu_x-u_{xx}-u_{xxxx}$, $x\in[0,L_x]$, periodic bc but I would like to know how to approach this in general to be able to deal with other non-linear pde – Vladislav Gladkikh Jan 11 '21 at 01:28
  • I don’t think both formulas have the same truncation error. In fact, in your first formula you assume that $u$ is constant in the range $[x-\Delta x,x+\Delta x]$ which is not necessarily a good approximation. In fact, this approximation is just a zeroth order approximation. I think better approximation is using trapezoidal rule to take $u$ equal to $\frac{u_{i-1}+u_{i+1}}{2}$ in that range which brings you to your second formula. My final conclusion is that your second formula is more accurate than the first formula and has lower truncation error or its order of accuracy is higher. – Mithridates the Great Jan 11 '21 at 03:23
  • 4
    Both are second order, but truncation errors will be different. Second one is conservative, use that if you think conservation is important for your problem. – cfdlab Jan 11 '21 at 03:44
  • @cfdlab has this right: You have to think about what the term means and then discretize accordingly. Here, you are probably thinking of it as a flux, so you will want to choose a conservative way to discretize. – Wolfgang Bangerth Jan 11 '21 at 16:29
  • If I recall the KS equations are often though of in the context of integrable equations so I agree with @wolfgang-bangerth that you probably want to use the conservation version of the difference operator. There is some more theory about this you may want to look up regarding symplectic or geometry preserving integrators and operators but I am by no means an expert in that field. Hopefully someone else may be able to help provide a more in depth answer for you if need be. – Kyle Mandli Jan 11 '21 at 19:26

1 Answers1

2

There is really no such thing as a good finite difference equivalent to an operator. In the earliest days of scientific computing, the thought was that each differential operator would be replaced by some finite difference expression, and that finite difference operator would be the most accurate one available, usually a central difference.

I believe that the issue was first stated properly by Brian Spalding

"There is no best formulation for a first-derivative or second-derivative expression in isolation; it is the combination of the first and second order derivatives, as they appear in a particular differential equation, that require to be represented by an algebraic expression" (Spalding, D.B., 1972. A novel finite difference formulation for differential expressions involving both first and second derivatives. International Journal for Numerical Methods in Engineering, 4(4), pp.551-559.)

This is far more general than just in the context of advection-diffusion equations in which it was made. It applies to ODEs and PDEs of any kind. What matters is not the error in each term, but the error in the entire combination. This is sometimes referred to as error cancellation. It is surprising that, almost fifty years later, this is still not recognised by some communities.

It must also be stressed that accuracy is not the only property required. Stability, conservation, upwinding and behavior at boundaries must also be taken into account, and may sometimes be in conflict. Efficiency (in various senses) and ease of coding are also important.

There is a shortage of books dealing with this, because most authors write from within thir own specialization and its own traditions. However, techniques for investigating this kind of question do exist, such as dispersion analysis and "equivalent equation" analysis. But in the broadest context this is still a research problem.

Philip Roe
  • 1,154
  • 6
  • 5