# How can off-diagonal Hamiltonian matrix elements be nonzero when the overlap matrix is diagonal?

While studying about Hückel theory, I got accustomed to the approximation of making the overlap matrix an identity matrix; that is making the off-diagonal elements zero as $S_{AB}= S_{BA}= 0\;;$ this implies the use of orthogonal base states of AOs. The off-diagonal elements of the Hamiltonian matrix are still taken as constants that may be non-zero: $H_{AB}= H_{BA}= \beta_{AB}$, where $\beta_{AB}$ is a negative quantity.

Then I wondered why it isn't the case that $H_{AB}= H_{BA}= 0$ strictly, as it represents the expectation value - the average energy contribution of the overlapping region of AOs $A$ and $B$. But, it would seem that overlapping is not actually possible, as is evident from the fact that $S_{AB}$ is zero.

Indeed, this seems rather counterintuitive, but it is not. Another way of looking at $S_{ij}=δ_{ij}$ is saying that all atomic orbitals are orthonormal to each other. So if you would evaluate the overlap integral of two different orbitals, it would result in zero. This does not necessarily mean that evaluating the Hamiltonian integral $\langle ϕ_i|\hat H|ϕ_j\rangle$ results in zero, because first applying the Hamiltonian operator on the wave function and then integrating might result in a non-zero outcome.

I know he is right in this point; but I'm still having trouble seeing how this is possible.

As Peter Atkins in his book Elements of Physical Chemistry wrote:

[...] The integral $H_{AB}$ depends on both $\psi_A$ and $\psi_B$, and we can interpret it as the contribution to the energy due to the accumulation of electron density where the two atomic orbitals overlap, including, for instance, the Coulombic attraction between the extra accumulation of electron density and both nuclei.

Evidently, this phrase makes clear that $H_{AB}$ is non-zero iff there is overlap between the AOs.

So, how can $H_{AB}\ne 0$ and $S_{AB}= 0$ both be true at the same time? And, what are the physical implications? While the former means there is overlap, the latter means the opposite; it seems really contradictory.

• Please don't use Math Jax in the title. It does not render in the mobile app and it comes with multiple more problems. I can't provide the link at the moment, but there are recent discussions on Meta. (Cc @brian) Dec 31 '15 at 1:50
• @Martin-マーチン Meant to change the title when I edited; forgot. Will tweak here shortly. Dec 31 '15 at 2:26

I believe the confusion lies in some ambiguity in the use of the term overlap.

For the $S_{AB}=0$ approximation of Hückel theory, overlap is used in the specific mathematical sense of the "overlap integral":

$$S_{AB} = \left<\varphi_A|\varphi_B\right> = \int_{\vec r}{\varphi_A^*\!\left(\vec r\right)\varphi_B\!\left(\vec r\right)\mathrm{d}\vec r}$$

However, this does not mean that at each point in $\mathbb{R}^3$ only one of $\varphi_A$ or $\varphi_B$ is allowed to bear a non-zero value. In fact, at most points in $\mathbb R^3$, $\varphi_A$ and $\varphi_B$ will both bear non-zero values. Since $\varphi_A$ and $\varphi_B$ will in general have "co-located regions of non-zero values," the two functions can be described qualitatively as overlapping, in the same sense as in your second quote. It is the overlap of the functions in this more general, qualitative sense, that allows $H_{AB}=\left<\varphi_A^*\middle|\hat H\middle|\varphi_B\right>\neq0$.

(To note, in order for Hückel's approximation to be exact, the orbitals would have to be selected such that the specific integral $S_{AB}$ over all $\mathbb R^3$ equals zero$^\ddagger$. I believe Hückel did not actually do this, but instead just coerced to zero any nonzero $S_{AB}$.)

To help explain more explicitly why this is, I'll first write out the integral implied by the Dirac notation for $H_{AB}$:

$$H_{AB}=\left<\varphi_A^*\middle|\hat H\middle|\varphi_B\right>= \int_{\vec r}{\varphi_A^*\!\left(\vec r\right)\hat H\!\left[\varphi_B\!\left(\vec r\right)\right]\mathrm{d}\vec r}$$

Then, I'll introduce two (real-valued) one-dimensional functions defined on the closed domain $x=[0,1]$ to use for demonstration purposes:

$$\varphi_A\!\left(x\right) = \sin\!\left(2\pi x\right) \\ \varphi_B\!\left(x\right) = \sin\!\left(3\pi x\right)$$

$\hspace{10mm}$

It is straightforward to show that $S_{AB}=0$ for these two functions. One way is to plug the overlap integral into Wolfram Alpha. Another option is to do it by hand. In the below figure, the green curve is a plot of the product $\varphi_A\!\left(x\right)\cdot\varphi_B\!\left(x\right)$, and the orange curve is a plot of the cumulative integral of this product:

$$\int_0^x{\varphi_A\!\left(x'\right)\cdot\varphi_B\!\left(x'\right)\mathrm{d}x'}$$

$\hspace{10mm}$

As can be seen, the integral over the entire domain is zero, satisfying $S_{AB}=0$.

Now, let's introduce a simple "Hamiltonian"$^\dagger$:

$$\hat H = x$$

The next figure is a replicate of the first one above, with $\hat H\!\left[\varphi_B\right]$ also plotted as the dashed red curve:

$\hspace{10mm}$

As in the second figure above, one last plot shows the local value of $\varphi_A\!\left(x\right)\hat H\!\left[\varphi_B\!\left(x\right)\right]$ along with the cumulative integral:

$$\int_0^x{\varphi_A\!\left(x'\right)\cdot\left[x'\cdot\varphi_B\!\left(x'\right)\right]\mathrm{d}x'}$$

$\hspace{10mm}$

The value of $H_{AB}$ here is clearly not equal to zero. (Wolfram Alpha concurs.) Thus, it is absolutely possible to have $H_{AB} \neq S_{AB} = 0$.

To note, the principle exhibited here on a closed domain in $\mathbb R^1$ applies equally well to orbitals on an infinite domain in $\mathbb R^3$. Note also, if I were actually performing a quantum mechanical calculation here, I would have been a lot more careful about normalizing my wavefunctions (viz., ensuring $S_{ii}=1$).

$^\ddagger$Numerous methods are known for generating orthogonalized orbitals with $S_{AB}=0$ strictly, from a general set of orbitals where $S_{AB}\neq0$ occurs for some non-null subset of the $\left(\!A,\!B\right)$. To my knowledge, the most commonly used orthogonalization for atomic orbitals is Löwdin's method (see this PDF). The Gram-Schmidt orthogonalization (usually in its "modified" form) is used in a variety of other areas of quantum chemistry. Wikipedia also has a pretty solid article on orthogonalization methods in general.

$^\dagger$You'd never use this as a Hamiltonian operator. Further, I'm not sure if it technically even is a Hamiltonian operator. (I think it'd work as a dipole moment operator?) But, whatever, leave me alone, it's for purposes of illustration.

• Okay, this means at most points $\varphi_A$ and $\varphi_B$ are non-zero; but still the sum of them over all the volume is $\approx 0,$ isn't it? Then how it makes the difference; overlap region is still on the verge of null; how could there be $H_{AB}$ as it is also the integral over all the volume? If the overlap is zero, then why should $H_{AB}\ne 0$,irrespective of how the overlap integral became zero-either by one of $\varphi$s zero at a point or the net sum being zero?
– user5764
Dec 30 '15 at 20:41
• Cool! I am looking forward to seeing your example. In my previous answer, I already referred to my website (ivofilot.nl/posts/view/29/…) where you can see in Example 2 a scenario where an orthonormal basis gives off-diagonal Hamiltonian integrals. But perhaps this example is too complicated and you can come up with something simple and really to the point. :-) Dec 30 '15 at 21:34
• I agree with the general principle illustrated by your example, i.e., that for two arbitrary orbitals $A$ and $B$, $S_{AB}=0$ doesn't necessarily imply $H_{AB}=0$. However, it should be emphasized that for two atomic orbitals $A$ and $B$ belonging to different atoms, it is almost invariably (if not always) true that $S_{AB}=0$ iff $H_{AB}=0$. Dec 30 '15 at 23:03
• We still ignore $S_{AB}$ because most qualitative features of the solution don't change by this approximation (a counterexample: chemistry.stackexchange.com/a/42636/7841). But it would be a poor approximation if we really wanted to get accurate numbers (e.g., bonding energy) from Hückel theory. Dec 30 '15 at 23:06
• @higgsss Mmm, so actually $S{AB} \neq 0$ holds generally, it's just that the Hückel approximation treats them as equal to zero? Hadn't appreciated that. Good points. Dec 30 '15 at 23:09

Maybe a little example from linear algebra (just imagine it to be spin space and we're back in the quantum world) can also add something to the discussion. Suppose you have two wavefunctions $$\psi_A = \frac{1}{\sqrt{2}} \begin{pmatrix} 1 \\ 1 \end{pmatrix} \qquad \psi_B = \frac{1}{\sqrt{2}} \begin{pmatrix} 1 \\ -1 \end{pmatrix}$$ Then obviously the overlap of the two is $$S_{AB} = \langle \psi_A | \psi_B \rangle = \frac{1}{2}(1 \cdot 1 + 1 \cdot (-1)) = 0$$ Nevertheless, if you consider the Hamiltonian $$H = \begin{pmatrix} 1 & 0 \\ 0 & -1 \end{pmatrix}$$ then you get $H_{AB} = \langle \psi_A | H | \psi_B \rangle = 1 \neq 0$.

My suggestion is to forget about the interpretation of these matrix elements given in Atkins, since it is very difficult to imagine how quantum-mechanical operators act (he also seems to forget that there is not only Coulomb interaction but also kinetic energy present in the Hamiltonian, the latter acting as a derivative operator on orbitals).