Cusp solitons mediated by a topological nonlinearity

Harvey just finished what should be the last paper of his PhD studies: Cusp solitons mediated by a topological nonlinearity

Harvey's PhD project studied the intersection between topological data analysis (TDA) techniques and nonlinear and many-body quantum dynamics. His first paper devised a TDA-based pipeline for detecting the emergence of quantum chaos in a periodically-driven nonlinear Kerr cavity. He followed this up with a demonstration of many-body quantum scar detection using topology-based dimensional reduction.

These works, while very nice, were ultimately using TDA to recover known physics. We really want to find examples where TDA can unveil new physics. This is a hard problem. Where to look? And what counts as "new"?

The easier solution for us was to insert TDA "by hand" into a nonlinear model, and see what came out of it.

For our testbed we took the nonlinear Schrodinger equation, frequently used to model nonlinear waves in various platforms. In the usual nonlinear Schrodinger equation, the conserved energy is the Hamiltonian,

$$ H = \int dx \left[ \frac{1}{2} |\partial_x \psi |^2 - \frac{g}{2} |\psi|^4 \right] $$

The second term, responsible for the nonlinear dynamics, can be interpreted as an intensity-dependent potential of depth $\frac{g}{2}|\psi|^2$. We looked at what would happen if we replaced this term with a quantity obtained using TDA. When dealing with one-dimensional functions, such as intensity profiles $|\psi(x)|^2$, TDA frequently uses sublevel set persistent homology, characterizing shape in terms of the persistence of local maxima and minima. We used the total persistence of these features as an energy penalty term, leading to

$$ H^{\prime} = \int dx \left[ \frac{1}{2} |\partial_x \psi|^2 - \alpha \mathrm{sgn}( \partial_x |\psi|^2 ) (\partial_x |\psi|^2) \right]  $$

Deriving the equations of motion, we found that this topological energy penalty gives rise to effective $\delta$ function potentials at the local maxima and minima of intensity, which act to enhance or suppress local maxima, depending on the sign of the nonlinear coefficient $\alpha$. We then studied the resulting nonlinear dynamics, including the focusing of Gaussian and flat-top beams.

The dynamics are very different from the regular nonlinear Schrodinger equation with focusing nonlinearity, where such a flat top beam would quickly break up into a collection of tightly-focused bright solitons. In this case, since the nonlinearity is proportional to the intensity gradient, its influence is mainly limited to the edges of the flat-top beam. 

We also uncovered some interesting connections to the physics of nonlocal nonlinear systems. Specifically, our "topological nonlinearity", when regularized, resembles a weakly nonlocal nonlinearity with a vanishing local part. Such nonlinearity leads to cusp solitons, as was previously studied in the context of plasma physics!

We hope to follow up this study with investigations of similar "topological" nonlinearities and potential experimental realizations. In the present work we speculated that similar nonlinearities may arise in the context of fluid-mediated nonlinearities and lattices undergoing Floquet modulation, but demonstrating such implementations explicitly remains an open problem for us.

From classical to quantum HodgeRank

This is a rather late summary of a cool preprint I saw a few months ago: Quantum HodgeRank: Topology-Based Rank Aggregation on Quantum Computers 

This work is inspired by and builds on quantum subroutines developed for efficiently solving high-dimensional topological data analysis problems, offering superpolynomial speedups for ranking higher-order network data by developing a quantum version of the classical HodgeRank algorithm.

What is HodgeRank? It was originally proposed in 2011 as a better way of ranking incomplete or skewed datasets, for example based on user ratings or scores.

The basic idea is to apply an analogue of the Helmholtz decomposition (used routinely in electromagnetics) to graph data, enabling one to assign a ranking based on incomplete pairwise preferences. Importantly, HodgeRank outputs not just a raw ranking, but also an estimate of the quality of the ranking via the construction of local and global cycles present in the optimal ranking. To be specific, the returned optimal ranking is unique and fully consistent if the preference matrix can be written as the gradient of some scalar ranking function. If it cannot, then there are inevitable ambiguities present in the preference data due to the existence of global or local cycles. 

An example of a local ranking cycle is the following: B is preferred over A, C is preferred over B, and yet A is preferred over C. This leads to the ranking A < C < B < A, thus forming a cycle. It is better to identify cycles such as these and acknowledge that a traditional ranking does not make sense for these items. This is what HodgeRank does! User preference data is rarely consistent, so cycles such as these routinely occur in the wild, for example in user rankings of movies on online platforms such as Netflix. 

As a generalization of HodgeRank, Quantum HodgeRank promises the ability to perform ranking tasks on preference data forming higher-order networks, avoiding the exponential scaling with network dimension faced by classical algorithms. Moreover, the authors of the preprint argue that HodgeRank cannot be dequantized (i.e. implemented efficiently using a randomized classical algorithm) in the same manner as quantum TDA algorithms for the Betti number problem. Moreover, while applications of high-dimensional Betti numbers (and even their occurrence in real datasets) remain unclear, HodgeRank represents a ranking problem with more likely concrete applications. Thus, this looks like an exciting area to keep an eye on. 

It is also interesting to speculate on whether (classical) HodgeRank or HodgeRank-inspired methods can be useful for understanding the behaviour of interacting many-body quantum systems, where it is typically intractable to sample all of the pairwise interaction elements of Hamiltonians as the system size increases, but incomplete or skewed sampling is readily available. Watch this space!

From NISQ to small logical quantum circuits

After six years of huge interest in NISQ (noisy intermediate-scale quantum) circuits there are still no practical applications where a noisy quantum device can outperform the best classical methods. Noise is too detrimental, and classical methods are too powerful. Experts continue to argue that now is not the time for commercial applications: quantum error correction, hundreds of logical qubits, and millions of error-corrected gates are needed.

Then what's next? Circuits of a moderate size with some limited error correction capabilities. LISQ (logical intermediate-scale quantum) or something else, for short.

What can we expect from these up and coming small scale logical circuits?

First, a lot of the tools developed for the NISQ era will become obsolete. For example, variational quantum circuits involving continuously-parameterised quantum gates cannot be easily implemented in a fault-tolerant manner. Instead, post-variational hybrid quantum-classical algorithms for this era will need to offload the continuously-parameterised part of the algorithm to a classical computer, with the quantum circuit used to measure a set of (hopefully classically-intractable) observables that are used as inputs to the classical tunable model.

Second, the hardware, algorithms, and the error correcting code cannot be considered in isolation. Choosing the right error correcting code will be essential to get the most out of the current hardware. Examples of this can be seen in QuEra's logical circuit demonstration from late last year, where the use of a 3D quantum error correction code allowed them to perform random IQP circuit sampling with error detection, and Quantinuum's recent demonstration of repeated error correction. Similar to the NISQ era, different hardware platforms will have different strengths and limitations in what kinds of circuits they will be able to run.

Finally, the most valuable software tools in the NISQ era were for quantum control and state tomography, essential to get the most out of the noisy hardware. These tools will remain important, since fidelities at the physical qubit level directly affect the amount of quantum error correction overhead required. As we move to logical circuits, the new valuable quantum software will be in the form of compilers that will take all the hassle out of hardware and error code selection out of the end-user and translate a given logical circuit into simple, understandable hardware requirements.

Arxiv April Fools'

This year there are quite a few joke papers cross-listed in the popular physics category. My favourite: "Is Winter Coming?"

Particularly memorable entries from previous years include "Novel approach to Room Temperature Superconductivity problem" and "A solvable string theory in four dimensions."

Updates

Infrequent posting due to other commitments. Here are a few brief items of note from the past month:

• Beng Yee uploaded his second paper from his PhD research to arXiv: A Unified Framework for Trace-induced Quantum Kernels. This project tackled the problem of how to choose the best quantum kernel for a given learning task using tools from classical multiple kernel learning theory. The bottom line: the optimal problem formulation (e.g. as a kernel model, projected kernel model, or quantum neural network) depends on the relative amount of training and test data, whether one wants to impose constraints to the trained model, and whether one has many qubits with low-fidelity gates or a fewer qubits with high fidelity gates. Read to find out more!
• The December issue of Optics & Photonics News highlights some of the most exciting peer-reviewed research in optics and photonics published over the past year. There is also an accompanying perspective on areas to watch in 2024 and beyond by selected summary authors.
• Two papers recently published in PRL caught my eye: Universal Sampling Lower Bounds for Quantum Error Mitigation suggests the quantum error mitigation being pushed by IBM and others as a means of getting useful applications out of current noisy quantum processors may be foiled by an exponentially growing measurement overhead, and Classifying Topology in Photonic Heterostructures with Gapless Environments shows how a recently-developed real space formulation of topological invariants may be a more useful tool for quantifying the robustness of topological states in photonic systems, particularly those exhibiting radiation losses of optical nonlinearities.
• The 7th International Conference on Optical Angular Momentum will be held 24 - 28 June 2024 in South Africa. The abstract submission deadline is 7 January 2024.
• The next edition of the Quantum Techniques in Machine Learning conference will be held in Melbourne, 25-29 November 2024. The abstract submission deadline is 5 July 2024. 
• In the news headlines: Alibaba shuts quantum computing lab. Seems to be part of a wider trend of industry funding shifting from quantum to generative AI - see also Zapata and Normal Computing.
  

Physics meets machine learning and AI

Machine learning research of interest to physicists can be broadly divided into two categories: using machine learning tools to solve physics problems, and using ideas from physics to improve machine learning techniques.

An example of the former is the transformer neural networks used in the design of large language models such as ChatGPT. The ability of the transformer neural network architecture to efficiently learn long-ranged correlations in data is also useful for variational methods for finding ground states of strongly-correlated quantum many-body systems. Two papers demonstrating this approach were published in Physical Review B and Physical Review Letters earlier this year.

Popular image generation tools such as Dall-E and Stable Diffusion (which I wrote about previously) are based on time-reversing a diffusion process to generate desired samples from noise. This approach is heavily inspired by techniques from non-equilibrium statistical mechanics published in Physical Review E in 1997.

Another pressing issue in machine learning and AI is how to understand the emergent properties of large language models as their size or training time is scaled up. This is a problem that physicists are well-posed to tackle using techniques from statistical physics, random matrix theory, and the theory of phase transitions, which have recently been applied to shallow neural network models in a few different studies:

Memorizing without overfitting: Bias, variance, and interpolation in overparameterized models

Learning through atypical phase transitions in overparameterized neural networks

Grokking phase transitions in learning local rules with gradient descent

Droplets of Good Representations: Grokking as a First Order Phase Transition in Two Layer Networks

I'm sure we'll see a growing number of theoretical physicists becoming involved in this exciting area of research in the coming years.

What I've been reading lately

Continuity Equation for the Flow of Fisher Information in Wave Scattering

We can get an intuitive understanding of a wide variety of wave systems ranging including photonics, acoustics, and electronic condensed matter by visualizing the flow of intensity, energy, or probability density through them. These flows are useful for understanding the behaviour of conserved quantities, since they can be decomposed into sources, sinks, and solenoidal components. This paper shows that the Fisher information, a measure which bounds the precision with which parameters of interest can be measured, similarly obeys a conservation law enabling its visualization in terms of information flow. Remarkably, the Fisher information flow gives distinct insights into wave propagation in complex media and is complementary to more standard analysis methods based on the energy flow. This work raises many interesting questions and opens new possibilities!

Energy and Power requirements for alteration of the refractive index

This is another paper in a series of perspectives on estimating the capabilities and potential limits to the performance of photonic devices using relatively simple classical oscillator models and sharp physical insights. The take home message is that the power required to achieve a given level of optical modulation depends primarily on the interaction time, which depends on the device geometry (e.g. resonator vs travelling wave), without substantial variation among different materials. This suggests that improvements in power efficiency are more likely to come from improvements in fabrication methods and device design, rather than the discovery of some new material with substantially better physical properties.

Quantum Algorithm for Computing Distances Between Subspaces

There's growing evidence that the best place to look for a quantum advantage for classical machine learning will be geometrical or topological problems that have a natural connection to quantum systems. One example is the Betti number problem, which maps to computing the ground state of supersymmetric many-body Hamiltonians. This work shows that computing distances between k-dimensional subspaces of an n-dimensional space can be done exponentially faster using a fault-tolerant quantum computer. The algorithm exploits the ability to efficiently encode subspaces into quantum states combined with quantum signal processing. Subspace distances have to large scale machine learning and computer vision problems, suggesting the asymptotic exponential advantage promised by a fault-tolerant quantum computer could lead to practical speedups.

arXiv highlights

Quantum-noise-limited optical neural networks operating at a few quanta per activation

Suitably-trained optical neural networks can still perform classification tasks accurately using low intensity light with a low signal to noise ratio. This suggests that specialized light-based analogue hardware for machine learning may offer a route towards reducing the enormous energy consumption of neural networks!

Dissipative mean-field theory of IBM utility experiment

Another approach towards reproducing the results of IBM's kicked Ising model quantum simulation experiment, this time using mean field theory. The Appendix gives a simple rule of thumb for estimating the quantum volume of specific devices based on their two-qubit gate and readout fidelities and compares some different hardware providers.

Maximally-Localized Exciton Wannier Functions for Solids

Wannier functions - localized states constructed as a superposition of Bloch waves from an energy band of interest - are an important tool of the condensed matter physicists' trade. This work presents a method for constructing maximally-localized Wannier functions for multi-particle states, focusing on applications to excitons (electron-hole pairs).

Tensorized orbitals for computational chemistry

This work presents a tensor network-based compression of the matrix elements that need to be computed and stored when performing quantum chemistry calculations, based on Tensor Cross Interpolation. This is yet another example of how tools from quantum many-body physics can be used to speed up time-consuming computational tasks - no working quantum computer needed!

Seeking quantum speedups using supersymmetric systems

There is a neat correspondence between the question of whether a simplicial complex has a k-dimensional hole and whether the ground state of a related supersymmetric (SUSY) quantum many-body Hamiltonian is at zero energy:

Complexity of Supersymmetric Systems and the Cohomology Problem

Clique Homology is QMA1-hard

A less technical presentation of the latter paper at QIP2023 and can be viewed here.

Both problems are QMA1-hard, meaning that the correctness of a trial solution can be efficiently checked by a quantum computer (but finding the correct solution remains hard even for the quantum computer). In contrast, recently-proposed quantum algorithms for TDA consider relaxations of the homology problem that can be solved efficiently using quantum algorithms, such as estimating the normalized number of k-cycles to some finite precision.

What other seemingly classical or purely mathematical problems can be naturally framed in the language of supersymmetric quantum mechanics? This promises to be fertile ground for exponential quantum speedups, and you don't need to be an expert in quantum algorithms to join the hunt!

Tensor network simulations challenge claims of quantum advantage...again!

Hot off the arXiv today: Efficient tensor network simulation of IBM's kicked Ising experiment

The authors report efficient classical simulations of the experiments by the IBM quantum computing team reported in Nature last week: Evidence for the utility of quantum computing before fault tolerance

What's going on here?

Tensor network methods are proving to be extremely powerful for computations related to quantum systems and large-scale neural networks. They work best for simulations of 1-dimensional or tree-like quantum systems (corresponding to the special case of matrix product states). Higher-dimensional systems or those with long range coupling containing looped paths, however, incur increasing overheads.

The Eagle quantum processor used in IBM's recent experiments is based on a two-dimensional network of qubits on a "heavy hexagon" grid. Thus, even though it is two-dimensional (harder for tensor network methods), its loops are longer than that of a more compact square lattice. The time required to traverse a single loop is comparable to the circuit depths probed in the experiment, meaning that by applying some clever factorization tricks the dynamics can be reproduced by efficiently-simulable tree-like tensor networks!

 

This is not the first time tensor networks have challenged claims of supremacy - they have also been used to simulate Google's original quantum supremacy experiments. What is particularly striking here is that the time between the publication of the quantum experiment and publication of the classical reproduction has dropped from years to weeks!

Here are some libraries for trying out tensor network simulations of quantum systems:

tensorcircuit: Python library developed by Tencent Quantum Lab - can handle shallow circuits involving hundreds of qubits.

ITensorNetworks: Julia library developed by the Flatiron Institute, which was used to reproduce the IBM experiments.

For theorists, getting familiar with these simulation tools that can also be applied to other important areas (such as large-scale machine learning or numerical simulations) seems to be a better use of time than getting to grips with the intricacies of ever-changing device-specific error models and quantum error mitigation schemes!

The localization landscape

Localization of waves due to destructive interference in disordered media - Anderson localization - has been a subject of intense investigation for more than 50 years. The original paper has now been cited more than 15,000 times according to Google Scholar. Being a property of linear, non-interacting Hamiltonians subjected to a random potential, one might think that everything there is to know about this problem would have already been studied to death a long time ago, with current work focusing on understanding peculiarities arising under special circumstances.

Delightfully, this is not the case! Back in February, this preprint caught my attention due to its keywords of many-body localization and persistent homology. Specifically, the authors have used persistent homology to characterize the shape of the "localization landscape" of a many-body Hamiltonian. 

What is the localization landscape?

The localization landscape was first proposed by Filoche and Mayboroda in an article in PNAS which, despite its broad applicability to understanding wave transport in a variety of settings (condensed matter, photonics, acoustics), did not attract as much interest as other arguably more specialized areas such as non-Hermitian systems or topological edge states. In short, the localization landscape u of a Hamiltonian $\mathcal{H}$ satisfying certain properties is the solution of the linear equation

$$\mathcal{H} u = \mathcal{1},$$

where $\mathcal{1}$ is a vector with all elements equal to 1. u corresponds to the steady-state response of the medium to a uniformly-distributed source.

Left: The localization landscape of a disordered two-dimensional wave medium. Right: Five lowest energy eigenstates of the Hamiltonian, which are localized to distinct peaks of the landscape bounded by lines of small $u$ (red). For more details, read the paper!

Remarkably, it can be shown that $u$ bounds the spatial extend of the low energy eigenmodes of $\mathcal{H}$. Thus, instead of solving the eigenvalue problem and plotting its low energy modes individually to find out where they are localized, plotting $u$ alone is enough to find all the effective low-energy valleys in a medium. Moreover, as a solution to a linear system of equations, $u$ is easier to obtain than the eigenstates themselves. A more rigorous discussion (including the properties that must be satisfied by $\mathcal{H}$ can be found in the PNAS article, which is a pleasant and accessible read.

Interest is now growing in localization landscapes, thanks to recent generalizations that can bound the spatial extent of modes residing in the middle of the energy spectrum, eigenvectors of real symmetric matrices and modes of many-body interacting quantum systems. The latter remarkably shows that useful landscape functions are not limited to low-dimensional wave media, but can also bound the spreading of wavefunctions in the high-dimensional Fock space of many-body quantum systems.

A natural question that arises from these recent works is whether the localization landscape might have some potential applications in the context of quantum computing and noisy intermediate-scale quantum (NISQ) processors. For example, finding the ground state of a generic many-body Hamiltonian is a computationally challenging problem, and methods for NISQ devices such as the variational quantum eigensolver may fail to converge due to the presence of vanishing gradients or sub-optimal local minima. 

Can the localization landscape offer an easier, more hardware-efficient way to sample from low-energy solutions of a hard-to-solve Hamiltonian? Watch this space to find out!

Tomography, topology, and more

Some preprints that caught my attention over the last few weeks:

Attention-based transformer networks for quantum state tomography. The tremendous surge in popularity of transformer-based large language models means that there is a lot of effort towards developing efficient hardware and algorithms for implementing transformer-based neural networks. It is thus timely to understand how this architecture may be useful for solving problems in physics. This preprint proposes a transformer-based model for density matrix reconstruction.

A discrete formulation of the Kane-Mele Z2 invariant. Newcomers to topological materials are often stumped on how to efficiently implement gauge-invariant formulas for topological invariants in numerical calculations; analytical formulas assume a smooth choice of gauge for the eigenfunctions, whereas numerical calculations will return a non-smooth random gauge. The method reported here for calculating Chern numbers without requiring any gauge-fixing greatly simplifies numerical calculations. The present preprint concisely presents a numerical-friendly formulation of the Z2 invariant describing quantum spin Hall phases.

Valley photonic crystal waveguides fabricated with CMOS-compatible process. This work presents valley Hall photonic crystals based on an improved mask design that yields more triangular-shaped holes, improving their performance as valley Hall waveguides. It will be interesting to see measurements of the absolute propagation loss and how it compares to the strong backscattering reported earlier this year.

Photonic Landau Levels. Two groups (from the Netherlands and from the USA) report experiments with strained photonic crystals that emulate Landau levels formed by electrons subjected to uniform magnetic fields. These works show how previous theory and experiments based on weakly-coupled waveguide arrays can be generalized beyond the tight-binding approximation and may serve as a novel platform for achieving high quality factor modes and enhanced light-matter interactions. 

Questions and concerns about Google's quantum supremacy claim. The lead author Gil Kalai is one of the most prominent skeptics of quantum computing. This preprint summarizes efforts to rigorously analyze the raw data behind Google's 2019 quantum supremacy experiments. Since there now exist efficient classical algorithms for reproducing the output of the quantum supremacy circuits, the most important outstanding result from the 2019 paper is that the errors in large scale quantum circuits are uncorrelated to a good approximation, suggesting that quantum error correction can work in principle. This preprint argues that the data underlying this claim is flawed and that more effort should be devoted to understanding noise sources present in NISQ devices.

Scaling up quantum processors

 Last November IBM announced with much fanfare their new 433-qubit superconducting quantum processor, named Osprey. Skeptics wanted to see the technical specifications before deciding whether this represented an important breakthrough or not. A few weeks ago the device (with 413 working qubits) finally became available for cloud users. Some technical specifications can be found here. 

Disappointingly, the quantum volume proposed by IBM themselves as a better measure of quantum processor performance than the raw qubit count is not yet available for this device. Presumably the slightly lower gate fidelities reported mean that the quantum volume does not exceed that achieved on their smaller devices with higher gate fidelity.

Meanwhile, Quantinuum announced their new trapped ion quantum processor with 32 fully-connected qubits and a whopping quantum volume of 65,536 (for reference, the best reported quantum volume from a cloud-accessible IBM device is 128). The announcement coincided with the upload of preprints to arXiv using the device to study quantum states with topological order and benchmarking its performance using various metrics.

metriq is a great resource for keeping track of all the different quantum processor platforms and devices and comparing their reported fidelities. Raw qubit counts are not meaningful without knowing the gate fidelities and device connectivity!

Suppression of modulational instability in valley-Hall waveguides

Posting has become infrequent due to some urgent deadlines and talk preparations over the last few weeks. Lots of great stuff has appeared on arXiv in May which I'm hoping to read and perhaps post about later. 

In the meantime, we also have a preprint out:

Self-steepening-induced stabilization of nonlinear edge waves at photonic valley-Hall interfaces

Several previous works demonstrated instabilities of topological edge states in the presence of weak nonlinearities, both numerically and analytically, often via reduction to a 1D nonlinear Schrodinger equation (NSE). We show here that if you go to stronger intensities, higher-order nonlinear effects (essentially arising from an intensity dependence of the effective Kerr nonlinearity strength) described by a modified nonlinear Schrodinger equation (MNSE) can stabilize the edge states! The phase diagram below nicely summarizes our central result:

I prepared some slides on this and our earlier analyses of nonlinear Dirac models describing topological edge states. The slides including some background material on photonic crystals and topological photonics are available here!