Research at CMMPEDevices & applications — Optical image processing


Optical information processing

Digital computing technology — based on binary data and silicon based electronic processors — dominates the computer landscape, and with good reason: it is a profoundly impressive and mature technology. However there are other candidates. The ability of silicon based computing to sustain exponential Moore’s Law improvements in performance (doubling transistor count every 2 years) is being questioned, making now an exciting time to consider alternatives.

Figure 1. The Fourier transform of a positive focal length lens

Fourier optical information processing is one such alternative. It exploits the serendipitous occurrence of the Fourier transform in optical systems as demonstrated in Figure 1, and was heavily developed historically for applications such as pattern recognition based on optical correlation architectures such as the phase only matched filter (POMF) and the joint trasnsform corrtalator (JTC).

Figure 2. Basic principle of the optical derivative engine. Lower right shows the filters required for different derivative functions.

There is potential for a revival of this technology, re-targeted as a ‘co-processor,’ to deliver a step change in performance for certain calculations. Specifically, it is proposed to create two different coprocessors: one to perform a 2D Fourier transform with a novel algorithm to allow direct phase determination; and one two differentiate a 2D function. The basic operating principle of this all-optical derivative processor or engine is shown in Figure 2.

Optalysys Optical Computing - Explained by Professor Heinz Wolff


Optical pattern recognition (comparators)

The joint transform correlator (JTC) is one of two main optical image processing architectures which provide us with a highly effective way of comparing images in a wide range of applications. Traditionally an optical correlator is used to compare an unknown input scene with a pre-captured reference image library, to detect if the reference occurs within the input. There is a new class of application for the JTC where they are used as image comparators, not having a known reference image, rather frames from a video sequence form both the input and reference. The JTC input plane is formed by combining the current frame with the previous frame in a video sequence and if the frames match, then there will be a correlation peak as shown in Figure 4. If the objects move then the peaks will move (tracking) and if something has changed dramatically in the scene, then the correlation between the two frames is lost.

Figure 3. The 1/f JTC architecture in the lab

The JTC can be built using a single liquid crystal over silicon spatial light modulator (SLM), a Fourier transform lens and a digital CMOS camera. The system is used over 2 passes to create the final correlation output plane, with the first pass creating the joint power spectrum which is them nonlinearly processed before being displayed on the SLM for the 2nd pass. This processing gives us a lot of flexibility in the way in which the comparator works, allowing its function and sensitivity to be tuned and optimised. This includes adding invariances such as rotation, scale and occlusion.

Figure 4. The JTC used as a frame by frame comparator.

This forms the basis of a very powerful application for the JTC in Defence and Security as well as many other machine vision problems such as industrial inspection or production line monitoring. Any change in the scene can be recorded and with the inherent shift invariance property of the correlator, any movement of the objects in the scene can also be detected.

Figure 5. The 1/f JTC from Cambridge Correlators (now called Optalysys)

Further reading on the joint transform correlator/comparator:

Download a JTC presentation (pdf)

Related journal patents and publications:

Optical processing, Patent application number WO2008110779, US8610839, filed 10th March 2008.

Optical correlator, UK patent application number WO2004029746, 9726386.7, filed 12th December 1997.

Non-display applications and the next generation of liquid crystal over silicon technology
T.D. Wilkinson, C. Henderson, D. Gil-Leyva, R. Ghannon and W.A. Crossland Phil.Trans.R.Soc.A, Vol 364, pp.2721-2731, (2006)

Optimization of a binary filter by direct binary search algorithm for rotational invariant JTC
J.A. Butt and T.D. Wilkinson, Proc. SPIE 5202-21, San Diego, (2003)

Optical comparator based on FLC over silicon technology
T.D. Wilkinson and N. New, Asian Journal of Physics, Vol.11(3), pp.345-366, (2002)

Optical comparator based on an FLC over Silicon SLM
T.D. Wilkinson, N.J. New and W.A. Crossland, Mol.. Cryst. Liq. Cryst, Vol.360, pp.17-27, (2001)

Compact optical correlator based helmet-tracking system
N.J. New and T.D. Wilkinson (Invited), Proc. SPIE 4387, pp.52-59, (2001)

Head tracker based on a compact optical correlator
T.D. Wilkinson and N.J. New, Proc. SPIE 6361, Orlando, (2001)

Optimising the discrimination capabilities of the joint transform correlator for a product validation application
N.J. New, T.D. Wilkinson and W.A. Crossland, Proc. SPIE 4043, pp.117-128, (2000)

Binary phase-only 1/f joint transform correlator using an FLC SLM
T.D. Wilkinson, W.A. Crossland and V. Kapsalis, Optical Engineering, 38(2), pp.357-360, (1999)

Optical recogniser based on FLC over silicon technology
T.D. Wilkinson and W.A. Crossland, Proc. SPIE 3715, pp.132-138, (1999)

The binary phase-only 1/f joint transform correlator using an FLC SLM
T.D. Wilkinson and V. Kapsalis, Ferroelectrics, 213, pp.241-247, (1998)

The binary phase-only 1/f joint transform correlator
T.D. Wilkinson, V. Kapsalis and W.A. Crossland, Proc. SPIE 3386, pp.65-69, (1998)

Compact optical correlator using silicon backplane FLC SLMs for fingerprint recognition
T.D. Wilkinson and R.J. Mears, Ferroelectrics, 181, p47, (1996)

Scale invariant optical correlators using ferroelectric liquid crystal spatial light modulators
T.D. Wilkinson, Y. Petillot, R.J. Mears and J.L. de Bougrenet de la Tocnaye, Applied Optics, 34, p1885, (1995)

Asymmetric binary holograms using an FLC SLM
T.D. Wilkinson, D.C. O’Brien and R.J. Mears, Optics Communications, 109, p.222, (1994)

Scale invariant binary phase-only matched filter using a ferroelectric liquid crystal spatial light modulator
T.D. Wilkinson, D.C. O'Brien and R.J. Mears, Applied Optics, 33, p4452, (1993)

back to top