Enhancing the visual landscape
In today’s world of cutting-edge technologies, the acquisition of instant information is possible through advancements in digital image capture and processing. Image processing refers to the recognition, manipulation and image enhancement of a digital image to achieve an aesthetic quality, or to derive data to support another task. From detection systems at traffic lights to fingerprint and biometric security systems, digital imaging is crucial to a wide variety of real-world applications where vision is involved.
Image processing techniques are already used within a diverse range of industries and hold huge future potential. Image processing algorithms and artificial intelligence are now so accurate they can be used to sort items in a manufacturing assembly line, diagnose defects in the human body, shape our knowledge of climate change through satellite data and identify enemy objects in combat.
Associated schools, institutes & centres
Impact
We’re developing novel theories and algorithms to capture, process, analyse and understand single and multiple images and videos. Our research covers a diverse range of areas including:
- analysis of remote sensing imagery to shape our knowledge of the impacts of climate change
- medical imaging to help shape the design of future artificial knees
- video and image compression
- real-time imaging
- adaptive optics.
Our research has been instrumental in the development of a new multi-modal similarity measure called the Sum of Conditional Variance (SCV). The SCV is the first information-theoretic similarity measure that can be optimised using standard optimisation techniques. The SCV similarity measure is adopted for use by leading international research teams including:
- Johns Hopkins University (USA), where it is being used for visual tracking of robotic surgical tools in retinal surgery
- University College London and Imperial College London who are using the SCV similarity measure in a new technique for real-time tracking of deformable tissue surfaces during keyhole surgery
- a team in France that developed a modified version of the SCV for the real-time tracking of soft tissue in 3D ultrasound sequences. The team members hold positions at the Institut de Recherche Technologique, Inria, INSA, CHU, Université de Rennes and IRISA.
- Our research on satellite image analysis has a strong impact on converting remote sensing raw data into usable information across two aspects:
- the advanced investigation of image quality improvement via postprocessing, including error corrections such as multisource image registration and optical data cloud removal, super-resolution reconstruction and subpixel and super pixel-based techniques
- the development of effective machine learning as well as deep learning approaches. Reliable training of a classifier, which is critical for accurate information extraction, is addressed by the development of feature mining techniques in both spectral and spatial domains and the generation of novel class data models in high dimensional space.
Competitive advantage
We have world-leading expertise in:
- 2D and 3D medical image registration for kinematic analysis of knee and hip joints
- real-time imaging for autonomous guidance of unmanned aerial vehicles
- feature extraction and classification of hyperspectral imagery
- motion estimation for video and image compression
- algebraic reconstruction techniques for faster and finer CT reconstruction
- adaptive optics for turbulence characterisation and retinal imaging.
Successful applications
Our collaboration with the Trauma and Orthopaedic Research Unit (TORU) at the Canberra Hospital since 2005 has developed more effective methods to measure the relative motion of the bones in human joints using standard hospital imaging equipment. The major outcome of this project is the development of a software package called OrthoVis.
The algorithms used in OrthoVis are a result of several PhD student projects supervised by members of the Imaging group. This software is now an intrinsic part of a major clinical trial to evaluate the performance of three different artificial knee designs.
We also demonstrate the applications of remote sensing imagery across:
- crop mapping
- weed classification
- flood assessment
- moving vehicle detection from satellite videos.
Partners
-
Xu M, Jia X, Pickering M, Jia S, Thin cloud removal from optical remote sensing images using the noise-adjusted principal components transform, ISPRS Journal of Photogrammetry and Remote Sensing 149:215-225 01 Mar 2019
Y. Guo, X. Jia and D. Paull, “Effective sequential classifier training for SVM-based multitemporal remote sensing image classification,” Transactions on Image Processing, 27 (6): 3036 – 3048, 2018.
Y. Chen, H. Jiang, C. Li, X. Jia, and P. Ghamisi, “Deep feature extraction and classification of hyperspectral images based on Convolutional Neural Networks,” IEEE Trans. Geosci. Remote Sens., 54(10): 6232 - 6251, 2016.
X. Jia, B.-C. Kuo, and M. Crawford, "Feature mining for hyperspectral image classification," Proceedings of the IEEE, vol. 101, no. 3, pp. 676-697, 2013.
F. Li, X. Jia, D. Fraser, and A. Lambert, "Super resolution for remote sensing images based on a universal hidden Markov tree model," IEEE Transaction on Geoscience and Remote Sensing, vol. 47, pp. 1270-1278, 2010.
X. Jia and J. A. Richards, “Segmented principal components transformation for efficient hyperspectral remote sensing image display and classification,” IEEE Trans. on Geoscience and Remote Sensing, vol. 37, pp. 538-542, 1999.
J. A. Richards and X. Jia, Remote Sensing Digital Image Analysis, 3rd ed. (1999) and 4th ed. (2006): Springer-Verlag.
Junpeng Zhang; Xiuping Jia; Jiankun Hu; Kun Tan, “Moving Vehicle Detection for Remote Sensing Video Surveillance with Nonstationary Satellite Platform,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 10.1109/TPAMI.2021.3066696, 2021.
Study with us
Courses associated with Imaging research include:
- ZEIT4226 Digital Image Processing and Target Detection
- ZEIT4227 Radar Techniques and Applications
- ZEIT8221 Spaceborne Imaging Technology
We also offer a professional education short course for those wishing to upskill.
