![Dr Sonit Singh](https://api.research.unsw.edu.au/sites/default/files/images/profile/to%20upload.jpg)
Dr Sonit Singh
- Doctorate of Philosophy (PhD) in Multimodal Machine Learning, Macquarie University, Sydney, Australia 2021
- Master of Research (M.Res.) in Natural Language Processing and Machine Learning, Macquarie University, Sydney, Australia, 2017
- Bachelor of Technology (B.Tech.) in Electronics and Communication Engineering, Lovely Professional University, India, 2011
Sonit Singh is a Lecturer in the School of Computer Science and Engineering at the University of New South Wales (UNSW), Sydney, Australia. Before being promoted to the Lecturer position, he was a Postdoctoral Research Fellow in the School of Computer Science and Engineering at the University of New South Wales (UNSW), Sydney, Australia. Before joining UNSW, he did his PhD degree at Macquarie University, in collaboration with Macquarie University Hospital and Data61, CSIRO. His PhD thesis entitled “Multimodal Machine Learning for Medical Imaging” focused on developing multimodal machine learning models at the intersection of Computer Vision and Natural Language Processing that can jointly reason on medical images and radiology reports. Before this, he completed the Master of Research degree in Natural Language Processing and Machine Learning at Macquarie University in 2017. His Masters thesis entitled "Generalizing Link Prediction for Information Extraction" focused on extending knowledge graphs reasoning from triplets to n-ary relations. He received the Bachelor of Technology in Electronics and Communication Engineering from Lovely Professional University (India) in 2011. During his PhD and Masters, he was supported by an international Macquarie University Research Excellence scholarship and the Data61 CSIRO top-up scholarship.
Sonit Singh is also very passionate about learning and teaching. He has been actively teaching various computer science and engineering courses since 2011. Back in India, he taught various courses in Electronics Engineering, including Artificial Intelligence, Computer Vision, Robotics and Automation, Neural Networks and Fuzzy Logic, Electronic Devices and Circuits. After joining Department of Computing, Macquarie University in 2017, he had the opportunity to do lecturing and tutoring Data Structures and Algorithms, Data Science, Artificial Intelligence, Document Processing and Semantic Web, and Machine Learning units. Since August 2021, he joined UNSW and has been involved in teaching COMP9517: Computer Vision and COMP9444: Neural Networks and Deep Learning.
Sonit Singh has broad interests in Artificial Intelligence, Computer Vision, Natural Language Processing, Machine Learning, Deep Learning, Medical Imaging, and their intersections. Other research projects towards which he is highly inclined include Image Captioning, Visual Question Answering, Visual Dialog, and Visual-Language Navigation. Overall, Sonit Singh is passionate about teaching humans and machines. His research answers questions that impact clinical practice and patient outcomes.
- Publications
- Media
- Grants
- Awards
- Research Activities
- Engagement
- Teaching and Supervision
- Sonit Singh and Arcot Sowmya, "Wireless Capsule Endoscopy Image Analytics and Predictive Diagnostics", 2022-2023 ($80,000)
- Sonit Singh, "Improving Engineering Education using Project-based Learning", Course Design Institute Grant, 2024 ($2,500)
- Sonit Singh, "The Engineer and the World - 35th Australasian Association for Engineering Education Annual Conference", EF Grant, 2024 ($3467)
I feel honored to receive the following awards:
- 2023: UNSW Engineering Deans Early Career Academic Fellowship
- 2021: Highly Commended Finalist for 2021 Vice Chancellor's Learning and Teaching Awards at Macquarie University
- 2019: Awarded Postgraduate Research Fund (PGRF) in the Department of Computing, Macquarie University
- 2019: Awarded Data61, CSIRO top-up scholarship (Duration: 3 years; AUD 10,000 per annum)
- 2018: International Macquarie University Research Excellence Scholarship (iMQRES) including tuition fee waiver and providing living stipend for 3 years
- 2016: International Macquarie University Research Excellence Scholarship (iMQRES) including tuition fee waiver and providing living stipend for 1 year
- 2014: Received Teaching Excellence Award in the School of Electronics and Communication Engineering at Lovely Professional University, India
- 2011: Academic Roll of Honour - Vice-Chancellor's roll of honour for academic merit at undergraduate level
Sonit Singh has been involved in the following projects:
- Biomedical engineering project on the development of camera tracking based system for the registration of multiple 3D Ultrasound volumes of human placenta to form an extended ultrasound volume for having 3D view and analysis of the entire human placenta. The project is in collaboration with UNSW's Perinatal Imaging Research Group (Royal Hospital for Women / UNSW's School for Women's and Children's Health).
- Applying artificial intelligence technologies for the diagnosis and staging of liver diseases using ultrasound imaging. Specifically, project aims at discovering relevant imaging biomarkers in sequential ultrasound images/volumes that are predictive of Hepatocellular Carcinoma (HCC). This discovery will lead to early detection and staging of liver diseases, in turn saving human lives. The project is in collaboration with multiple hospitals across New South Wales, including St George, Liverpool, and Royal Prince Alfred.
- Omics Imagification: Converting Omics data into Images for the application of Convolutional Neural Networks. The project aims to develop methods to transform non-image omics data into images for the application of convolutional neural networks. This project is in collaboration with Dr. Miad Zandavi (Harvard Medical School), Prof. Arcot Sowmya (School of CSE, UNSW Sydney), and A/Prof. Fatemeh Vafaee (School of BABS, UNSW Sydney).
Seminar/Presentations
- Sonit Singh, "Bridging the gap between Images and Text with Deep Learning", Guest lecture in COMP3420: Artificial Intelligence for Text and Vision course in School of Computing, Macquarie University (29 August 2023)
- Sonit Singh, "Overview of UNSW AI and Analytics", presentation to delegates and Head of the Foreign Policy Strategy Agency of the Ministry of the Foreign Affairs of the Republic of Indonesia (20 March 2024)
- Sonit Singh, "Artificial Intelligence in Medicine: Making Impact in Clinical Practice", presentation to delegates from Ministry of Foreign Affairs, Malaysia (May 2023)
Professional societies:
- Member, Association for Computing Machinery (ACM)
- Member, Institute of Electrical and Electronics Engineers (IEEE)
- Member, Association for Computational Linguistics (ACL)
- Associate Fellow of Higher Education Academy, UK (AFHEA)
- Member, Australasian Association for Engineering Education (AAEE)
UNSW:
- Deputy Director, UNSW Online (Data Science and Analytics Program)
- Member, UNSW Data Science Hub (uDASH)
- Member, UNSW AI Institute (UNSW.AI)
Reviewing service:
- Computer Methods and Programs in Biomedicine
- Health Information Science and Systems
- IEEE International Symposium on Biomedical Imaging (ISBI)
- Artificial Intelligence in Medicine
- Association for Computational Linguistics (ACL)
- Artificial Intelligence in Medicine (AIIM)
- Conference on Computer Vision and Pattern Recognition (CVPR)
- IEEE Journal of Biomedical and Health Informatics (JBHI)
- IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
- Radiotherapy and Oncology
- European Conference on Machine Learning (ECML)
- IEEE Access
Engineering Education:
- Essentials of Supervision Workshop (Supervising Doctoral Studies)
- Scientia Education Academy Lecture Series
- Computers and Education
- Computers and Education: Artificial Intelligence
- Foundations of University Learning and Teaching (FULT) Program 2021
- UNSW Teaching Accelerator Program 2024
- UNSW Course Design Institute (CDI) Course Development Program 2024
Seminars, Workshops, Conferences
- Sydney Teaching Symposium, University of Sydney, 16 July 2024
- Attended Hybrid Workshop for Machine Learning Advances in Cardiovascular Health
- Attended Big Data Stream planning day at Ingham Institute for Applied Medical Research
- Attended UNSW Computing Research Expo 2022
- Attended Image Analytics Pillar launch at Tyree IHealthE
- 2023 Indo-Pacific International Maritime Exposition, International Convention Centre, Sydney (7-9 November 2023)
Representing CSE to delegates of international universities, research organisations, and government and industry bodies
- Thapar Institute of Engineering and Technology, India (18 August 2023)
- Mahidol University, Thailand (13 June 2023)
Posters
- Sonit Singh, "Advanced Computational Methods for Automated Image Analysis", CSE Research Expo, UNSW Sydney (24 October 2022)
Presentation/Seminars
- Sonit Singh, "Multimodal Machine Learning for Medical Imaging", MLCV Group, School of Computer Science and Engineering, UNSW Sydney (24 September 2021)
- Sonit Singh, "The Rise of Language Model", MLCV Group, School of Computer Science and Engineering, UNSW Sydney (17 December 2021)
- Sonit Singh, "Attention Augmented Convolutional Neural Networks", Computer Vision Group, School of Computer Science and Engineering, UNSW Sydney (08 July 2022)
- Sonit Singh, "Data Augmentation Techniques in Natural Language Processing", NLP Reading Group, School of Computer Science and Engineering, UNSW Sydney (12 September 2023)
- Sonit Singh, "Segment Anything Model", Biomedical Image Computing Group, School of Computer Science and Engineering, UNSW Sydney (28 March 2024)
- Sonit Singh, "Self-supervised Representation Learning for Images, Videos, Text, and Audio", MLCV Group, School of Computer Science and Engineering, UNSW Sydney
- Sonit Singh, "Retrieval-Augmented Generation for Large Language Models", Human-Centered Computing and Machine Learning Group, School of Computer Science and Engineering, UNSW Sydney
My Research Supervision
PhD Research Students
- Matt Gibson, "Machine Learning for Change Detection in Remote Sensing", School of Computer Science and Engineering, UNSW Sydney (Joint supervision with Prof. Arcot Sowmya)
- Md Akizur Rahman, "AI-Driven Automated Acute Diverticulitis Prognosis and Treatment Planning", School of Computer Science and Engineering, UNSW Sydney (Joint supervision with Prof. Arcot Sowmya, Dr. Alan Blair, and Dr. Praveen Ravindran (Colorectal Surgeon, Sydney Adventist Hospital))
- Shisheng Zhang, "Learning to Predict risk of Coronary Artery Disease from CTCA Images", School of Mechanical and Manufacturing Engineering, UNSW Sydney (Joint supervision with Prof. Arcot Sowmya and Dr. Susann Beier)
- Hao Wu, "Cardiovascular Risk Prediction based on CTCA images and clinical data using Machine Learning", School of Mechanical and Manufacturing Engineering, UNSW Sydney (Joint supervision with Prof. Arcot Sowmya and Dr. Susann Beier)
- Manna Elizabeth Philip, "Automated Fetal Cardiac Functional Assessment using 4D Ultrasound", School of Computer Science and Engineering, UNSW Sydney (Joint supervision with Prof. Arcot Sowmya, Prof. Alec Welsh (School of Medicine), and Dr. Gordon Stevenson (ML Engineer at Vexev Pty Ltd))
- Irfan Dwiki Bhaswara, "Surgical Instrument Detection and Tracking in robot-assisted surgery", School of Computer Science and Engineering, UNSW Sydney (Joint supervision with Prof. Erik Meijering and Prof. Arcot Sowmya)
MPhil Research Students
- Ziping Chu, "A self-adapting framework for medical image segmentation", School of Computer Science and Engineering, UNSW Sydney (Joint supervision with Prof. Arcot Sowmya)
Masters and Honours Research Students
- Darren Chong, "Omics Imagification: Representation Learning of Omics in the form of Images for the applications of CNN", September 2023 - Ongoing.
- Lachie Nguyen, "Diagnosing Coronary Stenosis in CTCA images using Artificial Intelligence", February 2024 - Ongoing
- Zhongsui Guo, "Smart Food Monitoring System", September 2023 - Ongoing
- Runyu Wang, "Automated Music Generation using Neural Networks", May 2023 - Ongoing
- Rahul Soni, "Course Recommendation System based on Career Interests", February 2024 - Ongoing
- Rohan Patel, "Course Recommendation System based on Career Interests", February 2024 - Ongoing
- Vincent Pham, "Improving Student Engagement in Online Learning", February 2024 - Ongoing
- Quoc Minh Quan Nguyễn, "Student Emotion Detection for Engagement in Online Learning, February 2024 - Ongoing
- Jonathan Chen, "Symbolic Music Generation using Deep Learning", February 2024 - Ongoing
Completions (Masters and Honours Thesis)
- Louisa Canepa, "Medical Visual Question Answering (Med-VQA), Honours in AI, May 2022 - April 2023.
- Michael Chen, "AI for the Diagnosis and Staging of Liver Diseases using Ultrasound Imaging", February 2023 - December 2023
Research Interns
- Shreyas Raturi, "Pan-cancer Classification using Omics Imagification techniques", SRM Institute of Science and Technology, India (May - November 2022)
- Vishnucharan S, "Adaptive Multiple Choice Question Generation using Knowledge Tracing Model", National Institute of Technology - Tiruchirappalli, India (April 2024 - Ongoing)
My Teaching
- Term 3, 2021 - COMP9517: Computer Vision
In Term 3 2021 I did Lecturing and Tutoring for COMP9517: Computer Vision course. I was mainly responsible for delivering lectures in Week 8 "Convolutional Neural Networks and their applications" and Week 9 "Applications of Deep Learning" where I covered various applications at the intersection of computer vision and natural language processing. As it was for the first time I was teaching a course at UNSW, I also get involved in tutoring COMP9517 to have better understanding of the course and its assessments. I revised tutorial/lab specifications and did marking of labs, assignment, project, and the final exam. Overall, it was a great teaching and learning experience.
- Term 2, 2022 - COMP9444: Neural Networks and Deep Learning
In Term 2, 2022, I did Lecturing and Tutoring for COMP9444 course. I was mainly responsible for delivering lectures from Week 4 to Week 7, covering topics on Computer Vision and Natural Language Processing.
- Term 3, 2022 - COMP9444: Neural Networks and Deep Learning
In Term 3, 2022, I did Lecturing and Tutoring for COMP9444 course. I was mainly responsible for delivering lectures from Week 4 to Week 7, covering topics on Computer Vision and Natural Language Processing.
- Term 2, 2023 - COMP9444: Neural Networks and Deep Learning/ COMP9511: Human Computer Interaction
In Term 3, 2022, I am Lecturing COMP9444 course. I am mainly responsible for delivering lectures from Week 4 to Week 7, Week 9 and Week 10, covering topics on Computer Vision and Natural Language Processing. For COMP9511, I am mainly delivering tutorials and marking assessments.
- Hexamester 1, 2024 - ZZEN9444: Neural Networks and Deep Learning
In Hexamester 1, 2024, I did lecturing for ZZEN9444 course, an accelerated 6-Weeks course delivered to UNSW Online (Data Science and Analytics) program cohort. I really enjoyed teaching this cohort as most of them are already working in the IT industry as senior data scientists, business analysts, machine learning engineers, etc.
- Hexamester 2, 2024 - ZZSC9020: Data Science Project
I am teaching and mentoring "Data Science Project" course, a 6-Week data science capstone project where students need to apply knowledge learnt in "Data Science and Analytics" program to solve some real-world problem. Students are provided with real-world data and they need to do formulate the research question, conduct literature review, exploratory data analysis, model implementation, results analysis, error analysis, limitations and future work.