My research interests are (but not limited to) Computer vision, Pattern recognition and Animal re-ID. I also doodles.

Interested in pursuing an Msc or a PhD? Drop me an email at mhihipni at unimas dot my

---

Projects:

Design of A Deep Learning Model with Attention Mechanism for Biometric Re-identification of Green Sea Turtles in Long-term Tracking Scenario

We work with Sarawak Forestry Corp. to develop an automated biometric re-identification prototype for nesting Green sea turtles. Instead of using plastic/metal tags to re-identify individuals, our solution utilises a motion-activated and downright-facing camera to capture images of nesting female sea turtles. We trained deep learning models to extract the ROIs and infer individuals' ID. Our findings are reported in: i. IJAI2024, Zakry, K.A., Soria, S., Hipiny, I., Ujir, H., Hassan, R., & Hardi, R. (2024). Chelonia Mydas Detection and Image Extraction from Noisy Field Recordings, International Journal of Artificial Intelligence, 13(2), pp. 2354-2363, and ii. IJCDS (in-press), Soria, S., Zakry, K.A., Hipiny, I., Ujir, H., Hassan, R., & Jerry, A.L. (2024). International Journal of Computing and Digital Systems, 16(1), pp. 201-211.

Who Danced Better? Ranked Dance Video Dataset and Pairwise Skill Annotation Method

We developed a pairwise skill annotation method for tik-tok dance challenges. The method encodes the subject's consecutive 2D poses into String values to preserve order and tempo (of micro movements). The article is published: IJAIN2023, in International Journal of Advances in Intelligent Informatics 9(1), pp. 96-107, 2023. Dataset is available here: link. A 2nd article utilising the same dataset has also been published: IJ-AI2023, in International Journal of Artificial Intelligence 12(2), pp. 602-609, 2023.

A Novel Keypoint-based Recognition Pipeline for Iban Mat Motifs utilising Adaptive Smoothing, a PhD student project

The first article, i.e., IJEECS2021, provides proofs that we can use local feature descriptors to distinguish between classic Iban mat motif classes. Silvia's 2nd article, i.e., IJ-AI2023, introduces a classification framework that utilise adaptive smoothing to exclude small and non-discriminative features from affecting the classification's result.

AR-PHOTOBOOTH© available for purchase)

More details,

MO-LEARN©: Kinaesthetic Learning (available for purchase)

More details,

MO-WALL©: Interactive Kiosk with Gesture Recognition (available for purchase)

More details

Biometric identification of sea turtles (Chelonia mydas)

Hipiny, I., Ujir, H., Mujahid, A., and Yahya, N.K. (2018), Towards Automated Biometric Identification of Sea Turtles (Chelonia mydas), Journal of ICT Research and Applications, 12(3), 256-266, doi:10.5614/itbj.ict.res.appl.2018.12.3.4, Link, PANDAN-CHELOMY Dataset,

Activity recognition using gaze

I worked on modeling activities as a record of fixated visual landmarks, i.e., Gaze regions (See video), [BRISTECHREPO12]. The Gaze regions also prime locations of natural temporal cuts inside an egocentric video, [CITA15], and their properties are indicative of the subject's task performance, [ICSIPA17a]. My PhD (2014) thesis is available here.

---

Current Postgraduates

Name, Lvl	Thesis title	Remarks
Joseph S., PhD	Iban’s Plaited Mat Motifs Recognition using Invariant Image Features	Sept 2017 - 2024, Passed viva voce with minor correction [IJEECS2021], [IJ-AI2023]
Zakry K.A., MSc	Design of A Deep Learning Model with Attention Mechanism for Biometric re-ID of Green Sea Turtles in Long-term Tracking Scenario	Oct 2021 - Now, Thesis submitted, awaiting viva, [IJAI2024]
Soria S., MSc	Automatic segmentation of Region-of-Interest (ROI) in nesting Green sea turtle videos	Feb 2022 - Now, 1st paper will appear in IJCDS 16(1)
Leghari I., PhD	Artificial Intelligence Approaches for Identification and Evaluation of Intellectual Disabled Down Syndrome People of Pakistan: A Model Based Study	Oct 2022 - Now, Co-sup w/ AP Dr Hamimah
Ghazvini A., PhD	Image retargetting	Apr 2024 - Now

---

Graduated

Name, Lvl	Thesis title	Remarks
Peter M., MSc	Facial Expression Synthesis using Kernel Approach	Co-sup w/ Dr Jacey-Lynn Minoi
Joseph S., MAIT	Unsupervised Classification of Intrusive Igneous Rock Thin Section Images using Edge Detection and Colour Analysis	[ICSIPA17b], Now at Dept. of Minerals and Geoscience, Malaysia.

---

Datasets

PANDAN-CHELOMY, a dataset containing 140 aerial (70 raw + 70 rotated upright) images of sea turtles (Chelonia mydas), captured at Pandan Beach, Lundu.[link]

UNIMAS-CDRG-TIKTOK, a dataset containing 240 ranked videos (20 x 12 label categories). link

---

Miscellaneous

1. Freeglut - I use this instead of GLUT in my Computer Graphics’ class
2. MinGW
3. NeHe - The best resource site for OpenGL
4. Colah’s excellent LSTM tutorial
5. An excellent Youtube video on JPEG compression, DCT ***