Original Paper

Journal of Engineering Research

, 4:2

First online:

Open Access This content is freely available online to anyone, anywhere at any time.

Image based recognition of Pakistan sign language

  • Muhammad RaeesAffiliated withDepartment of Computer Science and IT, University of Malakand
  • , Sehat UllahAffiliated withDepartment of Computer Science and IT, University of Malakand
  • , Sami Ur RahmanAffiliated withDepartment of Computer Science and IT, University of Malakand
  • , Ihsan RabbiAffiliated withDepartment of Computer Science and IT, University of Malakand Email author 

Abstract

Sign language is the language of gestures used for non-verbal communication. This paper deals with alphabets and digit signs recognition from Pakistan Sign Language (PSL). The deep pixels-based analysis is pursued for the recognition of fingers (from index to small finger) while thumb position is determined through Template Matching. After fingers identification, the isolated signs are recognized based on finger states of being raised or lowered besides thumb’s position in 2D. For a quick recognition, signs are categorized into seven groups. The algorithm identifies these groups following a model of seven phases. The system’s accuracy achieved a satisfactory level of 84.2% when evaluated with signs comprising 180 digits and 240 alphabets.

Keywords

Alphabets signs recognition digits signs recognition fingers detection hand gestures recognition Pakistan sign language