Indic computing

Indic Computing means "computing in Indic", i.e., Indian Scripts and Languages. It involves developing software in Indic Scripts/languages, Input methods, Localization of computer applications, web development, Database Management, Spell checkers, Speech to Text and Text to Speech applications and OCR in Indian languages.

Most of the widely used Indic scripts are encoded in Unicode for working on Computers and Internet. As of version 10.0, Bengali, Devanagari, Gujarati, Gurmukhi, Kannada, Limbu, Malayalam, Masaram Gondi,[1] Newari, Ol Chiki, Oriya, Sinhala, Tamil and Telugu scripts are encoded and supported. Historically used writing systems like Arwi,[2] Ahom alphabet,[2] Grantha,[3] Khudabadi,[3] Mahajani,[3] Modi alphabet,[3] Siddham script,[3] Syloti Nagri,[4] Tirhuta[3] are also included. Some more Indic scripts are in development and will be included in unicode, for instance Tulu Script.

A lot of Indic Computing projects are going on. They involve some government sector companies, some volunteer groups and individual people.

Government sector

Indian Union Government made it mandatory for Mobile phone companies whose handsets manufactured, stored, sold and distributed in India to have support for reading of text in all 22 languages.[5] This move has seen rise in use of Indian languages by millions of users.[6]

TDIL

The Department of Electronics and Information Technology, India initiated the TDIL[7] (Technology Development for Indian Languages) with the objective of developing Information Processing Tools and Techniques to facilitate human-machine interaction without language barrier; creating and accessing multilingual knowledge resources; and integrating them to develop innovative user products and services.

In 2005, it started distributing language software tools developed by Government/Academic/Private companies in the form of CD for non commercial use.

Some of the outcome of TDIL program deployed on Indian Language Technology Proliferation & Deployment Centre. This Centre disseminate all the linguistic resources, tools & applications which have been developed under TDIL funding. This programme took to exponential expansion under the leadership of Dr. Swaran Lata who also created international foot-print of the programme.

C-DAC
Main article: C-DAC

C-DAC is an India based government software company which is involved in developing language related software. It is best known for developing InScript Keyboard, the standard keyboard for Indian languages. It has also developed lot of Indic language solutions including Word Processors, typing tools, text to speech software, OCR in Indian languages etc.

BharateeyaOO.org

The work developed out of CDAC, Bangalore (earlier known as NCST, Bangalore) became BharateeyaOO.[8] OpenOffice 2.1 had support for over 10 Indian languages.

BOSS

BOSS is developed by National Resource Centre for free/open source software, an initiative of DIT. Its activities are coordinated by C-DAC Chennai and Anna University KBC Research Center. Support Centres are established at several cities in India to provide support to Users.

NGO and Volunteer groups

Indlinux

Indlinux organisation helped organise the individual volunteers working on different indic language versions of Linux and its applications.

Sarovar

Sarovar.org is India's first portal to host projects under Free/Open source licenses. It is located in Trivandrum, India and hosted at Asianet data center. Sarovar.org is customised, installed and maintained by Linuxense as part of their community services and sponsored by River Valley Technologies. Sarovar.org is built on Debian Etch and GForge and runs off METTLE.

Pinaak

Pinaak is a non-government charitable society devoted to Indic language computing. It works for software localization, developing language software, localizing open source software, enriching online encyclopedias etc. In addition to this Pinaak works for educating people about computing, ethical use of Internet and use of Indian languages on Internet.

Ankur Group

Ankur Group is working toward supporting Bengali language (Bengali) on Linux operating system including localized Bengali GUI, Live CD, English-to-Bengali translator, Bengali OCR and Bengali Dictionary etc.[9]

SMC
Main article: Swathanthra Malayalam Computing

SMC is a free software group, working to bridge the language divide in Kerala in the technology front and is today the biggest language computing community in India.[10]

Input methods
Reverie Keypad lists the supported Indian languages for typing, in Android

Full size keyboards

With the advent of Unicode inputting Indic text on computer has become very easy. A number of methods exist for this purpose, but the main ones are:-

InScript
Main article: InScript Typing

Inscript is the standard keyboard for Indian languages. Developed by C-DAC and standardized by Government of India. Nowadays it comes inbuilt in all major operating systems including Microsoft Windows (2000, XP, Vista, 7), Linux and Macintosh.

Phonetic transliteration

This is a typing method in which, for instance, the user types text in an Indian language using Roman characters and it is phonetically converted to equivalent text in Indian script in real time. This type of conversion is done by phonetic text editors, word processors and software plugins. Building up on the idea, one can use phonetic IME tools that allow Indic text to be input in any application.

Some examples of phonetic transliterators are Xlit, Google Indic Transliteration, BarahaIME, Indic IME, Rupantar, SMC's Indic Keyboard and Microsoft Indic Language Input Tool. SMC's Indic Keyboard has support for as many as 23 languages whereas Google Indic Keyboard only supports 11 Indian languages.[10]

They can be broadly classified as:

  • Fixed transliteration scheme based tools – They work using a fixed transliteration scheme to convert text. Some examples are Indic IME, Rupantar and BarahaIME.
  • Intelligent/Learning based transliteration tools – They compare the word with a dictionary and then convert it to the equivalent words in the target language. Some of the popular ones are Google Indic Transliteration, Xlit, Microsoft Indic Language Input Tool and QuillPad.

Remington (typewriter)

This layout was developed when computers had not been invented or deployed with Indic languages, and typewriters were the only means to type text in Indic scripts. Since typewriters were mechanical and could not include a script processor engine, each character had to be placed on the keyboard separately, which resulted in a very complex and difficult to learn keyboard layout.

With the advent of Unicode, the Remington layout was added to various typing tools for sake of backward compatibility, so that old typists did not have to learn a new keyboard layout. Nowadays this layout is only used by old typists who are used to this layout due to several years of usage. One tool to include Remington layout is Indic IME. A font that is based on the Remington keyboard layout is Kruti Dev. Another online tool that very closely supports the old Remington keyboard layout using Kruti Dev is the Remington Typing tool.

Braille
Main article: Bharati Braille

IBus Sharada Braille, which supports seven Indian languages was developed by SMC.[10]

Mobile phones with Numeric keyboards
Nokia 1108 Hindi

Mobile/Hand/cell phone basic models have 12 keys like the plain old telephone keypad. Each key is mapped to 3 or 4 English letters to facilitate data entry in English. For inputting Indian languages with this kind of keypad, there are two ways to do so. First is the Multi-tap Method and second uses visual help from the screen like Panini Keypad. The primary usage is SMS. 140 characters size used for English/Roman languages can be used to accommodate only about 70 language characters when Unicode[11] Proprietary compression is used some times to increase the size of single message for Complex script languages like Hindi. A research study[12] of the available methods and recommendations of proposed standard was released by Broadband Wireless Consortium of India (BWCI).

Transliteration/Phonetic methods

English is used to type in Indian languages. QuillPad[13] IndiSMS[14]

Native methods

In native methods, the letters of the language are displayed on the screen corresponding to the numeral keys based on the probabilities of those letters for that language. Additional letters can be accessed by using a special key. When a word is partially typed, options are presented from which the user can make a selection.[15]

Smart phones with Qwerty keyboards

Most smart phones have about 35 keys catering primarily to English language. Numerals and some symbols are accessed with a special key called Alt. Indic input methods are yet to evolve for these types of phones, as support of Unicode for rendering is not widely available.

For Smart Phones with Soft/Virtual keyboards

Inscript is being adopted for smart phone usage. For Android phones which can render Indic languages, Swalekh Multilingual Keypad[16] Multiling Keyboard app[17][18] are available. Gboard offers support for several Indian languages.[19]

Localization
Main article: Internationalization and localization

Localization means translating software, operating systems, websites etc. various applications in Indian language. Various volunteers groups are working in this direction.

Mandrake Tamil Version

A notable example is the Tamil version of Mandrake linux. Tamil speakers in Toronto (Canada) released Mandrake, a GNU/Linux software, in coming out with a Tamil version.[20] It can be noted that all the features can be accessed in Tamil. By this, the prerequisite of English knowledge for using computers has been eliminated, for those who know Tamil.

IndLinux

IndLinux is a volunteer group aiming to translate the Linux operating system into Indian languages. By the efforts of this group, Linux has been localized almost completely in Hindi and other Indian languages.

Nipun

Nipun is an online translation system aimed to translate various application in Hindi. It is part of Akshargram Network.

Localising Websites

GoDaddy has localised its website in Hindi, Marathi and Tamil and also noted that 40% of the call volume for IVR is in Indian Languages.[21]

Indic blogging

Indic blogging refers to blogging in Indic languages. Various efforts have been done to promote blogging in Indian languages.

Social Networks

Some Social networks are started in Indian languages.[22]

Programming

Indic programming languages

Frameworks

Gherkin, a popular Domain-specific language has support for Gujarati, Hindi, Kannada, Punjabi, Tamil, Telugu and Urdu[23]

Libraries

Natural Language processing in Indian languages is on rise. There are several libraries such as iNLTK, StanfordNLP are available.[24]

Translation

Google offers improved translation feature for Hindi, Bengali, Marathi, Tamil, Telugu, Gujarati, Punjabi, Malayalam and Kannada,[19] with offline support as well.[25] Microsoft also offers translation for some of these languages.

Software

Indic Language Stack

In a symposium jointly organized by FICCI and TDIL, Mr. Ajay Prakash Sawhney, Secretary, Ministry of Electronics and IT, Government of India said that India Language Stack can help overcome the barriers of communication.[26] It should include various software technologies needed for Conversational AI in Indic languages and offer layers of suitable entry points to build applications.[27]

Transliteration tools

Transliteration tools allow users to read a text in a different script. As of now, Aksharamukha is the tool that allows most Indian scripts. Google also offers Indic Transliteration. Text from any of these scripts can be converted to any other scripts and vice versa. Whereas Google and Microsoft allow transliteration from Latin letters to Indic scripts.

Text-to-Speech

Carnegie Mellon University, in collaboration with the Hear2Read project, has developed a text-to-speech (TTS) software that helps the visually impaired listen to text in native Indian languages. Currently, Tamil is being offered and, releases in Hindi, Bengali, Gujarati, Marathi, Kannada, Punjabi and Telugu are expected over the remainder of 2016.[28]

Internationalized Domain Names
Main article: .in § Internationalised_domain_names_and_country_codes

Operating Systems

Email

Microsoft Inc. supports Hindi, Bengali and Tamil email addresses. It is expected to include other Indian languages in future.

Virtual Assistants

AI based Virtual Assistants Google Assistant provides support to various Indian languages.

Usage and Growth

According to GoDaddy, Hindi, Marathi and Tamil languages accounted for 61% of India's internet traffic.[21] Less than 1% of online content is in Indian languages. The newly created top apps have support for multiple Indian languages and/or promote Indian language content. 61% of the Indian users of WhatsApp primarily use their native languages to communicate with it.[29] A recent study revealed that adoption of Internet is highest among local languages such as Tamil, Hindi, Kannada, Bengali, Marathi, Telugu, Gujarati and Malayalam. It estimates that Marathi, Bengali, Tamil, and Telugu will form 30% of the total local-language user base in the country. Currently, Tamil at 42% has the highest Internet adoption levels, followed by Hindi at 39% and Kannada at 37%.[30] Intex also reported that 87% of its regional language usage came from Hindi, Bengali, Tamil, Gujarati and Marathi speakers.[6] Lava mobiles reported that Tamil and Malayalam are the most popular on their phones, more than even Hindi.[6]

See also

References
  1. Unicode 10.0
  2. Unicode 8.0
  3. Unicode 7.0
  4. Unicode 4.1
  5. Deadline for making handsets Indic language capable extended till 1 October 2017
  6. Centre’s push for regional language support paying off – The Hindu Business Line
  7. "TDIL: Technology Development for Indian Languages Programme, India". Archived from the original on 23 March 2015. Retrieved 28 March 2015.
  8. "BharateeyaOOo". Retrieved 28 March 2015.
  9. "Archive of Ankur Home". Ankur group, Bengalinux.org group. Archived from the original on 29 May 2005. Retrieved 26 December 2015.
  10. Helping Malayalam Take the Digital Leap – The New Indian Express
  11. "Quillpad Mobile – FAQs". Archived from the original on 2 April 2015. Retrieved 28 March 2015.
  12. "SIG Report on Indian Language SMS, Nov 2010" (PDF). Archived from the original (PDF) on 2 April 2015. Retrieved 11 November 2011.
  13. "Quillpad Mobile – Hindi SMS application for your mobile phone". Archived from the original on 2 April 2015. Retrieved 28 March 2015.
  14. "Eterno Infotech". Archived from the original on 28 March 2015. Retrieved 28 March 2015.
  15. "Keypad for mobile-Keyboard for mobile-Keyboard for typing on mobile-Keypad for typing on mobile". Retrieved 28 March 2015.
  16. This Bengaluru-Based Startup Believes It Has Built a Smarter Indic Keyboard – NDTV
  17. Honso. "MultiLing Keyboard – Android Apps on Google Play". Retrieved 28 March 2015.
  18. Honso. "Plugin Hindi हिन्दी – Android Apps on Google Play". Retrieved 28 March 2015.
  19. Google Translate for 9 Indian languages, 11 more get keyboard support – Live Mint
  20. Frederick Noronha. "Indian-language computing: The long road ahead – Features – Technology". Infochange India. Retrieved 28 March 2015.
  21. GoDaddy launches services in Hindi, Marathi and Tamil – EconomicTimes.com
  22. Google and Facebook’s attention to India might speed up Indic computing – Live Mint
  23. Gherkin Language reference
  24. TOP NLP LIBRARIES & DATASETS FOR INDIAN LANGUAGES - Analytics India Mag
  25. Google will let you translate to 7 Indian languages – Deccan Chronicle
  26. Sawhney, Shri. Ajay Prakash (30 July 2018). "India Language Stack needed to overcome the barriers of communication: IT Secretary". Press Information Bureau GoI. Retrieved 27 September 2020.
  27. A case for Bhārat Bhāṣā Stack - Indic language tech ecosystem for Voice Assistant and Conversational AI innovations
  28. University, Carnegie Mellon (3 August 2016). "Android App Lets Visually Impaired in India Listen to Texts in Native Languages-CMU News". Carnegie Mellon University. Retrieved 23 August 2016.
  29. We haven’t yet built the Indian internet!
  30. No English Only Vinglish: 90% New Internet Users Coming Online In India Are Non-English Speakers
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.