Centre for Internet and Society

Odia Wikipedia Turning 13 this June 3

subha — 2016-06-18T18:19:22Z

The Odia Wikipedia is turning 13 this June 3. To celebrate this long time of the editor community's tireless effort to make it to the largest Odia-language online encyclopedia an event is being organised in Odisha' capital Bhubaneswar. Centre for Internet and Society's Access To Knowledge (CIS-A2K) is proudly sponsoring for this event. Subhashish Panigrahi and Rahmanuddin Shaik are representing CIS at this event.

Over 20 Wikipedians from various corners of India are participating for a public gathering that is planned on June 3 at the Institute of Physics at 5 pm. A day-long internal meetup for the community in the presence of Wikimedia India and CIS-A2K has been planned that focuses on raising consensus for policy and guidelines for Odia Wikipedia, and planning for the activities ahead in the light of successes and learning from failures from the past.

Promotional Banner

For more details visit http://editors.cis-india.org/openness/events/odia-wikipedia-turning-thirteen

Odia Wikipedia Set to Celebrate 13 Years of Volunteer Contributions

subha — 2015-08-22T16:54:53Z

Odia Wikipedia, one of the first of several Indian language Wikipedia projects, is ready to celebrate 13 glorious years of free knowledge contribution on June 3.

Read the original post published by Global Voices on May 31, 2015 here. For event details click here: https://or.wikipedia.org/s/sml

Beginning in 2002 — a year after the world's largest online encyclopedia, the English Wikipedia, was launched — Odia Wikipedia has grown to be the largest content repository in the Odia language available in Unicode* on the Internet.

With about 17 active editors (also known as “uikiali”) spread across various parts of India and abroad, and over 8,800 articles, the project has become more than just an encyclopedia. The voluntary editor community has put its efforts into acquiring valuable Creative Commons (CC) licensed content by lobbying copyright holders/authors to relicense copyrighted content under CC licenses.

It has also engaged with over 2,000 people by organizing various outreach programs including the globally accredited pedagogic program the Wikipedia Education Program (WEP).

For its 13th anniversary the community is planning to release a character-encoding converter that promises to unlock massive amounts of content from government portals as well as journals, newspapers and magazines that have their content in non-Unicode character encoding that prevents user searching and reuse of digital-based content.

Odia language is spoken by more than 40 million people in the Indian state of Odisha (the 9 ^th largest Indian state by territory), its neighboring states and the Odia diaspora living outside India.

With over 5,000 years of literary heritage, it has been recognized as one of the oldest South Asian languages and has been given the status of a “classical language” by the Indian government.

However, the language has not gathered as much traction in terms of online presence as it might have.

Almost all the online newspapers in Odia are available either in non-Unicode and proprietary encoding systems, or as images. This makes them completely invisible as far as a search engine is concerned.

The same goes for the state government's official portals that either lack Odia-language content or have content in legacy encoding systems. To address these issues, a bunch of character encoding converters that convert text typed using various non-Unicode encoding systems to Unicode are incorporated on Odia Wikipedia.

With this new tool, the community aims at a mass conversion of content from all available sources — from newspapers and magazines to government journals and portals — into Unicode, so this content can be used in order to enrich Odia Wikipedia and generally improve the language's reach online.

Odia Wikipedia was not content-rich until the beginning of 2011, when editor activity began to pick up.

Since then it has expanded its content massively, with topics ranging from the essentials of medical science to the cuisine of Odisha.

The growth in readership of the project is a great example of how content is driving the internet. A project that was virtually unknown a few years back with monthly page views in the low thousands recorded 8,08,834 page views in March 2015 alone.

The Wikimedia community is gathering in Odisha's capital Bhubaneswar this June 3 to celebrate Odia Wikipedia becoming a teenager.

For more details visit http://editors.cis-india.org/openness/blog-old/global-voices-may-31-2015-subhashish-panigrahi-odia-wikipedia-set-to-celebrate-13-years-of-volunteer-contributions

Odia Wikipedia Gets a New Typing Solution!

subha — 2012-12-12T12:28:57Z

Subhashish Panigrahi worked with Yuvi Panda to create a new typing scheme for Odia Wikipedia and other Wikimedia projects. This blog post gives a summary of this development and its outcome.


Odia Lekhani Phonetic Keyboard Layout

A new typing scheme Lekhani (Odia for a stylus which was used for writing on palm leaves) to be used for Odia Wikipedia, other sister Wikimedia projects and for offline and typing using mobile devices was researched upon.

Indian languagFedora's Phonetic Keyboard Layoutes use various typing schemes (key combinations for output in Indic languages) which could be used for writing, printing, publishing and for any other purpose both for offline and online publication as well as printing. Development for Unicode standard in Odia language progressed lately. Revival of Odia Wikipedia after 2011 helped the use of unicode more on internet because of its extensive content (more than 3100 articles on various topics) and online activities on social media. Currently there are over different typing schemes available for Odia including the non-unicode typing schemes used mostly by the DTP operators and many newspapers and publication houses. One of the earliest development was the Inscript keyboard layout which follows a global standard for most Indic languages. Inscript is useful and once someone gets his fingers used to typing it is fun. But, most of the beginners find it difficult to type in Inscript. In those cases phonetic keyboards are quite helpful where someone need to press the English keys which corresponds to the Roman characters, e.g. R-a-d-h-aa for "Radha". Based on these sort of logics a keyboard layout was deployed for all the Indic languages on Narayam including Odia. (See Odia transliteration for details). The primary developer for transliteration was Junaid PV, a Malayalam Wikipedian who helped for the Indic languages and few other Asian languages. As transliteration follows more a common rule there are many ambiguities and bugs reported after it was deployed on Odia Wikipedia. Even though many rounds of changes there are still bugs which doesn't allow many editors to type accurately. This is one of the reasons when there was a need for a purely phonetic typing scheme which has more affinity to the way an Odia user would type the words using a Roman key board.

The idea for deploying a new phonetic typing scheme was started during Mumbai Hackathon in 2011. Subhashish brought the proposal in community village pump for ideas and consensus and the basic layout and testing was done. The whole project went into a slumber for a long time! Recently when YuviPanda was in Delhi and met Subhashish the idea of hacking and testing the tool came again. The whole keyboard layout was revised and deployed on github. Two main keyboard layouts which were used for keeping the major inputs as standard were Fedora Phonetic keyboard and Apple Oriya Qwerty.


Fedora's Phonetic Keyboard Layout


Apple QWERTY Keyboard

Majority of the key combinations have been kept same except for few small changes. The typing scheme is deployed on TranslateWiki.net for Universal Language Selector and gerrit which will be enabled on Odia Wikipedia soon for Narayam. The recent mobile typing tool, "Indic typing tool" which was developed at Delhi office of the Centre for Internet and Society by Yuvi Panda and Subhashish Panigrahi also uses Lekhani as a default typing tool.

Quick links:

Lekhani typing scheme for Odia
Source file: https://github.com/wikimedia/jquery.ime/blob/master/rules/or/or-lekhani.js
Check the github page for other Odia typing tools and here for all other languages
Typing in Lekhani using mobile phone

Credits:

Odia Lekhani Phonetic Keyboard Layout (CC-BY-SA 3.0): Manoranjan Behera
Fedora's Phonetic Keyboard Layout: RedHat
Apple QWERTY Keyboard: Apple Inc.

For more details visit http://editors.cis-india.org/openness/blog-old/odia-wikipedia-gets-new-typing-solution

Odia Wikipedia Community Brings Wikipedia Education Program to IIMC, Dhenkanal

subha — 2013-08-23T14:01:17Z

The Odia Wikipedia community collaborated with the Indian Institute of Mass Communication, Dhenkanal and hosted a pilot Odia Wikipedia Education Program. The program began in November 2012 and got over by January 2013. Sixteen student wikipedians signed up and took part in editing more than a dozen articles on Odia Wikipedia.

Odia Wikimedia community is primarily active in three major cities: Bhubaneswar, Cuttack and Nalconagar. There was a sustained growth in the community during August-October 2012 which inspired the comunity to initiate a long term program like Wikipedia Education Program. Mrutyunjaya Kar from Nalconagar community reached out to several schools in Nalconagar and Phulbani to find a potential institute for such a program. Subhashish from Access To Knowledge team of CIS supported the community for setting up a meeting with Prof. Mrinal Chatterjee and few other faculty members of Indian Institute of Mass Communication, Dhenkanal followed by a workshop for the students.

More than 45 students from both Odia and English department took part for the first introductory workshop. A program page was created on Odia Wikipedia for the detailed plan and discussion. 16 out of 45 students showed their interest to take part in the program and signed up on the project page. Teaching assistants Bhagaban and Sucharita supported the students in assessing and suggesting articles. A follow up session was organized in December by the Nalconagar Wiki-Community to teach the students about the typing and basic Wikipedia editing. Students continued to edit their chosen articles. Though initially the program was planned to be run for 3-4 months because of the course structure and exam announcement students requested for the closure of it.

The articles were assessed and wiki-fied by the wikipedians. On January, 26 a celebratory event was organized for the student-wikipedians. Prof. Chatterjee addressed the students about the benefits of contributing to Wikipedia in their mother tongue Odia. Subhashish along with fellow Wikipedians Dr. Subas Rout, Mrutyunjaya Kar, Srikant Kedia and Manoranjan Behera took part in a discussion about “What students can gain by contributing to Odia Wikipedia”.

Contribution details:

Number of student participants for introductory session: 45

Number of students took part in the Wikipedia workshop: 16
Number of students contributed: 12

Number of mentor wikipedians: 4

Number of articles edited: 12

Other details:

More details on Project page.

Photos, meeting podcasts and videos: http://bit.ly/YymQkn

Podcast of discussion among Odia Wikipedians with Prof. Mrinal Chatterjee and Subhashish Panigrahi

For more details visit http://editors.cis-india.org/openness/blog-old/odia-wikipedia-education-program-iimc-dhenkanal

Odia Wikipedia Celebrates 13 Years of Free Knowledge Contribution at Bhubaneswar

subha — 2016-06-18T18:21:13Z

The event was held at the Institute of Physics, Near Apollo Hospital, Bhubaneswar, Odisha on June 3, 2015, at 5 p.m.

The article was published by FullOdisha.com on June 3, 2015.

For more details visit http://editors.cis-india.org/openness/news/fullodisha-june-3-2015-odia-wikipedia-13-years-of-free-knowledge-contribution

Odia Wikipedia - Cuttack Community Meetup (March 16, 2013)

subha — 2013-07-17T06:40:11Z

A meetup of Odia wikipedians was organised by the Access to Knowledge team of the Centre for Internet and Society and the Odia wikipedia community on March 16, 2013. Vishnu Vardhan and Subhashish Panigrahi participated in the meetup.


Participants from the Wikipedia meetup held on March 16, 2013

Recently Centre for Internet and Society's Access To Knowledge Programme members T. Vishnu Vardhan and Subhashish Panigrahi met Odia Wikipedians in Cuttack to discuss about the current state of Odia Wikipedia and understand the community building strategies. Five active wikipedians from Cuttack and one from Bhubaneswar joined and discussed about various challenges the community is facing. New project ideas were discussed. Wikipedians also shared their stories and motivation. A new project on articles about the Villages, Pachayats, Blocks of Odisha was decided to be rolled as a key project on this day.

For more details visit http://editors.cis-india.org/openness/blog-old/odia-wikipedia-cuttack-community-meetup-march-16-2013

Odia Wikipedia - Bhubaneswar Community Meetup (March 17, 2013)

subha — 2013-04-30T03:52:05Z

The Access to Knowledge team from the Centre for Internet and Society and the Odia Wikipedia community held a meetup in Bhubaneswar on March 17, 2013. Vishnu Vardhan and Subhashish Panigrahi participated in this meet-up.


A picture of Wikipedians from the Bhubaneswar meetup held on March 17, 2013

The aim of this meetup was to discuss the current state of Odia Wikipedia and understand the community building strategies for this year. Wikipedians shared their motivation and experience for editing Wikipedia. Challenges, plans and new project ideas were discussed. A new project on articles about the Villages, Pachayats, Blocks of Odisha was decided to be rolled as a key project by the community. This would be useful to generate large volume of useful content on places of Odisha and involve new wikipedians from various places to contribute to articles of the their places.

For more details visit http://editors.cis-india.org/openness/blog-old/odia-wikipedia-meet-up-bhubaneswar-march-17-2013

Odia Littérateur Ramakrushna Nanda's 4 Books Now Available Under a Creative Commons License

subha — 2014-11-06T13:41:49Z

Children literature in Odia language went through an ennoblement after the intervention of Ramakrushna Nanda's writings.

His poetry “Ahe Dayamaya Biswa Bihari” has been sung in every school in Odisha. His work around Odia poetry, language and grammar, essays and encyclopaedia have been greatest resources for children for quite a few decades. CIS-A2K is honored to now bring four of his books under Creative Commons Share Alike (CC-by-SA 4.0) license:

Biswa Parihay (Encyclopaedia)
Lekhanira Pathasala (Grammar)
Bhabi Dekhantu (Compilation of essays)
Pausa Sandhyara Gapa (Compilation of stories)

The larger plans after this is to bring these books online on Odia Wikisource by scanning and digitizing them.

Video

Ramakrushna Nanda's son Prabhat Kumar Nanda and daughter-in-law Anasuya Nanda, speak about the journey of the children's magazine the “Sansar” and way forward for Odia Wikisource for today's generation.

For more details visit http://editors.cis-india.org/openness/blog-old/ramakrushna-nanda-four-books-under-cc-license

Odia Language's Presence in Digital Media and Wikipedia's Role

subha — 2014-03-05T11:36:46Z

କମ୍ପ୍ୟୁଟରରେ ଓଡ଼ିଆ ଭାଷା (Odia language in computer) is an essay published in Odia newspaper "The Samaja's Sunday supplement" on March 2. It is about the journey of Odia language in the digital era and the challenges faced during digitization of books and manuscripts.

It also focusses on the new technological advancements that allow users to interact and share knowledge on the internet in Odia language. It briefly explains about Odia Wikipedia, an online encyclopedia that is written by voluntary editors and the massive knowledge production by opening up platforms like these that allows real-time collaboration for editorship in regional languages.

A scanned version of the article is reproduced below. A higher resolution of this article could be read in The Samaja e-Paper.

For more details visit http://editors.cis-india.org/openness/blog-old/the-samaja-subhashish-panigrahi-march-2-2014-odia-language-presence-in-digital-media

Odia Language Wikipedia Page Grows to 800K Page Views A Month

subha — 2016-06-18T18:20:05Z

Odia Wikipedia is one of the first few Indian language Wikipedia projects celebrating such an old age. The Wikimedia community will gather in Odisha's capital of Bhubaneswar on June 3 to celebrate Odia Wikipedia's 13th anniversary.

Get more event details. Click to read the post originally published in Opensource.com on May 31.

The Odia language is spoken by more than 40 million people in the Indian state of Odisha (the 9th largest Indian state by area) and its neighboring states, as well as, the Odia diaspora living outside India. With over 5000 years of literary heritage, the Odia language has been recognized as one of the oldest South Asian languages and has been given the status of a "classical language" by the Indian government.

Odia Wikipedia was launched in 2002—a year after the world's largest online encyclopedia, the English Wikipedia—and has grown to be the largest online content repository for the Odia language in Unicode, and is also the largest online Odia encyclopedia. Odia Wikipedia has 17 active editors (known as uikiali) spread across various parts of India and abroad, and over 8,800 articles. The Odia Wikipedia community is driving progressive digital activities by converting content created with non-standard proprietary encoding systems into Unicode, optimizing the system for search engines, and relicensing copyrighted content into Creative Commons (CC) licenses.

Almost all the newspapers written in the Odia language are available in non-Unicode or other proprietary encoding systems, or as images, making it impossible to account for them in search. The same is the case for state government portals that lack Odia-language content or have content in legacy encoding systems. Today, character encoding converters are hosted on Odia Wikipedia so that the editors can convert other encoding to Unicode; making newspapers and magazines that were unaccessible because of inability to search non-Unicode content available.

Odia Wikipedia has been available in Unicode since 2002, but for nine years it was dormant. Content creation and editor activity began to pick up in 2011 and since has increased at a dramatic rate. Content now covers diverse topics, from medical science to Odia cuisine. Since, it has grown to over 808,834 page views as of March 2015.

Original photo by Subhashish Panigrahi. CC BY-SA 4.0

The Odia Wikimedia community has also organized Wikipedia workshops and Wikipedia Education Programs to relicense copyright encyclopedia content to CC licensed content by negotiating with authors and copyright holders, and by gathering resources from various sources that are were easily accessible.

Going forward we hope to make an impact on the areas slow to change, like the media for the Odia language who have resisted adopting Unicode.

The Odia Wikipedia community hopes to improve and increase the use of the Odia languague online so that users can read and communicate on the Internet in that language. An open and collaborative tool like Odia Wikipedia is a promising avenue for this challenge because it allows anyone to contribute to writing, editing and enriching articles.

For more details visit http://editors.cis-india.org/openness/blog-old/opensource-subhashish-panigrahi-may-31-2015-odia-language-wikipedia-page-grows-to-800k-page-views-a-month

Odia Language gets a new Unicode Font Converter

subha — 2014-07-02T09:59:31Z

Recently, I worked on designing a font encoding converter with a fellow Wikimedian Manoj Sahukar. We worked by taking the code of a converter that was made three years back and made it work for two fonts AkrutiOriSarala99 and AkrutiOriSarala that are used by the media industry for printing and publishing.

This converter can now convert text typed using a modified ISCII based encoding and help generating Unicode text. Based on this learning from this I created another such converter for one such popular font Shreelipi that is used by Government of Odisha's official documentation including a magazine. The following is a summary of the usability of the converters:

It’s been over a decade since Unicode standard was made available for Odia script. Odia is a language spoken by roughly 33 million people in Eastern India, and is one of the many official languages of India. Since its release, it has been challenging to get more content on Unicode, the reason being many who are used to other non-Unicode standards are not willing to make the move to Unicode. This created the need for a simple converter that could convert text once typed in various non-Unicode fonts to Unicode. This could enrich Wikipedia and other Wikimedia projects by converting previously typed content and making it more widely available on the internet. The Odia language recently got such a converter, making it possible to convert two of the most popular fonts among media professionals (AkrutiOriSarala99 and AkrutiOriSarala) into Unicode.

All of the non-Latin scripts came under one umbrella after the rollout of Unicode. Since then, many Unicode compliant fonts have been designed and the open source community has put forth effort to produce good quality fonts. Though contribution to Unicode compliant portals like Wikipedia increased, the publication and printing industries in India were still stuck with the pre-existing ASCII and ISCII standards (Indian font encoding standard based on ASCII). Modified ASCII fonts that were used as typesets for newspapers, books, magazines and other printed documents still exist in these industries. This created a massive amount of content that is not searchable or reproducible because it is not Unicode compliant. The difference in Unicode font is the existence of separate glyphs for the Indic script characters along with the Latin glyphs that are actually replaced by the Indic characters. So, when someone does not have a particular ASCII standard font installed, the typed text looks absurd (see Mojibake), however text typed using one Unicode font could be read using another Unicode font in a different operating system. Most of the ASCII fonts that are used for typing Indic languages are proprietary and many individuals/organizations even use pirated software and fonts. Having massive amounts of content available in multiple standards and little content in Unicode created a large gap for many languages including Odia. Until all of this content gets converted to Unicode to make it searchable, sharable and reusable, then the knowledge base created will remain inaccessible. Some of the Indic languages fortunately have more and more contributors creating Unicode content. There is a need to work on technological development to convert non-Unicode content to Unicode and open it up for people to use.

There are a few different kinds of fonts used by media and publication houses, the most popular one is Akruti. Two other popular standards are LeapOffice and Shreelipi. Akruti software comes bundled with a variety of typefaces and an encoding engine that works well in Adobe Acrobat Creator, the most popular DTP software package. Industry professionals are comfortable using it for its reputation and seamless printing. The problem of migrating content from other standards to Unicode arose when the Odia Wikimedia community started reaching out to these industry professionals. Apparently authors, government employees and other professional were more comfortable using one of the standards mentioned above. All of these people type using either a generic popular standard, Modular, or a universal standard, Inscript. Fortunately, the former is now incorporated into Mediawiki‘s Universal Language Selector (ULS) and the latter is in the process of getting added to ULS. Once this is done, many folks could start contributing to Wikipedia easily. Content that has been typed in various modified ASCII fonts include encyclopedias that could help grow content on Wikisource and Wikiquote. All of these need to be converted to Unicode. The non-profit group Srujanika first initiated a project to build a converter for conversion of two different Akruti fonts: AkrutiOriSarala99 and OR-TT Sarala. The former being outdated and the other being less popular. The Rebati 1 converter which was built by the Srujanika team was not being maintained and was more of an orphan project.
Above: Akruti Sarala - Unicode Odia converter user manual. Image credit: Subhashish Panigrahi, CC-BY-3.0

There are a few different kinds of fonts used by media and publication houses, the most popular one is Akruti. Two other popular standards are LeapOffice and Shreelipi. Akruti software comes bundled with a variety of typefaces and an encoding engine that works well in Adobe Acrobat Creator, the most popular DTP software package. Industry professionals are comfortable using it for its reputation and seamless printing. The problem of migrating content from other standards to Unicode arose when the Odia Wikimedia community started reaching out to these industry professionals. Apparently authors, government employees and other professional were more comfortable using one of the standards mentioned above. All of these people type using either a generic popular standard, Modular, or a universal standard, Inscript. Fortunately, the former is now incorporated into Mediawiki‘s Universal Language Selector (ULS) and the latter is in the process of getting added to ULS. Once this is done, many folks could start contributing to Wikipedia easily.

Content that has been typed in various modified ASCII fonts include encyclopedias that could help grow content on Wikisource and Wikiquote. All of these need to be converted to Unicode. The non-profit group Srujanika first initiated a project to build a converter for conversion of two different Akruti fonts: AkrutiOriSarala99 and OR-TT Sarala. The former being outdated and the other being less popular. The Rebati 1 converter which was built by the Srujanika team was not being maintained and was more of an orphan project.

Above: Akruti Sarala - Unicode Odia converter user manual. Image credit: Subhashish Panigrahi, CC-BY-3.0

Fellow Wikimedian Manoj Sahukar and myself used parts of the “Rebati 1 converter” code and worked on building another converter. The new “Akruti Sarala – Unicode Odia converter” can convert the more popular AkrutiOriSarala font and its predecessor AkrutiOriSarala99, which is still used by some. Odia Wikimedian Mrutyunjaya Kar and journalist Subhransu Panda have helped by reporting broken conjuncts which helps in fixing all problems before publishing. Odia authors and journalists have already started using the font and many of them have regular posts in Odia. We are waiting for more authors to contribute to Wikipedia by converting their work and wikifying it.

Recently a beta version of another Unicode font converter for Shreelipi fonts based on Odia Wikipedian Shitikantha Dash‘s initial code is released. It works with at least 85 % accuracy.

"Even after getting the classical status, Odia language is not being used actively on the internet like some other Indian languages. The main reason behind this is our writing system has not been web-friendly. Most of those in Odisha having typing skills, use modular keyboard and Akruti fonts. Akruti is not web-compatible as we know. There are thousands of articles, literary works, news stories typed in Akruti fonts lying unused (on the internet). Thanks to Subhashish Panigrahi and his associates, they have developed this new font converter that can convert your Akruti text into Unicode. I have checked it. It’s error-free. Now it’s easy for us to write articles online (for Wikipedia and other sites). Yes, we are late entrants as far as use of vernacular languages on the internet is concerned. But this converter will help us to go godspeed. Lets make Odia our language of communication and expression."

The above was originally posted on Wikimedia blog.

Quick Links

Copyright notes: "Akruti Sarala - Unicode converter screenshot mock-up.svg", "Akruti converter user manual (white).svg" by Subhashish Panigrahi , under CC-BY-SA 3.0 Unported, from Wikimedia Commons

For more details visit http://editors.cis-india.org/openness/blog-old/odia-language-gets-new-unicode-font-converter

Odia author Nirmala Kumari Mohapatra's 21 books relicensed under CC-by-SA 4.0

subha — 2014-12-06T02:49:12Z

Twenty one books of renowned Odia author Nirmala Kumari Mohapatra will now be available under the Creative Commons License.

Taking into consideration the request from the Centre for Internet and Society's Access to Knowledge team (CIS-A2K), Odia researcher, teacher and author Nirmala Kumari Mohapatra has signed a note to release 21 of her books under CC-by-SA 4.0 license. She came and attended the "Odisha Dibasa 2014" organized by Odia Wikimedia Community and CIS-A2K on March 29 in Bhubaneswar where we got 11 books of Dr. Jagannath Mohanty. Expressing her motivation for kindheartedly donating 21 out of her 35 books she tells us, "If Jagannath Mohanty's writings could go to millions of readers online why not I also open up my work. My life as a teacher has spent on researching on simplifying education. One of the 21 books she donated "Chandaka-Damapada Hasti Abhayaranya", is one of the rarest books that has ever been written on wildlife sanctuary. It is full of many observations about the elephants that reside in the Chandaka-Damapada wildlife sanctuary. Many interesting incidents from Odisha's history like a female barber shaving Gandhi during his Padayatra that are captured in her books would add to the richness of Odia Wikipedia. These books will soon be available on Odia Wikisource for digitization.

For more details visit http://editors.cis-india.org/openness/blog-old/odia-author-nirmala-kumari-mohapatra-21-books-under-cc

OCR and OER – update

subha — 2016-06-18T17:09:22Z

We welcome this short posting from Subhashish Panigrahi which updates a 2014 posting of his on Indic Language Wikipedias as Open Educational Resources at http://education.okfn.org/indic-language-wikipedias-as-open-educational-resources/

To read the blog post published by Open Education Working Group, see here.

Subhashish Panigrahi (@subhapa) is an educator, author, blogger, Wikimedian, language activist and free knowledge evangelist based in Bengaluru (often called Bangalore), India. After working for a while at the Wikimedia Foundation’s India Program he is currently at the Centre for Internet and Society‘s Access To Knowledge program. He works primarily in building partnership with universities, language research and GLAM (Gallery, Library, Archive and Museums) organizations for bringing more scholarly and encyclopedic content under free licenses, designs outreach programs for South Asian language Wikipedia/Wikimedia projects and communities. He wears many other hats: Editor for Global Voices Odia, Community Moderator of Opensource.com, and Ambassador for India in OpenGLAM Local. Subhashish is the author of a piece “Rising Voices: Indigenous language Digital Activism” in the book Digital Activism in Asia Reader.

Google’s OCR and its use by Wikimedians in South Asia

Some time back on the OCR project support network, Google had announced that the Google drive could be used for Optical Character Recognition (OCR). The software now works for over 248 world languages (including all the major South Asian languages). Though the exact pattern of development of the software is not clear, some of the Wikimedians reported that there is improvement over time in the recognition of their native languages Malayalam and Tamil. The recent encounter has been with a simple, easy to to use and robust software that can detect most languages with over 90% accuracy.

The OCR technology extracts text from images, scans of printed text, and even handwriting to some extent, which means that the text can be extracted pretty much from any old book, manuscript, or image. This certainly brings hope to most Indian languages as there is a lot to digitize. Most of the major Indian languages have plenty of non-digitized literature and the existing OCR systems are not as good as Google when so many languages are concerned as a whole.

Google’s OCR engine is probably using aspects of Tesseract, an OCR engine released as free software, or OCRopus, a free document analysis and optical character recognition (OCR) system that is primarily used in Google Books. Developed as a community project during 1995-2006 and later taken over by Google, Tesseract is considered one of the most accurate OCR engines and works for over 60 languages. The source code is available on GitHub.

The OCR project support page offers additional details on preserving character formatting for things like bold and italics after OCR in the output text.

When processing your document, we attempt to preserve basic text formatting such as bold and italic text, font size and type, and line breaks. However, detecting these elements is difficult and we may not always succeed. Other text formatting and structuring elements such as bulleted and numbered lists, tables, text columns, and footnotes or endnotes are likely to get lost.

The user-end interaction of the OCR software currently is rather simple. The user has to upload an image of the scan in any image format (.jpg, .png, .gif, etc.) or PDF to the Google Drive. Upon completion of the uploading, opening the file in Google Drive shows both the image and the converted text in the same document.

One of the most popular free and open digitization platforms, Wikisource currently hosts hundreds or thousands of free books which are either out of copyright or under Creative Commons licenses (CC-by or CC-by-SA) allowing users to digitize.

While OCR works quite well for Latin based languages, many other scripts do not get OCRed perfectly. So, the Wikisourcers (Wikisource contributors) often have to type the text.

Thus the new Google OCR might be useful both for the Wikisource community and many others who are in the mission of digitizing old text and archiving them.

The image below shows a screen from a tutorial to convert text in the Odia language from a scanned image using Google’s OCR.

For more details visit http://editors.cis-india.org/a2k/blogs/education-okfn-subhashish-panigrahi-september-25-2015-ocr-and-oer-update

Non Unicode ISCII Text Can be Converted to Unicode Now!

subha — 2012-12-21T09:59:18Z

Odia Wikipedian Manoj Sahukar has designed a new tool which can convert non Unicode ISCII text to Odia Unicode text. A majority of the digitized text and web content of newspapers and books are in non unicode text which now could be used for Wikipedia and other Odia Wiki projects. This opens a new arena for digitized free license books in Odia language.

Akruti Sarala is a known name in Odisha. Every single DTP operator who knows typing uses this font. Until now thousands of books have been created using this font. Even today many mainstream newspapers and magazines use this font for typing. Sadly, no one ever realized the content they are creating would be useless when it comes to sharing and reusing, especially on internet. Because, internet accepts a universal standard called "Unicode" for all the languages. When a book is limited only for printing purpose then use of non Unicode font is absolutely of no problem. But, when one copies text from an e-book created using non Unicode fonts (e.g. Sarala) and pastes it elsewhere strange characters gets displayed instead of Odia characters. This is the same situation for all other non-Latin languages.

Why this happens?

Non Unicode fonts use a funny technique. English/Roman characters are removed and Indian (or any other Non-Latin language) language characters are inserted instead of English characters. So, when you type any key from your keyboard the corresponding Indian language character displays instead of the English character. When you have a particular non Unicode font installed this technique works effectively. But, imagine when you don't have the font in your computer! By default it will show the English characters.

How Unicode fonts work?

Unicode fonts contain Indian language characters along with English characters. There is no character/glyph displacement. It is a global standard and fixed by The Unicode Consortium for all the languages. When one text is typed in an Indian language it displays the same character on Ubuntu, Windows or Mac operating system. As most of the operating systems come with Unicode fonts included there is nothing to be worried for installing them again.

How it got started?

Manoj Sahukar, a third year mechanical engineering student who is very enthusiast about the Odia science articles found Odia Wikipedia and realized that the volunteers are working so hard to write content which could actually be simplified rather than merely writing the same content. There are many science articles which he wanted to read on Wikipedia were not there. Then he realized the gap of the the non availability of Unicode content. This is also one more reason Google doesn't have a button for Odia unlike some of the other Indian languages. "Nothing could be such open and great platform like Odia Wikiepdia if one is searching content in Odia language. My tool is dedicated to the Odia Wikipedians who have been working hard for my language", expressed Manoj in the release note. He shared his interest and ideas with Odia Wikipedian Jnanaranjan Sahu and started working on building a tool which could convert the available science articles of Bigyana Diganta (a sciene magazine published in Odia language by Orissa Bigyana Academy) into Unicode. There are many articles which could be used for reference and some of the free content for WikiSource or WikiBooks. Finally he released his tool on internet on 12.12.12, the last one of the repeating dates of this century. It is still in its beta stage and Manoj is working on making it more user friendly. He is also keen on organizing technical events which will bring more individuals to create such open source tools. "My next target is developing OCR (Optical character recognition) software in Odia", says an excited Manoj.

What this tool does?

This tool could be used to convert text typed in non Unicode ISCII fonts to Odia Unicode text. The detailed procedure for using this tool and Unicode conversion is explained in a tutorial on Odia Wikipedia. The tool is released under GFDL license and is available for download on SourceForge.

Non Unicode text being copied from a PDF

Unicode font after conversion

Quick links:

Download from here
Project page on SourceForge: https://sourceforge.net/p/odiaconverter
Tutorial and technical description on Odia Wikipedia: http://or.wikipedia.org/s/cvm
Odia Unicode standard: Odia Unicode code chart

Manoj Sahukar talks about his ideas about the usability of Odia Unicode Converter tool

For more details visit http://editors.cis-india.org/openness/blog-old/non-unicode-iscii-text-can-be-converted-to-unicode

Nineteen Books Published by Ama Odisha Relicensed under CC-by-SA 4.0

subha — 2014-12-07T03:35:46Z

Odisha's most circulated newspaper Sambad has collaborated with CIS-A2K to relicense 19 books published by its sister concern "Ama Odisha".

These books consists of books starting from biographies of notable personalities to historical research. Yesterday Sambad's chairman-editor Soumya Ranjan Patnaik signed a copyright migration document to help the Odia Wikisource community to enrich the project. In an interview to me he expresses, "technology should be used as a tool to take our language to masses". Mr Patnaik is joining "Odia Wikisource Sabha 2014", a launching event of Odia Wikisource co-organized by Odia Wikimedia community and CIS-A2K on November 28, as chief guest.

For more details visit http://editors.cis-india.org/openness/blog-old/nineteen-books-by-ama-odisha-relicensed