Transcription Hackathon

Notes from Nature/iDigBio Hackathon to Further Enable Public Participation in the Online Transcription of Biodiversity Specimen Labels

December 16–20 at the University of Florida, Gainesville

Digitizing the Past and Present for the Future
Quick Links for Transcription Hackathon Workshop
Transcription Hackathon Workshop Agenda
Transcription Hackathon Workshop Biblio Entries
Transcription Hackathon Workshop Report } Agenda and Logistics Hackathon Advertisement Agenda Logistics Document Participants List AdobeConnect room for collaboration after the hackathon, then for connection to the workshop remotely (Send an email to Austin Mast, if you'd like to use the room for additional collaboration after the hackathon.) Media Citscribe Hackathon Facebook Album Twitter stuff: @iDigBio @NfromN hashtag #CITScribe Report Citscribe Hackathon Report Coordination Interoperability Track OCR Integration Track QA/QC and Reconciliation of Replicates Track User Engagement Track Participants Interest in Tracks Presentations Yonggang Liu, iDigBio: Image Ingestion at iDigBIo Austin Mast, iDigBio: Public Participation Yun Ling Yim, UC Berkeley: Calbug Digitization, CalBug California Arthropod Collections Miao Chen, Indiana U.: Using OCR Cody Meche, UF: Agile Scrum Julie Allen, INHS: Gamification Edward Gilbert, Symbiota Developer: Symbiota: a specimen-based biodiversity portal platform Deborah Paul, iDigBio Augmenting OCR WG: What's new in using OCR output in a Citizen Science Workflow Andrea Matsunaga, iDigBio: Herbarium Labels Transcription Crowdsourcing & OCR Joshua Campbell, iDigBio: Herbarium Labels Transcription Crowdsourcing Consensus Yonggang Liu, ACIS iDigBio: iDigBio Image Ingestion Appliance Paul Kimberly, Smithsonian: Smithsonian Transcription Center William Ulate, Missouri Botanical Garden: Purposeful Gaming and BHL Development Resources GitHub organization for this Transcription Hackathon 4 existing crowdsourcing datasets from Notes From Nature. Datasets contain transcriptions of different types of collections labels. Read more here. The datasets were shared only with the hackathon participants through dropbox once anonymized. It will be made public when we get a definitive approval from NfN. Calbug dataset Herbarium labels—The filenames with "USAM_" represent a nearly complete set of recent transcriptions from a collection (the University of South Alabama Herbarium), four replicates for most specimens (I think). Macrofungi labels Ornithological dataset For those interested in experimenting with the images that have been used for public participation in transcription: Herbarium label images: the set of ca. 16,000 "USAM" images used for some of the herbarium transcriptions is available at USAM Herbarium Images. This is several GB worth of image files. To get them, you could use the DownloadThemAll Firefox plugin. Notes From Nature web interface: Code available at https://github.com/zooniverse/notesFromNature Forked version for the Hackathon available at: https://github.com/idigbio-citsci-hackathon/notesFromNature Install Vagrant from http://downloads.vagrantup.com/tags/v1.3.5 and virtualBox from https://www.virtualbox.org/wiki/Downloads Vagrant script to build a VM with Notes From Nature web interface: https://github.com/idigbio-citsci-hackathon/nfn-vagrant Go to the location of the vagrant script and type "vagrant up" in your command prompt to build a VM with Note from Nature running on localhost:9294. API Calls https://api.zooniverse.org/projects/notes_from_nature/groups/ https://api.zooniverse.org/projects/notes_from_nature/groups/5170103b3ae74027cf000002 CYWG iDigBio Image Ingestion Appliance: The appliance can be used to ingest the images to be used by the crowdsourcing service into the iDigBio storage, and made publicly accessible through HTTP. The relationship between the image filenames and the URL can be exported by the appliance in CSV format. Gold Images from aOCR Hackthon: CSV file with URLs for the Images on iDigBio beta server (Uploaded by Image Ingestion Appliance): ent, herb,lichens. Code from the aOCR Hackthon: HandwritingDetection (https://github.com/idigbio-aocr): an algorithm that separates images into sets with no handwriting, little handwriting (mostly text typed or printed), lots of handwriting, based on the noise generated by the OCR software. Read more at Ben's blog. This could be used to rank which images are in more need for human transcription. Dictionaries to improve crowdsourcing consensus (e.g., names of collectors, scientific names): link to be provided by aOCR? (Some botantists: RDF and tab-delimited.) Hi all - (Paul Flemons). I have uploaded a number of files: a description of Open Refine procedures used for matching BVP fields to EMu EVENTS Detailed process of preparing BVP data for EMu Overview of preparing BVP data for EMu Diagram of the process of preparing data from BVP for EMu From Steve Raden: some background on Zooniverse's design http://arfon.org/how-the-zooniverse-works-tools-and-technologies http://arfon.org/how-the-zooniverse-works-keeping-it-personal http://arfon.org/how-the-zooniverse-works-the-domain-model Hackathon Products Brainstorming Documents from the Thursday Mix Ups Group 1 Mix Up Discussion Summary (google doc) Group 2 Group 3 MixUp google doc Group 4 Mix Up Discussion Summary (google doc) Some groups used the Coordination pages above to summarize products Group 1 Target File Format