Transcription json

Component/part description

In this section we are looking at the Transcription JSON schema used in autoEdit.

Related projects.

Connected to this is defining a schema for transcription, to make sure all components that work with this have a defined interface/specification. Eg BBC Transcript model

Gentle - json

See appendix for json example.

IBM - Json

See appendix for json example. As well as their stt api reference and documentation.

Pocketsphinx - plain text

See appendix for example pocketsphinx plain text.

Implementations Options considered

Other

An array of words object, to represent lines this could also be a nested array of word objects.

Where the word object at a minimum as a start, end time and text attribute.

BBC Transcription Model

considered the bbc/transcript-model to make use of bbc/transcript-editor React component, built on top of Draft.js to improve the word correction feature.

However the blocker for now is that changing the data structure for transcription at this stage would involve a pretty substantial refactor.

Current implementation

Transcription domain

autoEdit JSON Transcription schema at a high level it models the objects present in a transcription.

Transcription modelling diagram

In this representation:

• Transcription

  • Paragraphs ← speaker

    • Lines

      • Words

Speakers are associated to paragraphs. Paragraphs are treated as sections of lines.

A list of speakers can also be kept separate, similarly to how IBM Watson stt API returns the results of speaker diarization.

See Appendix for autoEdit json schema example.

What needs refactoring

Name of paragraph and line attribute are ambiguos. It should be lines and words instead(?).

replace array with hash

This is a bigger refactoring but instead of array data structure, could use hash/dictionary.

This way id is the key. and can make use of key value methods available in js. Lookup speed would improve(?) and could easily get array of values using js method.