autoEdit 2 Documentation
1.0.13
1.0.13
  • Introduction
  • Overview
    • Intro
      • Development approach
      • from 1.0.5 to 1.0.6
    • Architecture Overview
      • Lo fi Design Sketches
      • High fidelity sketches in HTML
    • Support the project
    • documentation section template
    • Build / Deployment
      • Deployment/build for Mac OS X
      • Deployment / Build for Linux
      • Deployment / Build for Windows
      • Travis CI continuous build
        • previous travis setup
  • R&D Doc
    • About R&D doc section
    • Transcription & Media Processing
      • Transcription json
      • Transcriber
        • audio to video
        • STT sdks
          • IBM Watson STT
          • Gentle STT
          • Pocketsphinx
      • Video preview conversion
      • Read metadata
    • Hypertranscript
    • Selections, Annotations, Papercuts
      • Selections
      • Annotations
      • Tags
    • Paper-edit
      • Paper-edit json
      • search-filter
      • drag-and-drop
      • Preview Paper-edit video
    • Export
      • EDL export
      • XML export
      • mp4 export
  • Appendix
    • Dev configuration
    • Current db setup
    • EDL Format
    • Reusable components
    • Prerequisites
    • Testing
    • Updating automated documentation
    • ffmpeg and ffprobe in electron
    • Adding STT services
  • Appendix - Data structures
    • IBM Watson json specs
    • Gentle Json transcription specs
    • Pocketsphinx results
    • autoEdit transcription Json
  • QA List
    • QA Intro
  • Adobe Panel
    • autoEdit Adobe CEP Panel dev setup
      • Adobe Extensions HostList codes
    • autoEdit Adobe CEP Panel integration overview
    • Jsx functions for Adobe CEP autoEdit adobe Panel
    • Packaging and distributing Adobe CEP Extensions
      • Packaging signing Adobe CEP Panel in details
      • Submit to Adobe
  • Project Page
    • Build project page
    • Build/update demo front end page
  • Roadmap
    • Improvements
    • Roadmap
      • Paper-editing Roadmap
      • Extra Features Roadmap
      • Future Roadmap
        • Live video editing
        • Social Media Export
        • Translate transcriptions
        • Web app
          • Multi-user collaboration
        • Searchable Editable Archive
        • NLP insights
        • Slack/Chat bot integration
        • Interactive dev tool
        • Phone mms integration with twillio
        • B-roll computational photography
Powered by GitBook
On this page
  1. Appendix

Adding STT services

Previousffmpeg and ffprobe in electronNextIBM Watson json specs

Last updated 6 years ago

Can use the Pr as an example.

Generally adding a new STT service to autoEdit will entail:

1. Credentials part 1

  1. Adding module to handle credentilas

  2. add support for keys in db.js

  3. expose getters and setters in

2. credentials part 2

  1. Pass data for settings view through the router

  2. add credentials field in settings template

  3. integrate with settings view

3. Transcription form

  1. Add option in transcription form template

    1. optional list of languages, if model supports multiple language models.

  2. Integrate with transcription form view

4. Backend

  1. Add backend option for that stt service in transcriber module

  2. The module to call the STT API and convert to json might more or less involved depending on the STT SDK provided by the STT service.

  3. Then a module adapter to convert the STT API output into autoEdit Json

    1. sometimes to build the adapter, it's easier to get some sample json from the STT API Service, or from a sample response and use that to create the parser. eg

A bit involved, but for now that's it, npm start, to test it out.

Added support for AssemblyAI #70
electron/assemblyai_keys.js
electron/db.js
electron/index.html
lib/app/router.js
settings_template.html.ejs
lib/app/views/settings_view.js
/transcription_form_template.html.ejs
lib/app/views/transcription_form_view.js
lib/interactive_transcription_generator/transcriber/index.js
lib/interactive_transcription_generator/transcriber/assemblyai/convert_to_json.js
lib/interactive_transcription_generator/transcriber/assemblyai/sample-assemblyai.json