autoEdit 2 Documentation
1.0.13
1.0.13
  • Introduction
  • Overview
    • Intro
      • Development approach
      • from 1.0.5 to 1.0.6
    • Architecture Overview
      • Lo fi Design Sketches
      • High fidelity sketches in HTML
    • Support the project
    • documentation section template
    • Build / Deployment
      • Deployment/build for Mac OS X
      • Deployment / Build for Linux
      • Deployment / Build for Windows
      • Travis CI continuous build
        • previous travis setup
  • R&D Doc
    • About R&D doc section
    • Transcription & Media Processing
      • Transcription json
      • Transcriber
        • audio to video
        • STT sdks
          • IBM Watson STT
          • Gentle STT
          • Pocketsphinx
      • Video preview conversion
      • Read metadata
    • Hypertranscript
    • Selections, Annotations, Papercuts
      • Selections
      • Annotations
      • Tags
    • Paper-edit
      • Paper-edit json
      • search-filter
      • drag-and-drop
      • Preview Paper-edit video
    • Export
      • EDL export
      • XML export
      • mp4 export
  • Appendix
    • Dev configuration
    • Current db setup
    • EDL Format
    • Reusable components
    • Prerequisites
    • Testing
    • Updating automated documentation
    • ffmpeg and ffprobe in electron
    • Adding STT services
  • Appendix - Data structures
    • IBM Watson json specs
    • Gentle Json transcription specs
    • Pocketsphinx results
    • autoEdit transcription Json
  • QA List
    • QA Intro
  • Adobe Panel
    • autoEdit Adobe CEP Panel dev setup
      • Adobe Extensions HostList codes
    • autoEdit Adobe CEP Panel integration overview
    • Jsx functions for Adobe CEP autoEdit adobe Panel
    • Packaging and distributing Adobe CEP Extensions
      • Packaging signing Adobe CEP Panel in details
      • Submit to Adobe
  • Project Page
    • Build project page
    • Build/update demo front end page
  • Roadmap
    • Improvements
    • Roadmap
      • Paper-editing Roadmap
      • Extra Features Roadmap
      • Future Roadmap
        • Live video editing
        • Social Media Export
        • Translate transcriptions
        • Web app
          • Multi-user collaboration
        • Searchable Editable Archive
        • NLP insights
        • Slack/Chat bot integration
        • Interactive dev tool
        • Phone mms integration with twillio
        • B-roll computational photography
Powered by GitBook
On this page
  • Hypertranscript / autoEdit Json
  • Papercuts
  • Papercut in view
  • ejs
  • EDL JSON/EDL export module - transcription
  • EDL JSON/EDL export module - paper-edit
  1. R&D Doc
  2. Paper-edit

Paper-edit json

Hypertranscript / autoEdit Json

This is the autoEdit json for a transcription. It models the structure of a transciptions text. With paragraphs, lines, and words.

"text": [
{
"id": 0,
"speaker": "Unnamed Speaker",
"paragraph": [
{
"line": [
{
"id": 0,
"text": "oh",
"startTime": 0.06,
"endTime": 1.65
},

Papercuts

This is a papercut json extracted from the dom view. Inside events. Contains either headings / titles or actual “papercuts” video segments. Events is sinonimum with papercuts. In edl format they are called events. It is missing words and text. So it’s hard to parse it back into the view once that is saved into the model/db. → ideally would want to change this to accomodate words, and have one papercut template for both scenarios.

{
"title": "Paperedit 2",
"events": [
{
"title": "Introduction",
"id": 1
},
{
"startTime": "16",
"endTime": "22.64",
"transcriptionId": "24dcd88b",
"reelName": "NA",
"clipName": "Ian Perkin-Mobile.mp4",
"videoId": "videoId_24dcd88b",
"speaker": "Unnamed Speaker",
"src": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.webm",
"audioFile": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.ogg",
"offset": "NA",
"id": 2
},

Papercut in view

Data structure used in papercut.html.ejs to make a paper-edit when selecting words in transcription side. (hypertranscript). It is an array of words, and It has redundant informations. To make it easier for the extraction.

{
"papercut": [
{
"text": "but ",
"clipName": "Ian Perkin-Mobile.mp4",
"reelName": "NA",
"startTime": "92.35",
"endTime": "92.47",
"speaker": "Unnamed Speaker",
"audioFile": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.ogg",
"src": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.webm",
"transcriptionId": "24dcd88b",
"videoId": "videoId_24dcd88b",
"offset": "NA"
},
{
"text": "it ",
"clipName": "Ian Perkin-Mobile.mp4",
"reelName": "NA",
"startTime": "92.47",
"endTime": "92.76",
"speaker": "Unnamed Speaker",
"audioFile": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.ogg",
"src": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.webm",
"transcriptionId": "24dcd88b",
"videoId": "videoId_24dcd88b",
"offset": "NA"
},
]
}

ejs

This is done so that there can be an interactive transcript this side as well using ejs

<dl class="dl-horizontal">
<dt><%= papercut[0].speaker %></dt>
<dt>
<a data-start-time="<%= papercut[0].startTime %>" data-video-id="<%= papercut[0].videoId %>" class="timecodes"><%= fromSeconds(papercut[0].startTime) %></a>
</dt>
<dd>
<% for(var i=0; i<papercut.length; i++){%>
<span contenteditable="false" class="words text-muted papereditWords"
data-transcription-id="<%= papercut[i].transcriptionId %>"
data-reel-name="<%= papercut[i].reelName %>"
data-clip-name="<%= papercut[i].clipName %>"
data-video-id="<%= papercut[i].videoId %>"
data-speaker="<%= papercut[i].speaker %>"
data-src="<%= papercut[i].src %>"
data-audio-file="<%= papercut[i].audioFile %>"
data-start-time="<%= papercut[i].startTime %>"
data-text="<%= papercut[i].text %>"
data-end-time="<%= papercut[i].endTime %>"><%= papercut[i].text %> </span>
<% } %>
</dd>
</dl>

EDL JSON/EDL export module - transcription

At the moment as as the papercut EDL json in autoEdit but with fields less, as it doesn’t need a lot of the once in the autoEdit one, to be able to make an .edl file.

var edlSqDemo = {
"title": "Demo Title of project",
//offset is optional default is "00:00:00:00"
"events": [
{ "id":1,
"startTime": 10,
"endTime": 20,
"reelName":"SomeReelName",
"clipName":"Something.mov"
"offset": "00:00:28:08"
},
{ "id":2,
"startTime": 45,
"endTime": 55,
"reelName":"SomeOtherReelName",
"clipName":"SomethingElse.mov",
"offset": "00:00:28:08"
},
{ "id":2,
"startTime": 45,
"endTime": 55,
"reelName":"NA",
"clipName":"SomethingElse.mov"
"offset": "00:00:28:08"
}
]
}

EDL JSON/EDL export module - paper-edit

{
"title": "Paperedit 2",
"events": [
{
"title": "Introduction",
"id": 1
},
{
"startTime": "16",
"endTime": "22.64",
"transcriptionId": "24dcd88b",
"reelName": "NA",
"clipName": "Ian Perkin-Mobile.mp4",
"videoId": "videoId_24dcd88b",
"speaker": "Unnamed Speaker",
"src": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.webm",
"audioFile": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.ogg",
"offset": "NA",
"id": 2,

"papercut": [
{
"text": "but ",
"clipName": "Ian Perkin-Mobile.mp4",
"reelName": "NA",
"startTime": "92.35",
"endTime": "92.47",
"speaker": "Unnamed Speaker",
"audioFile": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.ogg",
"src": "/Users/pietropassarelli/Library/Application Support/autoEdit2/media/Ian_Perkin-Mobile.mp4.1486169904445.webm",
"transcriptionId": "24dcd88b",
"videoId": "videoId_24dcd88b",
"offset": "NA"
},
...
]
},
...
]
}
PreviousPaper-editNextsearch-filter

Last updated 6 years ago