User Testing Ingest & Prep Workflow

User Testing - Program Operation Managers

We received feedback on our full Ingest and Prep workflow during the user testing session with the Program Operation Managers at NBCU and implemented various changes through several design iterations.

Script

For this round of user testing with the Program Operations Managers, we walked them through the proposed workflow that covered all the features while the users spoke aloud their feedback.

Our Script for our Program Operations Manager Interview

Recording

User Testing Session 1 with the Program Operation Managers via WebEx on May 30th, 2019.

Summarized Notes

Liked

Ingest & Prep Modal

  • The various QC statuses

  • How the record ID’s are linked to a TVD number (material ID)

  • The record-ID auto assign

  • Can view the show name

  • Ability to apply bulk VCHIP, delivery dates, and QC Statuses

  • Multiple GMO IDs on same production number for different versions i.e. texted and textless

  • Ingest & Record IDs - Always default to prod#_1 … no starting from nothing

  • How users can put info in ahead of prod delivery date and then when content is ingested users can select which GMO ID content is being applied to

  • In new workflow everything will already be ingested in Mediator so don’t need to apply edits to items that is waiting on delivery

Notes/Edits

  • Notes have timestamps

  • Notes have fix file name

  • The accountability this workflow creates

  • Can assign a technician

Asset Dashboard

  • The bold icons for the “QC status” to quickly know what isn’t ready for delivery at a glance

  • Ability to view the amount of unfinished notes/edits

  • The log to track history/updates

Dislike

Ingest & Prep Modal

  • Record status - they don’t need it

  • VCHIP is freeform - should be dropdown with specific options

  • Material ID (TVD ID) isn’t editable

  • GMO IDs are required

Notes/Edits

  • The “status” section is separate from the notes/edit section

  • Each new note has new blank fields; a lot of the notes will have the same metadata except for timestamps and instructions

  • Checking and unchecking boxes and bulk copy and paste to create new notes for the same asset; too much clicking and confusing

  • Don’t need source file name; will be the GMO item

Asset Dashboard

  • Nothing :)

Wants

Ingest & Prep Modal

  • To be able to search by compass material ID

  • Can also freeform edit the compass material ID

  • To go into this modal for a whole season without having to click on every episode in the asset dashboard

  • VCHIP to be a dropdown list of options not freeform - use all in google sheet

  • To convey to mediator if the files have QC passed or not - ultimate goal

  • GMO IDs

    • GMO IDs to display what makes it special so other parties can easily find i.e. texted vs textless

    • No error message if trying to add a note/edit on a GMO ID that isn’t ingested yet; should never have that

    • GMO ID should be optional

Notes/Edits

  • Ability to add multiple notes/edit request in one note i.e. for one file

    • Because most metadata will be the same except for timestamps

    • “+” at the end to add more edits with the following metadata: Fixname, Timecode of when it is, What fix is

    • Optional comments

  • Move “status” section before comments; possible to put in notes/edits section

  • Stronger indicator that the GMO ID is the source file name

    • Remove source file from note/edit form

Asset Dashboard

  • Wants a version description for the different GMO IDs

Key Takeaways

After hearing feedback from the Program Operation Managers, we decided to make the following changes to the UI of the Ingest and Prep workflow.

Ingest & Prep Modal

  1. Optional field for ingest and prep order # - new freeform field

  2. Freeform field to be able to enter translator material id

  3. VCHIP field- dropdown of possible values:

    • Unknown,NR,TV-Y,TV-Y7,TV-Y7-FV,TV-G,TV-PG,TV-PG-V,TV-PG-S,TV-PG-L,TV-PG-D,TV-PG-S-V,TV-PG-L-V,TV-PG-D-V,TV-PG-L-S,TV-PG-D-S,TV-PG-D-L,TV-PG-L-S-V,TV-PG-D-L-V,TV-PG-D-S-V,TV-PG-D-L-S,TV-PG-D-L-S-V,TV-14,TV-14-V,TV-14-S,TV-14-L,TV-14-D,TV-14-S-V,TV-14-L-V,TV-14-D-V,TV-14-L-S,TV-14-D-S,TV-14-D-L,TV-14-D-S-V,TV-14-D-L-S,TV-14-D-L-V,TV-14-L-S-V,TV-14-D-L-S-V,TV-MA,TV-MA-V,TV-MA-S,TV-MA-L,TV-MA-S-V,TV-MA-L-V,TV-MA-L-S,TV-MA-L-S-V,TV-MA-D-V,TV-MA-D-S,TV-MA-D-L,TV-MA-D-S-V,TV-MA-D-L-S,TV-MA-D-L-V,TV-MA-D-L-S-V,TV-MA-D

  1. By default when open modal record ID auto-assigns to “INGPREP{PROD#}A”

    • Ability to create new records which would spawn a new row in the modal

    • Subsequent records will be “INGPREP{PROD#}B”, “INGPREP{PROD#}C”...

  2. would be really cool too actually is if in the mock on the asset dashboard you show a configure view column at the end for Ingest & QC Work Order and then that number displays and you have a way to be taken to that order from the asset dashboard

Notes/Edits

  1. Optional field for ingest and prep order # - new freeform field

  2. Freeform field to be able to enter translator material id