AJA NTV2 SDK  17.1.3.1410
NTV2 SDK 17.1.3.1410
NTV2 Device Hardware Operation

On this page:

Introduction

In simplest terms, NTV2 devices are essentially…

  • a big chunk of SDRAM memory for buffering video frames and audio samples, which is tied to…
  • an FPGA that determines what gets written or read to/from that memory (and where), plus…
  • one or more video and/or audio signal inputs and/or outputs, and…
  • a high-speed PCIe interface to a host computer, for rapidly reading or writing 32-bit registers, and transferring bulk data via DMA to/from the host.

In addition, the FPGA firmware implements “widgets“ that can process video data in a particular way (e.g., color correction, muxing/demuxing, etc.).

Device Features

All AJA NTV2 hardware devices minimally support the following:

  • Capture or play to/from the host computer video and audio through at least one video connector.
  • SD 525i 59.94fps, and 625i 50fps
  • HD 720p 50/59.94/60, 1080i 50/59.94/60, 1080psf 23.98/24 and 1080p 23.98/24/29.97/30
  • 8-bit YCbCr or 10-bit YCbCr frame buffer formats.

Beyond these common characteristics, AJA devices fan out into a diverse array of capabilities to suit many different applications. To determine the features of an AJA device…

Note
Before SDK 17.0, AJA always recommended using Device Features API in the “libajantv2” Class Library . In SDK 17.0, the DeviceCapabilities class was introduced, to provide feature inquiry that works with virtual devices as well as locally-attached physical devices.

Most devices can capture and play video, but some may only capture, while others may only playout.

  • To determine if a device can capture video, call CNTV2Card::features, then DeviceCapabilities::CanDoCapture.
  • To determine if a device can play video, call CNTV2Card::features, then DeviceCapabilities::CanDoPlayback.

Hardware Characteristics

PCI Interface

All NTV2 devices utilize Peripheral Component Interconnect (PCI) or Peripheral Component Interconnect Express (PCIe) to communicate with the host computer system (or with other PCI/PCIe peers on the same host).

PCI Vendor ID

All AJA NTV2 devices have the same PCI vendor ID.

  • PCI vendor ID: 0xF1D0
Data Transfer

Direct Memory Access (DMA) is the only supported method of moving data between host memory and the hardware. All NTV2 devices have at least one DMA engine. (Programmed Input/Output, a.k.a. PIO is no longer supported.)

  • To determine the number of DMA engines for a device, call CNTV2Card::features, then DeviceCapabilities::GetNumDMAEngines.
Device Frame Buffer

All NTV2 devices have a fixed amount of Synchronous Dynamic Random Access Memory (SDRAM). The FPGA is the SDRAM controller, which controls the output of video (and metadata, such as audio and anc) from RAM, the input of video (and metadata) into RAM, the PCI interface to/from RAM, and RAM refresh.

Frame Buffer Layout

The FPGA is programmed with firmware that implements a number of video I/O and signal-processing “widgets”, plus other programming to handle other signal and data I/O.

  • The device’s SDRAM is logically partitioned into a number of equal-sized frames.
  • The intrinsic frame size used for Frame Buffer Indexing defaults to 8MB (and is doubled when necessary).
  • Call CNTV2Card::features, then DeviceCapabilities::GetActiveMemorySize to discover a device’s SDRAM complement.

The vast majority of the SDRAM frames are used for storing video raster data.

Audio ring buffer storage is located at the very top of SDRAM. As such, the uppermost frame(s) should be avoided for video. See Audio System Operation for more information.

Video data in the device frame buffer is always stored full-frame. Interlaced video is always stored in the frame buffer with the first line of Field 1 (F1L1) at the top of the buffer, followed by the first line of Field 2 (F2L1), then F1L2, F2L2, F1L3, F2L3, etc., alternating to the end of the frame. An exception to this is NTSC SD 525i, which starts with Field 2 at the top of the buffer (F2L1, F1L1, F2L2, F1L2, etc.).

Note
A very very long time ago, AJA had devices that stored all of F1’s lines in the top half of the buffer, and all of F2’s lines in the bottom half. These devices and buffer formats are no longer supported.

See Video System Operation for more details.

Signal Inputs & Outputs

Breakout Boxes and Cables

On some devices, certain signal connectors are accessible only through a Breakout Cable or Breakout Box.

SDI Connectors

Most AJA devices have at least one SDI connector.

Bi-Directional SDI Connectors

Some SDI connectors are permanently configured as inputs, others as permanent outputs, but on some devices, they’re software-configurable. This means your application can instruct the device to reconfigure one of its SDI connectors from an input to an output (or vice-versa).

SDI Input

An SDI Input is a device widget implemented in FPGA firmware that receives a video signal from a specific physical SDI connector, and makes it available to other firmware signal processing widgets.

  • There is one SDI Input widget for each input SDI connector. NTV2DeviceGetNumVideoInputs will return the number of them on the device. For devices with Bi-Directional SDI Connectors, the returned number will include every connector that can be configured as an SDI Input.
  • Electrical Characteristics:
    • AC-coupled input terminated with 75Ω to ground
    • SMPTE 292 compliant — 800mV peak-to-peak ±10%
Widget Signal Routing
Input Signal Detection

There are three functions provided in the SDK to determine if there’s a signal present at an SDI Input, and if so, what format it is:

Note
It is rare, but some SDI devices can emit signals that aren’t entirely SMPTE-compliant (e.g. they may contain improper CRC values). Modern AJA NTV2 firmware ignores input CRCs when detecting TRS, to enable the capture of non-compliant signals.
Error Checking

Some AJA devices with SDI Inputs have additional firmware and registers for tallying SDI errors that may be encountered.

SDI Output

An SDI Output is a device widget implemented in FPGA firmware that accepts a video signal from other firmware signal processing widgets to be transmitted through a specific physical SDI connector.

  • There is one SDI Output widget for each output SDI connector. NTV2DeviceGetNumVideoOutputs will return the number of them on the device. For devices with Bi-Directional SDI Connectors, the returned number will include every connector that can be configured as an SDI Output.
  • Some devices have an SDI Monitor Output that’s separate from the normal SDI Outputs.
    • Call NTV2DeviceCanDoWidget with NTV2_WgtSDIMonOut1 to determine if the device has an SDI monitor output.
    • The monitor output is not bi-directional — it’s always an output.
    • In all other respects, it can be treated like any other 3Gbps SDI output.
  • Electrical Characteristics:
    • AC-coupled output terminated with 75Ω to ground
    • Output Level: 800mV peak-to-peak ±10%, terminated into 75Ω
Widget Signal Routing
Configuration

HDMI Connectors

Many AJA devices have HDMI connectors, some for input, most for output.

  • Connector: Type-A (unless otherwise noted on device spec sheet)
  • To determine the number of HDMI inputs the device has, call NTV2DeviceGetNumHDMIVideoInputs.
  • To determine the number of HDMI outputs the device has, call NTV2DeviceGetNumHDMIVideoOutputs.
  • HDMI capabilities depend on the physical HDMI hardware used on the device and the supporting firmware.
  • To determine which HDMI hardware is present on the device, call NTV2DeviceGetHDMIVersion.
    NOTE: This function doesn’t return an HDMI protocol version. Instead, it returns an unsigned integer that indicates which “generation” of HDMI hardware was used on the device.
  • HDMI hardware capabilities chart:

HDMI Output

An HDMI Output is a device widget implemented in FPGA firmware that accepts a video signal from other firmware signal processing widgets to be transmitted through a specific physical HDMI connector.

Configuration & Inquiry
Widget Signal Routing

HDMI Input

An HDMI Input is a device widget implemented in FPGA firmware that accepts a video signal from a specific physical HDMI connector, and makes it available to other firmware signal processing widgets.

Widget Signal Routing
Configuration & Inquiry
Input Signal Detection

To determine if there’s a signal present at an HDMI input connector, and if so, what format it is…

Analog Video Connectors

Some older AJA devices support analog video.

  • An analog video input or output typically has three physical RCA connectors:
    • “Y/G/CVBS”
    • “Pb/B/Y”
    • “Pr/R/C”

Analog Output

An Analog Output is a device widget implemented in FPGA firmware that accepts a video signal from other firmware signal processing widgets to be transmitted through a specific physical analog video connector.

  • Call NTV2DeviceGetNumAnalogVideoOutputs to discover how many Analog Outputs are on the device.
  • Electrical Characteristics:
    • 12-bit precision DAC output
    • Luma Bandwidth: 12.5 MHz (SD) or 30 MHz (HD)
    • Chroma Bandwidth: 5.8 MHz (SD) or 13.75 MHz (HD)
Widget Signal Routing

Analog Input

An Analog Input is a device widget implemented in FPGA firmware that receives an analog video signal from a specific physical analog video input connector, and makes the signal available to other firmware signal processing widgets.

Widget Signal Routing
Input Signal Detection

To determine if there’s a signal present at an Analog Input, and if so, what format it is…

Reference Input

Input Signal Detection

To determine if there’s a signal present at the Reference Input, and if so, what format it is, call CNTV2Card::GetReferenceVideoFormat.

Note
For AJA devices that use a single BNC connector for Reference and LTC input — i.e. if NTV2DeviceCanDoLTCInOnRefPort returns true — then you must call CNTV2Card::SetLTCInputEnable and pass it false before calling CNTV2Card::GetReferenceVideoFormat, otherwise the function will return NTV2_FORMAT_UNKNOWN, even if there’s a valid reference signal at the connector.
Electrical & Signaling Characteristics:
  • Analog video reference, NTSC, PAL, or tri-level sync
  • Input terminated by 75Ω to ground
  • Input level: 0.5 Volts peak-to-peak to 2.0 Volts peak-to-peak
  • Tri-level sync:
    • Analog Color Black (700 mV sync nominal, plus burst)
    • Composite Sync (700 mV sync nominal, plus burst and video)
    • HD Tri-Level Sync (±700 mV sync)

LTC Connectors

Most AJA devices have the ability to receive or transmit analog Linear TimeCode (LTC).

LTC Input

Most AJA devices with SDI connectors have at least one analog LTC input.

Note
The LTC input firmware relies on the timing signal from an enabled FrameStore that’s configured for input, and that’s properly routed to an SDI Input that is receiving a valid signal. This is the LTC input’s “clock channel”. If the LTC input’s clock channel (FrameStore) is not receiving input interrupts, the LTC input will not provide intelligible timecode.
Detecting & Reading LTC
Note
For AJA devices that have a single BNC connector for Reference and LTC input — i.e. if NTV2DeviceCanDoLTCInOnRefPort returns true, you must call CNTV2Card::SetLTCInputEnable and pass it true before calling CNTV2Card::GetLTCInputPresent or CNTV2Card::ReadAnalogLTCInput, otherwise these function will fail to report a valid signal or timecode.
Electrical & Signaling Characteristics:
  • Designed to work with inverted or non-inverted inputs
  • Input impedence 75Ω, coax or other single-ended connection is recommended
  • There is no differential termination on these inputs, so a balanced connection may not be reliable
  • Designed to meet SMPTE spec, 0.5V to 4.5Vp-p

LTC Output

Most AJA devices with SDI connectors have at least one analog LTC output.

Note
The LTC output firmware relies on the timing signal from an enabled FrameStore that’s configured for output. This is the LTC output’s “clock channel”.

Serial Ports (RS-422)

Most AJA devices have a single RS-422 connector that can be used to control tape deck transports and for other purposes.

Video System Operation

This section describes how the Video System operates.

Widgets

Widgets implement signal processing functions in firmware.

There are widgets that represent signal inputs, outputs, plus those that perform processing, such as FrameStores or color space converters.

All widgets have a unique identifier in software expressed by the NTV2WidgetID enumeration. To determine if a device implements a particular widget, call NTV2DeviceCanDoWidget.

Video data paths between widgets are implemented using crosspoints in firmware.

  • Widget inputs are identified by NTV2InputCrosspointID.
  • Widget outputs are identified by NTV2OutputCrosspointID.
  • Input Widgets only have output crosspoint connections.
  • Output Widgets only have input crosspoint connections.
  • Processing Widgets have both input and output crosspoint connections.

The CNTV2SignalRouter class has static methods that are useful for inquiring about device widgets and their input and output crosspoints:

A set of “crosspoint select” registers (e.g., kRegXptSelectGroup1, kRegXptSelectGroup2, etc.) determine which widget output will feed (source) each widget’s input.

Note
A widget’s output can source multiple widgets’ inputs, while a widget’s input can only be sourced by one other widget’s output. In other words, widget outputs are one-to-many, while widget inputs are one-to-one.
Widget inputs that are left open — i.e., disconnected — i.e. aren’t connected to any other widget’s output — default to the NTV2_XptBlack output crosspoint.

The CNTV2Card class has several methods dedicated to widget routing:

Due to FPGA size limitations, only a small fraction of the possible widget interconnection routes are implemented. Unfortunately, for many years, there was never a programmatic way to determine at runtime if a device implemented a specific connection path. The CNTV2Card::CanConnect function was in place to support this, but it was never functional. Around SDK 14.0, an attempt was made to compile a static “implemented routes” table for some firmware, but it wasn’t reliable and was abandoned.

Starting with SDK 16.0, newer devices have a firmware ROM bitmask that provides a true indication of actual, implemented connection paths. The CNTV2Card::CanConnect function makes use of this bitmask for those devices that support it.

The NTV2 SDK provides the Routing Inspector in “NTV2Watcher” that graphically shows the available device widgets and the signal routing between them. It lets you inspect and interactively change widget configuration and signal routing paths between widgets. Also, for devices that support this feature, it displays the legal, implemented routes when creating a new connection from a widget socket. Finally, as a programming aid, once a working routing has been achieved, NTV2Watcher can generate the C++ source code that implements it.

FrameStore Operation

An NTV2 FrameStore is a device widget implemented in FPGA firmware that writes or reads video data to or from SDRAM, depending upon its mode (capture or playback), and uses several registers to control its operation. Each FrameStore has the following properties:

In the SDK, FrameStores are identified by an NTV2Channel enumeration and sometimes by a zero-based unsigned integer value, where zero corresponds to NTV2_CHANNEL1.

  • Call NTV2DeviceGetNumFrameStores to determine the number of FrameStores on a given device. This also determines the number of video streams (input or output) that can operate concurrently.
  • Devices having only one FrameStore are limited to Capturing or Playing a single stream of video at a time.
  • Devices with more than one FrameStore can independently input or output more than one video stream simultaneously, with each FrameStore accessing SDRAM.
  • A few older AJA devices (e.g. Corvid, Corvid 3G) had two FrameStores, but FrameStore 1 was input-only (NTV2_MODE_CAPTURE), and FrameStore 2 was output-only (NTV2_MODE_DISPLAY).
Note
In NTV2 parlance, the terms Channel and FrameStore are often used interchangeably.
Widget Signal Routing
UHD/4K and UHD2/8K

Since the introduction of 1.5Gbps HD signaling, the SDI image size has quadrupled twice!

When AJA introduced its first UHD-capable device, we called it “Quad“, since it required 4 × HD connections. Each link was a rectangular (“square”) division of the quad image. Thus came the term “quad squares”.

Then SMPTE proposed and ratified “Two-Sample Interleave” (a.k.a. TSI), with each link carrying a subsample of the whole image, which we called “Quad TSI”. Making TSI from a planar image required a simple kind of muxing, so “TSI Mux” widgets were added to the firmware, which had to be routed before the FrameStore for capture, and for playback, de-muxers had to be routed after the FrameStore. This we came to call “TSI routing”.

The firmware could now handle SD all the way up to 4K for all of the various SD, HD, and 3G SDI formats. The kona4, Corvid 44 and Corvid 88 are good examples of devices that supported these 3G crosspoints and the full complement of TSI muxers/demuxers.

When 12G arrived, this same quadrupling started all over again.  With the introduction of the KONA 5 and its UHD2/8K firmware, we implemented 12G crosspoints, so that UHD/4K signals can be routed like HD ones on the kona4. Initially UHD2 was square division, and then of course, SMPTE subsequently added TSI. These formats became “Quad-Quad Squares” and “Quad-Quad TSI”. This time, however, at AJA we built the muxers/demuxers into the FrameStores, their use (or not) being inferred from the format. This greatly simplifies signal routing.

To make “squares” and TSI operate on the KONA 5 and Corvid 44 12G there’s still a difference in the way FrameStores are routed: Square division requires 4 FrameStores, since the “squares” are simultaneously accessing four different places in the image. TSI only requires 2 FrameStores, since only two lines in the image are being accessed at a time.

Multi-Format / “Independent” Mode

Multi-Format Mode, also known as “Independent” mode, is a device capability in which it can simultaneously operate more than one stream, with each having a different video format. Devices having this capability that are in this mode are able to use a different NTV2VideoFormat on each FrameStore.

This differs from prior device capability. For example, assuming there was sufficient DMA and processor bandwidth on the host, the Corvid 24 could simultaneously ingest two video streams, and playout another two video streams — but all four streams must have the identical NTV2VideoFormat.

In Multi-Format Mode, for example, assuming sufficient PCIe and host processor bandwidth, the Corvid 44 could simultaneously ingest NTV2_FORMAT_720p_5000 and NTV2_FORMAT_525_5994 while playing NTV2_FORMAT_1080p_2997 and NTV2_FORMAT_720p_5994.

The relevant SDK calls:

Note
This “Independent Mode” doesn’t mean that the FrameStores cannot interfere with each other’s frame buffer memory. FrameStores have equal access to any frame buffer in device SDRAM. Therefore, if you use frame buffers 0…5 for Channel 1, you must take care to not use frames 0…5 for any other channel on the device (unless you have good reason to do so). See When FrameStores Access the Same Frame Buffer Memory (below) for more information.
In Multi-Format Mode, because NTV2 devices only have one hardware clock for driving the outputs, all output video formats must be in the same Clock Family. Call IsMultiFormatCompatible(const NTV2VideoFormat, const NTV2VideoFormat) to find out if two video formats are multi-format compatible. Call IsMultiFormatCompatible(const NTV2FrameRate, const NTV2FrameRate) to see if two frame rates are multi-format compatible. Call GetFrameRateFamily to determine the Clock Family that a given NTV2FrameRate belongs to. See Video Output Clocking & Synchronization for more details (below).

Frame Buffer Access

Data can be transferred to or from the device at any time using the DMA API in the CNTV2Card class, or CNTV2Card::AutoCirculateTransfer if using AutoCirculate.

Since the host computer always has unrestricted access to frame memory at any time, it’s critical to synchronize or gate transfers to/from the host using the vertical blanking interrupt (e.g., CNTV2Card::WaitForOutputVerticalInterrupt, CNTV2Card::WaitForOutputFieldID, CNTV2Card::WaitForInputVerticalInterrupt, CNTV2Card::WaitForInputFieldID, etc.). The transfer functions don't wait — they immediately perform the transfer, and wonʼt return until they finish (or fail).

Warning
Calling CNTV2Card::DMAWriteFrame at a fraction of frame time after the VBI to write the same frame on the device that’s being read for the currently-playing video frame will likely look torn or distorted. Likewise for the opposite — i.e., calling CNTV2Card::DMAReadFrame at a fraction of frame time after or before the VBI to read the same frame being written by the FrameStore from the incoming video frame would result in some lines having pixel data from the new, incoming frame, while the remaining lines would contain old pixel data.

For extremely tight latency, FrameStore 1 has a kRegLineCount register that can be monitored (via CNTV2Card::ReadLineCount ), so that small bands of raster lines can be transferred “ahead of” the line counter (for playback) or “behind” it (for capture). However, other FrameStores (2 or higher) do not have Line Counter registers.

There are several DMA API functions for transferring data between host memory and device SDRAM. They are frame-centric in that they all require a zero-based index number or Frame Offset to calculate where to start reading or writing in device SDRAM.

  • Call CNTV2Card::DMAReadFrame or CNTV2Card::DMAWriteFrame to transfer frame data from or to device SDRAM (respectively).
  • Frame Number — See Frame Buffer Indexing (below) for details.
  • Byte Count:
    • Should be even, or evenly divisible by 4, or ideally a power of two.
    • Small transfers can sometimes be problematic for certain DMA engine firmware in combination with certain host hardware and OS platforms. To avoid this, AJA recommends transferring at least 4096 bytes of data. Try smaller values if necessary, but test thoroughly with the devices and hardware you intend to support.
    • It can be larger than a frame. For example, if the device frame size is 8MB, and the requested byte count is 16MB, two frames will be transferred.
  • CNTV2Card::DMARead and CNTV2Card::DMAWrite are similar, but also accept a Byte Offset, which…
    • Should be even, or evenly divisible by 4, or ideally a power of two.
    • Hint: All device SDRAM can be accessed by using a zero Frame Number and using any offset value needed (up to 4GB minus the Byte Count).
Note
DMA transfer speeds may be affected by the amount of video data being accessed by the device to transmit video. If a channel is in display mode, it is always playing video, and therefore reading from SDRAM, consuming SDRAM bandwidth… the amount consumed determined by the amount of data being read from frame memory… which depends on Frame Buffer Geometries and Device Frame Buffer Formats. In some cases, DMA speeds can be increased by disabling unused channels (see CNTV2Card::DisableChannel). Disabling unused channels is especially useful when using larger video and frame buffer formats, which use significant SDRAM bandwidth to read frame data for playout. In addition to the fact that more data is moved in, say, 48-bit RGB (than YUV8), the transfer of that data may also proceed at a slightly slower rate.
Warning
Accessing memory addresses that are beyond the end of device SDRAM is not recommended, and will result in unexpected behavior — e.g. wrapping around and continuing from the start of device SDRAM.

AutoCirculate users should call CNTV2Card::AutoCirculateTransfer to transfer video, audio, and/or ancillary data. By default, it knows the correct frame in device SDRAM to source (for capture) or target (for playback).

Frame Buffer Indexing

FrameStores access frame data in SDRAM starting at Frame Offsets measured from the start of SDRAM (at address zero).

  • The first byte of the first raster line of the first frame coincides with SDRAM address 0x00000000.
  • Frame Offsets are always multiples of the “intrinsic” frame size of the device, which defaults to NTV2_FRAMESIZE_8MB (8MB).
  • The intrinsic frame size applies globally to all FrameStores on the device.
  • Call CNTV2Card::GetFrameBufferSize to discover the current intrinsic frame size.
  • When any FrameStoreʼs NTV2FrameGeometry or NTV2PixelFormat changes, the intrinsic frame size can change. Since Frame Offsets are always multiples of the deviceʼs intrinsic frame size, this means that the Frame Offsets for all FrameStores can change whenever any FrameStoreʼs NTV2FrameGeometry or NTV2PixelFormat changes.
  • The following table shows a sampling of actual raster sizes for three pixel formats: 10-Bit YCbCr Format, 8-Bit ARGB, RGBA, ABGR Formats, and 48-Bit RGB.
    NTV2FrameGeometry NTV2Standard NTV2VANCMode Raster 10-bit YUV 8-bit RGBA 48-bit RGB
    NTV2_FG_720x486 SD 525i Off 720×486 0.89 MB 1.33 MB 2.00 MB
    NTV2_FG_720x508 SD 525i Tall 720×508 0.93 MB 1.40 MB 2.09 MB
    NTV2_FG_720x514 SD 525i Taller 720×514 0.94 MB 1.41 MB 2.12 MB
    NTV2_FG_720x576 SD 625i Off 720×576 1.05 MB 1.58 MB 2.37 MB
    NTV2_FG_720x598 SD 625i Tall 720×598 1.09 MB 1.64 MB 2.46 MB
    NTV2_FG_720x612 SD 625i Tall 720×612 1.12 MB 1.68 MB 2.52 MB
    NTV2_FG_1280x720 HD 720p Off 1280×720 2.37 MB 3.52 MB 5.27 MB
    NTV2_FG_1280x740 HD 720p Tall 1280×740 2.44 MB 3.61 MB 5.42 MB
    NTV2_FG_1920x1080 HD 1080 Off 1920×1080 5.27 MB 7.91 MB 11.9 MB
    NTV2_FG_1920x1112 HD 1080 Taller 1920×1112 5.43 MB 8.14 MB 12.2 MB
    NTV2_FG_1920x1114 HD 1080 Tall 1920×1114 5.44 MB 8.16 MB 12.2 MB
    NTV2_FG_2048x1080 HD 2K×1080 Off 2048×1080 5.67 MB 8.44 MB 12.7 MB
    NTV2_FG_2048x1112 HD 2K×1080 Tall 2048×1112 5.84 MB 8.69 MB 13.0 MB
    NTV2_FG_2048x1114 HD 2K×1080 Taller 2048×1114 5.85 MB 8.70 MB 13.1 MB
  • After a geometry and/or pixel format change, when the required raster size of any FrameStore exceeds 8MB, the firmware automatically increases the intrinsic frame size to 16MB.
    • After switching to 16MB, note that the frame buffer capacity of the device is cut in half. For example, if a device could store 100 × 8MB frames, after the bump to 16MB, it will only hold 50 frames.
      • WARNING: This can adversely affect AutoCirculate streaming. For example, if frame buffers 45 thru 55 were used for AutoCirculate Capture using 8MB offsets, after the switch to 16MB, frames 50 thru 55 would be invalid, and “out of bounds”, resulting in undefined behavior.
  • Conversely, when no FrameStores require 16MB frame sizes, the firmware automatically reverts the intrinsic frame size to 8MB. (However, on some devices, this behavior can be changed. See below.)
  • Most devices automatically switch to the larger 16MB size whenever NTV2VANCMode is enabled (i.e. “tall” or “taller”) on any FrameStore.
  • WARNING: On devices with more than one FrameStore, if any other FrameStores are streaming video in their respective frame buffer ranges when the instrinsic frame size changed, there will be a noticeable glitch in their captured or outgoing video streams.
    • Most devices can be pre-set and locked to 16MB to avoid Frame Size switching (and prevent video glitching).
    • Call NTV2DeviceSoftwareCanChangeFrameBufferSize to determine if the device supports this 16MB pre-set/lock feature.
    • Call CNTV2Card::SetFrameBufferSize(NTV2_CHANNEL1, ::NTV2_FRAMESIZE_16MB); to set the larger size in advance.
  • UHD/4K and UHD2/8K Frame Offsets
    • UHD/4K — Frame Offsets are 4 times the 8MB/16MB intrinsic frame size. This means that, from the FrameStoreʼs point of view, the deviceʼs frame capacity drops by ¼ when configured for UHD/4K video.
    • UHD2/8K — Frame Offsets are 16 times the 8MB/16MB intrinsic frame size. This means that, from the FrameStoreʼs point of view, the deviceʼs frame capacity drops by a factor of 16 when configured for UHD2/8K video.
  • Frame Range Considerations When Streaming Both SD/HD and UHD/4K/8K
    • It can be tricky to determine frame ranges for SD/HD, UHD/4K, and/or UHD2/8K streams that won't interfere with each other.
    • UHD/4K frame offsets are 4 times larger than the intrinsic SD/HD offsets.
    • UHD2/8K frame offsets are 16 times larger than the intrinsic SD/HD offsets.
    • Example: A device with SDRAM for up to 120 × 8MB frames must operate three streams, each with a 10-frame latency:
      • Channel 1: continuous playout of UHDp60 from 8-bit ARGB;
      • Channel 2: Capture various, intermittent video signals up to 1080p as 48-bit RGBA; the signals come and go;
      • Channel 3: Non-stop capture of continuous 525i SD signal as 10-bit YCbCr;
      • Solution:
        • The intrinsic frame size of 8MB is too small to accommodate 1080p rasters at 48-bit RGB (11.9MB). Therefore, to avoid glitches, the device will be pre-set to 16MB before starting any streams. The deviceʼs frame capacity is now only 60 × 16MB frames.
        • On Channel 1, AutoCirculate Playout UHD frames 0 thru 9. Because each UHD frame uses 4 intrinsic frames, the first available 16MB frame after this channelʼs buffers is frame 40.
        • On Channel 2, when a valid signal is received, AutoCirculate Capture frames 40 thru 49.
        • On Channel 3, AutoCirculate Capture frames 50 thru 59.
    • “NTV2Watcher” has a “Memory Map” Tool that helps visualize device memory utilization.

Host Buffer Locking

A DMA transfer using CNTV2Card::AutoCirculateTransfer, CNTV2Card::DMAReadFrame, CNTV2Card::DMAWriteFrame, etc. requires the NTV2 device driver to perform these operations (ignoring some OS-dependent variations):

  1. map the host buffer into kernel memory address space;
  2. map and lock those pages into physical memory, where they must remain for the duration of the transfer;
  3. build the segment list (or scatter-gather list) of memory segments for the DMA transfer (which also must remain in physical memory for the duration of the transfer);
  4. perform the DMA transfer;
  5. unmap/unlock all pages from physical (and kernel) memory.

The mapping, locking and segment list construction steps can consume a substantial portion of the Per-Frame “Time Budget”, especially with larger rasters and/or pixel formats, which can contribute to frame-drops.

In most use cases, client applications re-use the same host buffers over and over again. A substantial time savings can be realized if those host buffers are pre-locked and wired down into physical memory before entering the frame-processing loop (where CNTV2Card::AutoCirculateTransfer or CNTV2Card::DMAReadFrame or CNTV2Card::DMAWriteFrame are called).

Starting in SDK 16.0, new DMA API functions were added for this purpose:

  • CNTV2Card::DMABufferLock — maps and locks down a host buffer into physical memory.
    • Starting with SDK 16.0.1, an optional parameter was added to also have the driver pre-build and cache the segment map (SGL) from the pre-locked buffer.
  • CNTV2Card::DMABufferUnlock — unlocks and unmaps a host buffer that was previously locked.
    • Starting in SDK 16.0.1, this also frees any previously cached segment map (SGL).

Video Output Clocking & Synchronization

  • NTV2 devices have one output clock that drives all SDI outputs.
  • When SDI output(s) are routed and connected, then output synchronization must be considered.

“Capture-Only”

In Capture mode, the device firmware will calculate each input signal’s timing independently. If these signals are routed to FrameStores that are operating in Capture mode, the FrameStores will each signal VBIs independently at the correct time. For example:

  • Repeated calls to CNTV2Card::WaitForInputVerticalInterrupt(NTV2_CHANNEL2) will occur at 50Hz;
  • Repeated calls to CNTV2Card::WaitForInputVerticalInterrupt(NTV2_CHANNEL3) will occur at 24Hz.

On older devices with more than one FrameStore and “uniformat” firmware (deprecated starting in SDK 17.0), the input signals can still be captured independently, but they must be in the same frame rate “family” (i.e. Clock Family) as the overall device video format:
Related Clock Families:

  • 24 / 48
  • 25 / 50 (PAL)
  • 29.97 / 59.94 (NTSC)
  • 30 / 60 / 120

Devices with one FrameStore are essentially “uniformat” by nature.

“Capture & Playout”

Add a route from FrameStore4 to SDIOut4, configuring the FrameStore for 1080i2997 playout:

In this scenario, there are now three output synchronization options:

  1. Clock the output signal independently of the inputs and any other reference using the device’s internal clock. In this case, call CNTV2Card::SetReference with NTV2_REFERENCE_FREERUN.
  2. Sync the outputs to a 29.97Hz (or 59.94Hz) external reference. For this case, call CNTV2Card::SetReference with NTV2_REFERENCE_EXTERNAL.
  3. Sync the outputs to one of the SDI inputs. But note that this option is not viable in this example, because none of the input signals have 2997 or 5994 timing.

If multiple input signals from the same Clock Family are feeding the device, it’s probably impossible to lock to them all, unless they’re all sync’d to a common timebase (often called “house reference”) … otherwise, the signals will all drift over time with respect to each other. For example, one signal may just be starting a new frame, while another is already half-way through its frame. Since the device clock can’t lock to more than one of them, NTV2_REFERENCE_FREERUN must be used, to clock the outputs from the device’s own internal clock source. Note that setting “free run” isn’t technically necessary — the application would run just as well locked to one of the input signals, with the only difference being when the output signals would actually come out of the BNCs.

“End-to-End” (“E-E”)

Add a route from SDIIn2 to SDIOut4 (assume this route is actually implemented in the firmware):

This can be done either directly, as shown, or indirectly (for example, through a Mixer/Keyer widget). This requires the device’s output timing to be locked to the input signal. In this case, call CNTV2Card::SetReference with NTV2_REFERENCE_INPUT2.

When the reference source is set to an SDI input, the output signal(s) will be locked to the same timebase as that of the designated source’s signal. For this to work, the output video format must have a frame rate in the same Clock Family as that being received at the SDI input. The actual output signal will exit the BNCs with about 2~3 lines of delay due to signal propagation through device circuitry, but the important point is that the phase relationship between the reference input signal and the output signal will be fixed, and will not drift.

Note
For historical reasons, if SDI Input 1 is used for input and a signal is present, its signal frame rate dictates the Clock Family for all SDI outputs. When operating the device in multiformat mode, it’s therefore best to always use NTV2_CHANNEL1 as an output/playout channel, and use the other channels for input, as they don’t have the Clock Family restriction or any effect on the outputs.

External Reference

If the device’s output(s) must have a given timing (e.g., to feed a switcher), then applications can pass NTV2_REFERENCE_EXTERNAL to CNTV2Card::SetReference, which will lock the device to an analog or tri-level sync signal connected to the device’s external reference input.

To determine the video format of the signal being applied to the reference input, call CNTV2Card::GetReferenceVideoFormat.

Note
For AJA devices that have a single BNC connector for Reference and LTC input — i.e. if NTV2DeviceCanDoLTCInOnRefPort returns true, you must call CNTV2Card::SetLTCInputEnable and pass it false before calling CNTV2Card::GetReferenceVideoFormat. If the reference input port is configured to read LTC, CNTV2Card::GetReferenceVideoFormat will always return NTV2_FORMAT_UNKNOWN.
When configured for NTV2_REFERENCE_EXTERNAL, the device output will internally revert to Free-Run if the reference signal disappears or is incompatible with the output video format. When there’s no signal detected at the external reference connector, AJA recommends setting the device reference to NTV2_REFERENCE_FREERUN.

Field/Frame Interrupts

Many device hardware registers are updated on the video frame sync (i.e. the VBI associated with the start of a new frame). This is determined by the FrameStore’s NTV2RegisterWriteMode and is normally set to NTV2_REGWRITE_SYNCTOFRAME.

For example, CNTV2Card::SetInputFrame is called by the client application to instruct the device’s FrameStore to write the next video frame that arrives into a specific frame buffer number in device memory. The function call immediately changes the FrameStore’s Input Frame register, but internally, the device firmware ensures that the FrameStore uses the new frame number value at the next NTV2_FIELD0 (first field in time) sync pulse. (To avoid a race condition, though, the client application must wait for the VBI, which gives it an entire frame time to update hardware registers and configure the device widget settings that are required for the next frame to be processed.)

For interlaced video, where the frame is transmitted as two fields, each field contains every other line of the frame. For HD video, the first field in time contains the first active line of the frame (i.e. the “top field” a.k.a. NTV2_FIELD0 a.k.a. F1); the second field contains the last active line of the frame (i.e. the “bottom field” a.k.a. NTV2_FIELD1 a.k.a. F2). Each field starts with a video sync — however, normally, in NTV2_REGWRITE_SYNCTOFRAME mode, the hardware registers are only updated at the NTV2_FIELD0 sync. Each of the syncs (NTV2_FIELD0 and NTV2_FIELD1 ) signals an interrupt to the driver, but CNTV2Card::WaitForInputFieldID (or CNTV2Card::WaitForOutputFieldID) check a hardware register and return only when the requested NTV2FieldID is detected.

The FrameStore can alternatively be configured for Field Mode by passing NTV2_REGWRITE_SYNCTOFIELD into CNTV2Card::SetRegisterWriteMode, which causes calls to CNTV2Card::SetInputFrame or CNTV2Card::SetOutputFrame to take effect at the next field interrupt. In this mode of operation, the client application must wait for the next field interrupt – not frame interrupt – which gives it half the frame time to prepare/configure the device for the next field to be processed.

For progressive video, all syncs are flagged by the hardware as NTV2_FIELD0 syncs, so registers are updated for the next frame and the CNTV2Card::WaitForInputFieldID (or CNTV2Card::WaitForOutputFieldID) work as expected.

To wait for an event (such as a VBI) from a particular FrameStore, your application should subscribe to it by calling CNTV2Card::SubscribeInputVerticalEvent or CNTV2Card::SubscribeOutputVerticalEvent.

Once subscribed, to efficiently wait for an input vertical interrupt, call CNTV2Card::WaitForInputFieldID or CNTV2Card::WaitForInputVerticalInterrupt, referencing the FrameStore that’s configured for capture, and that’s routed (directly or indirectly) from an input that has a valid video signal.

To efficiently wait for an output vertical interrupt, call CNTV2Card::WaitForOutputFieldID or CNTV2Card::WaitForOutputVerticalInterrupt, referencing the FrameStore that’s configured for playout.

The number of input or output vertical events that have successfully been waited on and fired can be obtained by calling CNTV2Card::GetInputVerticalEventCount or CNTV2Card::GetOutputVerticalEventCount. By calling either of these methods before and after calling the “wait for input/output” function, you can determine if the interrupt event actually triggered. Call CNTV2Card::SetInputVerticalEventCount or CNTV2Card::SetOutputVerticalEventCount to reset the tally counter.

Normally it’s not necessary to explicitly unsubscribe the CNTV2Card instance’s event subscriptions, as its destructor automatically does this when it calls CNTV2Card::Close.

Note
On the Windows platform, the AJA NTV2 driver stores a finite number of event subscription handles for client applications, which get consumed with every Subscribe… call (e.g. CNTV2Card::SubscribeInputVerticalEvent, etc.), and are freed with every Unsubscribe… call (e.g. CNTV2Card::UnsubscribeInputVerticalEvent, etc.). Prior to SDK/driver version 16.2.3, abnormal program terminations, crashes, or force-quitting client apps from a debugger prevented the driver from freeing the subscription handles, which, after many repetitions, would exhaust the subscription handles. To recover from this, you had to…
  • reboot the machine, or…
  • manually disable and re-enable the AJA driver (after closing all running NTV2 client applications, including the AJA Service, or…
  • set virtual register kVRegClearAllSubscriptions to a non-zero value (which can be easily done in “NTV2Watcher” tool’s Registers Inspector ). Starting in version 16.2.3, the driver now automatically unsubscribes and frees its subscribed event handles when the CNTV2Card instance is destructed.

When FrameStores Access the Same Frame Buffer Memory

Note that it’s possible (and quite easy) to have two or more FrameStores accessing the same frame buffer memory.

Here’s an example where this would be really bad:

CNTV2Card device;
if (CNTV2DeviceScanner::GetFirstDeviceFromArgument("0", device))
{
// Assume this device has valid video signals at SDI Inputs 1 and 2
// (same video format, different content)...
device.ClearRouting(); // Clear all existing connections
device.EnableChannel(NTV2_CHANNEL1); // Enable FrameStore 1
device.SetMode(NTV2_CHANNEL1, NTV2_MODE_CAPTURE); // Set FrameStore 1 to capture mode
device.SetSDITransmitEnable(NTV2_CHANNEL1, false); // Set SDI connector 1 to capture
device.Connect(NTV2_XptFrameBuffer1Input, NTV2_XptSDIIn1); // Connect SDI In 1 to FrameStore 1
device.SetInputFrame(NTV2_CHANNEL1, 0); // Write FrameStore 1 video into frame buffer 0
device.EnableChannel(NTV2_CHANNEL2); // Enable FrameStore 2
device.SetMode(NTV2_CHANNEL2, NTV2_MODE_CAPTURE); // Set FrameStore 2 to capture mode
device.SetSDITransmitEnable(NTV2_CHANNEL2, false); // Set SDI connector 2 to capture
device.Connect(NTV2_XptFrameBuffer2Input, NTV2_XptSDIIn2); // Connect SDI In 2 to FrameStore 2
device.SetInputFrame(NTV2_CHANNEL2, 0); // Write FrameStore 2 video into frame buffer 0
}

In this case, there are two video signals fighting to write video rasters into the same frame memory on the device. If this frame were to be transferred to host memory, the image would look torn, a bad mixture of frames from SDI inputs 1 and 2.

On the other hand, FrameStores sharing the same frame buffer memory can be beneficial, for example, as a Frame Synchronizer. Here’s an example of how to synchronize an SDI signal with the AJA device’s free-running output clock:

CNTV2Card device;
if (CNTV2DeviceScanner::GetFirstDeviceFromArgument("0", device))
{
// Assume this device has a valid video signal at SDI Input 1:
device.ClearRouting(); // Clear all existing connections
device.EnableChannel(NTV2_CHANNEL1); // Enable FrameStore 1
device.SetMode(NTV2_CHANNEL1, NTV2_MODE_CAPTURE); // Set FrameStore 1 to capture mode
device.SetSDITransmitEnable(NTV2_CHANNEL1, false); // Set SDI connector 1 to capture
device.Connect(NTV2_XptFrameBuffer1Input, NTV2_XptSDIIn1); // Connect SDI In 1 to FrameStore 1
device.SetInputFrame(NTV2_CHANNEL1, 0); // Write FrameStore 1 video into frame buffer 0
device.SetReference(NTV2_REFERENCE_FREERUN); // Free run the outputs
device.EnableChannel(NTV2_CHANNEL2); // Enable FrameStore 2
device.SetMode(NTV2_CHANNEL2, NTV2_MODE_DISPLAY); // Set FrameStore 2 to playout mode
device.SetOutputFrame(NTV2_CHANNEL2, 0); // Read FrameStore 2 video from frame buffer 0
device.SetSDITransmitEnable(NTV2_CHANNEL3, true); // Set SDI connector 3 to output
device.Connect(NTV2_XptSDIOut3Input, NTV2_XptFrameBuffer2YUV); // Connect FrameStore 2’s output to SDI Out 3
}

When AutoCirculate is used, AutoCirculate manages the FrameStore’s Input Frame register (capture) or Output Frame register (playout), repeatedly circulating it from the Start Frame to the End Frame (e.g., 0 thu 6). Another FrameStore can very easily write into any of the frames involved in another FrameStore’s AutoCirculate frame range. For example:

CNTV2Card device;
if (CNTV2DeviceScanner::GetFirstDeviceFromArgument("0", device))
{
// Assume this device has valid video signals at SDI Inputs 1 and 2
// (same video format, different content)...
device.ClearRouting(); // Clear all existing connections
device.EnableChannel(NTV2_CHANNEL1); // Enable FrameStore 1
device.SetSDITransmitEnable(NTV2_CHANNEL1, false); // Set SDI connector 1 to capture
device.Connect(NTV2_XptFrameBuffer1Input, NTV2_XptSDIIn1); // Connect SDI In 1 to FrameStore 1
device.AutoCirculateInitForInput(NTV2_CHANNEL1, 0, NTV2_AUDIOSYSTEM_INVALID, 0, 1, 0, 6); // AutoCirculate capture into FBs 0/1/2/3/4/5/6
device.AutoCirculateStart(NTV2_CHANNEL1); // Start AutoCirculate (assume another thread calls AutoCirculateTransfer)
// UH-OH: This code block will cause 1 of every 7 frames captured via AutoCirculate
// on NTV2_CHANNEL1 to be corrupted by video from SDI Input 2...
device.EnableChannel(NTV2_CHANNEL2); // Enable FrameStore 2
device.SetMode(NTV2_CHANNEL2, NTV2_MODE_CAPTURE); // Set FrameStore 2 to capture mode
device.SetSDITransmitEnable(NTV2_CHANNEL2, false); // Set SDI connector 2 to capture
device.Connect(NTV2_XptFrameBuffer2Input, NTV2_XptSDIIn2); // Connect SDI In 2 to FrameStore 2
device.SetInputFrame(NTV2_CHANNEL2, 3); // Write FrameStore 2 video into frame buffer 3
}

Color Space Converter Operation

A Color Space Converter (a.k.a. CSC) is a device widget implemented in FPGA firmware that converts YCbCr values into RGB[A] values, or vice-versa. It uses several registers to configure its conversion properties.

  • Generally, there is one CSC for every SDI connector. NTV2DeviceGetNumCSCs can be used to determine the number of CSCs on a given device, which should match NTV2DeviceGetNumVideoInputs or NTV2DeviceGetNumVideoOutputs (whichever is larger).
  • CSC widgets are identified by NTV2_WgtCSC1, NTV2_WgtCSC2, etc., but are normally identified in SDK calls by an NTV2Channel value that represents a zero-based index number.
  • Each CSC has two inputs:
    • Video Input: This input should be routed to another widget’s output that produces…
      • YCbCr video — in which case the CSC will produce valid RGB[A] data at its RGB Video output.
      • RGB[A] video — in which case the CSC will produce valid YCbCr video at its YUV Video output, and alpha channel video at its Key YUV output.
    • Key Input: This supplies alpha channel data for the CSC’s RGB Video output. When used, it should always be sourced with YCbCr video (never RGB).
  • Each CSC has 3 outputs:
    • YUV Video: This produces valid YCbCr video data only when the CSC’s Video Input is receiving RGB[A] video.
    • RGB Video: This produces valid RGB[A] video data only when the CSC’s Video Input is receiving YCbCr video.
    • Key YUV: This produces valid YCbCr key data only when the CSC’s Video Input is receiving RGB[A] video.
  • Routing instructions are in the widget_csc section in the Widget Signal Routing section.
  • The CSC’s conversion coefficients are adjusted based on “SMPTE” versus “Full” range.
  • The CSC’s conversion matrix can be set to “Rec. 601” (SD) or “Rec. 709” (HD).
YCbCr to RGB Conversion
  • When the CSC’s Video Input is connected to a YUV video source, it will convert and provide RGB data on its “RGB” output crosspoint.
  • In addition to the YCbCr-to-RGB value conversion, the CSC also performs the necessary 4:2:2 up-sampling to fill the “missing” pixels in the outgoing RGB raster.
  • The CSC will produce an opaque alpha channel by default.
  • It can produce alpha channel data from YCbCr video supplied to its Key Input (using just the luma channel) — provided it’s configured to do so:

The conversion formulæ:

// Full-range 8-bit “Rec 601” (SD) conversion:
R = 1.164384 * y + 0.000000 * cb + 1.596027 * cr;
G = 1.164384 * y - 0.391762 * cb - 0.812968 * cr;
B = 1.164384 * y + 2.017232 * cb + 0.000000 * cr;
// SMPTE-range 8-bit “Rec 601” (SD) conversion:
R = 1.000000 * y + 0.000000 * cb + 1.370705 * cr;
R = 1.000000 * y - 0.336455 * cb - 0.698196 * cr;
R = 1.000000 * y + 1.732446 * cb + 0.000000 * cr;
// Full-range 10-bit “Rec 601” (SD) conversion:
R = 1.167808 * y + 0.000000 * cb + 1.600721 * cr;
G = 1.167808 * y - 0.392915 * cb - 0.815359 * cr;
B = 1.167808 * y + 2.023165 * cb + 0.000000 * cr;
// SMPTE-range 10-bit “Rec 601” (SD) conversion:
R = 1.0000008 * y + 0.000000 * cb + 1.370705 * cr;
G = 1.0000008 * y - 0.336455 * cb - 0.698196 * cr;
B = 1.0000008 * y + 1.732446 * cb + 0.000000 * cr;
// Full-range 10-bit “Rec 709” (HD) conversion:
R = 1.167808 * y + 0.000000 * cb + 1.798014 * cr;
G = 1.167808 * y - 0.213876 * cb - 0.534477 * cr;
B = 1.167808 * y + 2.118615 * cb + 0.000000 * cr;
// SMPTE-range 10-bit “Rec 709” (HD) conversion:
R = 1.000000 * y + 0.000000 * cb + 1.539648 * cr;
G = 1.000000 * y - 0.183143 * cb - 0.457675 * cr;
B = 1.000000 * y + 1.814180 * cb + 0.000000 * cr;
Note
The 8-bit and 10-bit coefficients are NOT the same, since the RGB 10-bit white point (1023) is not simply 4 × the 8-bit RGB white point (255).
RGB to YCbCr Conversion
  • When the CSC’s Video Input is fed RGB[A] video, it will convert and provide YUV data on its “Video” and “Key” output crosspoints.
  • In addition to the RGB-to-YCbCr value conversion, it also performs the necessary 4:2:2 down-sampling (implemented as a low-pass filter) for the fewer samples in the outgoing YUV raster.
  • The Key Output luma channel data is scaled appropriately from the incoming alpha channel data. Its outgoing Cb and Cr component values are fixed at 0x200.

The conversion formulæ:

// Full-range 10-bit “Rec 601” (SD) conversion:
Y = 0.25604 * r + 0.50265 * g + 0.09762 * b;
Cb = -0.14779 * r - 0.29014 * g + 0.43793 * b;
Cr = 0.43793 * r - 0.36671 * g - 0.07122 * b;
// SMPTE-range 10-bit “Rec 601” (SD) conversion:
Y = 0.29900 * r + 0.58700 * g + 0.11400 * b;
Cb = -0.17259 * r - 0.33883 * g + 0.51142 * b;
Cr = 0.51142 * r - 0.42825 * g - 0.08317 * b;
// Full-range 10-bit “Rec 709” (HD) conversion:
Y = 0.18205 * r + 0.61243 * g + 0.06183 * b;
Cb = -0.10035 * r - 0.33758 * g + 0.43793 * b;
Cr = 0.43793 * r - 0.39777 * g - 0.04016 * b;
// SMPTE-range 10-bit “Rec 709” (HD) conversion:
Y = 0.21260 * r + 0.71520 * g + 0.07220 * b;
Cb = -0.11719 * r - 0.39423 * g + 0.51142 * b;
Cr = 0.51142 * r - 0.46452 * g - 0.04689 * b;
Enhanced CSCs

Some AJA devices support “enhanced” CSC firmware that is used to override the default Rec 601 and Rec 709 conversion offsets and coefficients. Call NTV2DeviceCanDoEnhancedCSC to determine if the device has the enhanced CSC firmware.

Widget Signal Routing

LUT Operation

A color Look Up Table (a.k.a. LUT) is a device widget implemented in FPGA firmware that converts specific input RGB values into other corresponding RGB values. It uses several registers to configure its conversion properties and a contiguous bank of registers for reading or writing the conversion table.

Note
LUTs only work with RGB video, not YCbCr.
  • For devices that have LUTs, there is usually one LUT for every FrameStore and/or SDI Input (or Output). Call NTV2DeviceGetNumLUTs to obtain the number of available LUTs.
  • LUT widgets are identified by NTV2_WgtLUT1, NTV2_WgtLUT2, …, but are normally identified in SDK calls by NTV2Channel, a zero-based, unsigned index number.
  • Each LUT widget has one input that only accepts RGB video.
  • Each LUT widget has two outputs — YUV and RGB — that carry the converted video. The YUV output carries the luminance of the converted video in the Y channel.
  • The NTV2DeviceGetLUTVersion function returns the version number of the LUT widget firmware implementation.
  • The conversion is performed on a per-component basis using 10 bits of precision.
  • The 10-bit Red, Green, or Blue component value (0x000 thru 0x3FF) is used as the index into the respective R, G, or B table to fetch the converted output value, another 10-bit value in the range 0x000 thru 0x3FF.
  • LUTs have two independent banks, only one of which is actively converting input video.
  • There is currently no API call that reads the Red, Green and/or Blue conversion table values for a particular bank of a given LUT. (It can be done, but a control register must be configured before and after calling CNTV2Card::ReadLUTTables.)
  • To change the Red, Green and/or Blue conversion table values for a particular bank:
    • Build a 1,024-element std::vector of UWord or double values for each R, G and/or B component. Each value in the array should be in the range 0 - 1023 or 0.00 - 1023.00, respectively.
    • Call CNTV2Card::DownloadLUTToHW. The array values will automatically be clamped to the legal range 0x000 thru 0x3FF prior to being written to the device.
  • Some newer device firmware supports 12-bit LUTs. In 12-bit mode, the LUT table is expanded in size to 4,096 values per component, and the legal (output) values assume the range 0x000 - 0xFFF.
  • See widget_lut for a discussion on how to route signals to and from LUT widgets.
  • The “NTV2Watcher” tool’s LUT Inspector can be used to inspect and/or modify LUT configuration.
Note
The reading and writing of any 10-bit “version 2” LUT bank table data flows through registers 512-2047, with host access controlled by register 376 (kRegLUTV2Control). There is no software mutex guarding access to this register, so calls to read or write the tables are not thread-safe.
Widget Signal Routing

Mixer/Keyer Operation

A Mixer/Keyer is a device widget implemented in FPGA firmware that mixes or “keys” YCbCr video. It uses a pair of registers for configuring its mixing/keying properties.

Note
Mixer/Keyer widgets can only process YCbCr video — not RGB[A].
  • Generally, there is one mixer/keyer for every 2 FrameStores and/or SDI Inputs (or SDI Outputs). Call NTV2DeviceGetNumMixers to obtain the number of Mixer/Keyer widgets that are available.
  • Mixer/Keyer widgets are identified by NTV2_WgtMixer1, NTV2_WgtMixer2, …, but are normally identified in SDK calls by a zero-based, unsigned 16-bit index number.
  • Each Mixer/Keyer has two outputs — Video and Key — that contain the mixed/keyed output video.
  • Each Mixer/Keyer has four inputs:
    • two Foreground inputs — Video and Key — and…
    • two Background inputs — Video and Key.
    • Key Inputs only utilize Y-channel data — the Cb and Cr components are ignored.
    • IMPORTANT: The Mixer’s foreground and background inputs must be closely synchronized or the Mixer won’t be able to mix them. If the Mixer is unlocked, its outputs will send unclocked (garbage) video.
  • Each Mixer/Keyer has the following configuration parameters:
  • For information on how to route signals to and from the Mixer, see widget_mixkey.
  • The “NTV2Watcher” tool’s Mixer/Keyer Inspector allows you to interactively view each Mixer/Keyer widget’s current configuration, as well as make changes to it.
Widget Signal Routing

High Dynamic Range (HDR) Video

HDR support was introduced in SDK 12.5.

SDI output: HDR data is delivered in-band using VPID signaling for SDR/HDR Transfer Characteristics, Colorimetry and Luminance.

HDMI output: Side-band information is used to inform an HDMI sink device (e.g. a monitor) that the video content is HDR. This includes generation of the Dynamic Range and Mastering Info-frame and the static metadata descriptors as defined in CTA-861.3 and HDMI v2.0a.

Check the device page in NTV2 Devices for any notes on HDR support for a given device. You can also call NTV2DeviceCanDoHDMIHDROut to determine if the device's HDMI output is capable of HDR.

HLG and HDR10 parameters are formatted in the dynamic mastering info frame based on the HDR values passed to specific CNTV2Card functions (e.g. CNTV2Card::SetHDMIHDRWhitePointY). The data does not need to be sequenced per-frame.

HDR10+ requires a vendor-specific info frame for each video frame. There is a way to pass custom HDMI info frames to the driver, however it was only a technology demonstration, and may not be supported in all drivers. Proper HDR10+ support is scheduled for a future SDK.

Dolby Vision support was added in SDK 13.0. Call CNTV2Card::EnableHDMIHDRDolbyVision method to enable or disable sending the Dolby Vision bit in the HDMI AVI info frame to the monitor. Note that Dolby Vision data is encoded, and is output as 8-bit RGB, with the metadata in the least significant bits of the video at the top of the frame. (The actual video itself is actually 12-bit YUV 4:2:2.) Client applications must properly encode the Dolby Vision metadata into the host frame buffer before transferring it to the device during playback.

Audio System Operation

Firmware Implementation

  • An Audio System consists of:
    • A Record engine that operates the Capture aspect of the Audio System (if NTV2DeviceCanDoCapture returns true):
      • when Running, continually writes audio samples into its 4MB input audio buffer region in device SDRAM, wrapping as necessary.
      • obtains audio samples from a designated source FIFO (see CNTV2Card::SetAudioSystemInputSource).
    • A Playback engine that operates the Playout aspect of the Audio System (if NTV2DeviceCanDoPlayback returns true):
      • when Running, continually reads audio samples from its 4MB output audio buffer region in device SDRAM, wrapping as necessary.
      • can drive destination/output/sink FIFO(s);
      • always sends silence (zeroes) when Stopped.
    • Several firmware registers are used to monitor and control each Audio System.
  • Audio sources (inputs) and destinations (outputs) have FIFOs associated with them that pipe/stream their audio data to/from other sinks/sources.
    • A source FIFO can drive an Audio System’s Record engine (for writing into device SDRAM), or it can feed another audio destination’s FIFO.
    • A destination (sink) FIFO can pull audio from an Audio System’s Playout engine (reading from device SDRAM), or it can pull from another audio source’s FIFO.
    • Depending on the transport chipset, they accommodate 2, 4, 8 or 16 channels of audio. Some are configurable (e.g. 2 or 8 channel HDMI audio).
    • SDI:
      • SDI inputs each have an audio de-embedder to decode incoming SMPTE 272M/299M HANC packets found in the input SDI stream, pushing audio into its (source) FIFO.
      • SDI outputs each have an audio embedder to encode and insert SMPTE 272M/299M HANC packets into the SDI stream, pulling audio from its (sink) FIFO.
        • The SDI audio embedder can be turned off, if desired.
        • “Loopback” audio play-through is implemented by tying an output FIFO to an input FIFO (see CNTV2Card::SetAudioLoopBack).
    • HDMI, AES/EBU and Analog audio are handled similarly.
      • Inputs receive audio, and push the samples into their associated source FIFO(s).
      • Outputs transmit audio, pulling from their associated sink FIFO(s).
    • There are bits in certain control registers that control where a destination/sink FIFO pulls its audio from.
Note
NTV2 devices with custom ancillary data extractors/inserters (see NTV2DeviceCanDoCustomAnc) make it possible to capture (and on some devices with special firmware, playback) SDI audio without using an Audio System, instead using the SDI Anc Packet Capture or SDI Anc Packet Playout capabilities. Also note the SDI Ancillary Data facility won’t work for HDMI, AES/EBU or Analog transports — the Audio System facility must be used.

Audio Systems

  • NTV2-compatible devices have a minimum of one Audio System (sometimes referred to in the past as an Audio Engine).
  • An Audio System can stream audio, whether in Capture (Record) mode, or Playout mode, or both.
  • Call NTV2DeviceGetNumAudioSystems to determine the number of Audio Systems on a device.

Audio Channels

  • Each Audio System can accommodate at least 8 channels of audio.
  • Call NTV2DeviceGetMaxAudioChannels to determine the maximum number of audio channels that a device’s Audio Systems can handle.
  • Call CNTV2Card::GetNumberAudioChannels to determine how many audio channels a device Audio System is currently configured for.
    • Modern AJA devices will accommodate up to 16 channels.
    • Very old AJA devices defaulted to 6 channels at power-up — these should be configured to use 8 channels.
  • Call CNTV2Card::SetNumberAudioChannels to change the number of audio channels a device Audio System is configured to use.
    Note
    AJA recommends configuring the Audio System to use the maximum number of audio channels the device is capable of.
  • HDMI Audio — The HDMI standard supports a minimum baseline of 2 audio channels up to a maximum of 8.
  • AES/EBU Audio — The AES/EBU connectors (on cables or breakout boxes) support 8 audio channels.
  • Analog Audio — Analog audio connectors (on cables or breakout boxes) support 4 or 8 audio channels.
  • Monitor Audio — Audio monitoring (RCA and/or headphone jacks) supports 2 audio channels.
  • The firmware automatically ensures that excess unused audio channels will capture silence or be ignored for playout. For example, an Audio System that’s been configured for 16 channels and is recording 2 HDMI audio channels will carry the HDMI audio in channels 1 and 2, and contain silence in channels 3 thru 16.
  • Note that some SDI video formats have substantially reduced HANC capacity, and thus can only carry 8 audio channels (e.g. 2K×1080@2997, 2K×1080@30, 4K@29.nosp@m..97, 4K@30). Again, the Audio System can still operate in 16-channel mode, but will capture and/or playout silence in channels 9-16.

Audio Sample Rate

Audio Buffers

  • Each Audio System uses an 8 MB contiguous block of memory located in the upper part of SDRAM:
  • An NTV2 device will use one of these two memory configurations for its Audio Systems’ buffers:
    • “Stacked” — The first Audio System’s 8 MB chunk starts at the very top of SDRAM, such that the last byte of Audio System 1’s Input Buffer coincides with the last addressable byte of SDRAM. Subsequent Audio Systems’ buffers stack downward from there, 8 MB each.
    • “Non-stacked” — These devices use the last one or two video frames for audio storage. The first byte of the last Audio System’s Output Buffer coincides with the first byte of the last frame buffer in device memory. Previous Audio System buffers, if any, start at the next-lower 8MB frame buffer.
  • Call NTV2DeviceCanDoStackedAudio to determine if the device uses the “stacked” arrangement or not.
  • The first (lower address) 4 MB of the Audio System’s 8 MB chunk is for Audio Output.
  • The last (higher address) 4 MB of the Audio System’s 8 MB chunk is used for Audio Input.
  • Each Output or Input aspect of the Audio System operate independently, each being in one of two states:
    • Stopped — a.k.a. the “Reset” state.
    • Running — When the Input or Output aspect of the Audio System is Running, eight or sixteen channels (see CNTV2Card::GetNumberAudioChannels) of audio are always written/read to/from this memory, regardless of whether all 8 or 16 channels are used.
  • See Audio Data Formats for details on the format of the audio data in the buffer.
Note
Older “Non-stacked” audio devices (e.g. KONA LHi) had audio systems that could operate with 1MB or 4MB buffers, and typically started (at power-up) in 1MB mode. This design was abandoned in favor of fixed 4MB buffers, which the NTV2 SDK generally assumes are in use. Applications that use “Non-stacked” devices are strongly recommended, when first configuring the device, to first call CNTV2Card::GetAudioBufferSize to determine the current buffer size, and if it’s not 4MB, set it to 4MB mode by calling CNTV2Card::SetAudioBufferSize with NTV2_AUDIO_BUFFER_SIZE_4MB. Before relinquishing control of the device, its prior (saved) buffer size should be restored.
Warning
It is easy to write video data into an audio buffer and vice-versa, which leads to noisy, garbled audio and/or bad video frame(s). SDK clients must take precautions to ensure that frame buffers used by your application never coincide with any of the audio buffers.
Note
The “NTV2Watcher” tool’s Audio Inspector allows you to monitor each Audio System’s capture or playout buffer, as well as inspect or change its current configuration.
Warning
A fixed 4MB audio buffer necessarily places a maximum time limit … and therefore an upper limit on the number of frames of audio that can be buffered. For example, 4MB will hold up to 1.37 seconds of 16-channel audio, or 2.73 seconds of 8-channel audio. At 60 fps, that’s 82 or 164 frames, respectively; or at 29.97 fps, that’s 41 or 82 frames. Modern NTV2 devices have a large enough SDRAM complement such that it’s easy to buffer hundreds of video frames on the device, which can readily exceed the maximum frames of audio that can be buffered. CNTV2Card::AutoCirculateInitForInput or CNTV2Card::AutoCirculateInitForOutput will emit a warning in “AJA Logger” or the ‘logreader’ Command-Line Utility if the requested number of video frames to buffer exceeds the audio buffering capacity. (Be sure to enable the AutoCirculate_39 message group to see these messages.)

Audio Connectors

Some AJA devices have additional audio connectors: AES, analog, headphone and/or microphone.

AES Audio

  • AES Inputs
    • Call NTV2DeviceGetNumAESAudioInputChannels to determine how many AES inputs a device has.
    • Electrical Characteristics:
      • DC-coupled input terminated with 75Ω to ground
      • Minimum input level: 100 mV peak-to-peak
  • AES Outputs
    • Call NTV2DeviceGetNumAESAudioOutputChannels to determine how many AES outputs a device has.
    • Electrical Characteristics:
      • AC-coupled output terminated with 75Ω to ground
      • Output level: 1.55 Volts peak-to-peak, ±10%, terminated into 75Ω

Analog Audio

Headphone Connector

Microphone Connector

Audio Capture

For devices that are capable of capturing video, each Audio System constantly extracts audio samples from its Input Source (assuming the source is locked to a valid signal). If there’s no input signal, the Audio System invents zero values (silence) across all audio channels.

  • Generally, the Input Source is selectable, to receive samples from any of the device’s video (and possibly audio) Input Sources, including embedded SDI, HDMI, external AES and analog inputs.
  • SDI Sources: Audio samples are de-embedded from incoming audio HANC packets:
    • HD: follows SMPTE 299M: Each audio sample consists of 24 bits of sample data (normally PCM).
    • SD: follows SMPTE 272M: Each audio sample consists of 20 bits of PCM sample data — audio extended packets are ignored.
    • For devices that support 3Gb Level B inputs, the audio can be taken from data stream 1 or 2.
    • Missing Embedded Audio Group packets (each containing two audio channel pairs) in the data stream result in silence (zeroes) for their respective audio channels.
    • The firmware continually notes which Embedded Audio Group packets are present and which are missing, and coalesces this information into a hardware register. Call CNTV2Card::GetDetectedAudioChannelPairs to query this information.
  • HDMI Sources: Audio samples are pulled from the HDMI input hardware.
    • Call CNTV2Card::GetHDMIInputAudioChannels to determine if the HDMI input is supplying 2 or 8 channels of audio.
    • Call CNTV2Card::SetHDMIInputAudioChannels to change the HDMI audio input configuration.
  • AES: Audio samples are obtained from the AES inputs.
  • Analog:

When the Audio System is running, each 24-bit sample is copied as-is into the most-significant 3 bytes of each 4-byte sample word in the Audio Input Buffer in device memory at the address specified by the Audio System’s Audio Input Last Address register (i.e., the Record Head or “write head”).

  • On older (non-stacked-audio) devices, this sample-copying process is done in 128-byte chunks.
  • On newer (stacked-audio) devices, 512-byte chunks are used.
  • Call CNTV2Card::IsAudioInputRunning to determine if the capture side of the Audio System is running or not.
  • Call CNTV2Card::StartAudioInput to start the capture aspect of the Audio System running.
  • Call CNTV2Card::StopAudioInput to stop the capture aspect of the Audio System running.
  • Call CNTV2Card::SetAudioCaptureEnable to enable or disable writing into the Audio System’s Input Buffer memory. Note that Input Buffer writing can be disabled while the Audio System is running — the Audio System will continue to go through the motions of Capture, advancing the Record Head as needed, but the Input Buffer’s contents won’t change.

Call CNTV2Card::ReadAudioLastIn to obtain the current Record Head position. Audio data continues to be written into the Input Buffer until filled, whereupon the Record Head wraps back to the start of the buffer, where writing continues. The least-significant byte of each 32-bit sample word in the Audio Input Buffer is always set to zero. (Note that for SD, because extended packets are ignored, an extra 4-bit nibble in each 32-bit sample word will also be zero.)

Audio data can be transferred from the Audio Input Buffer in device memory to a host audio buffer via DMA by calling CNTV2Card::DMAReadAudio. While the offset to the Input portion of the device Audio Buffer is typically fixed at 4 MB, to be absolutely safe should this ever change, call CNTV2Card::GetAudioReadOffset to obtain the actual offset being used by the driver and SDK.

Note
If AutoCirculate is used for capture, AutoCirculate completely and automatically runs the Audio System — there is no need to call CNTV2Card::StartAudioInput or CNTV2Card::SetAudioCaptureEnable. When CNTV2Card::AutoCirculateInitForInput is called with a valid NTV2AudioSystem, and CNTV2Card::AutoCirculateStart is subsequently called, AutoCirculate starts the Audio System. CNTV2Card::AutoCirculateTransfer automatically transfers the correct number of captured audio samples from the device Audio System’s Input Buffer that are associated with the video frame being transferred. AUTOCIRCULATE_TRANSFER::GetCapturedAudioByteCount will return the exact number of transferred audio bytes for the frame that was just transferred to the host. See AutoCirculate Capture for more information.

Upstream equipment may indicate one or more audio channel pairs is not carrying PCM data (e.g., Dolby-E) via certain bits in the AES header in the audio stream. On newer AJA devices (see NTV2DeviceCanDoPCMDetection), the Audio System’s de-embedder makes this information available in a hardware register, and client software can query it by calling CNTV2Card::GetInputAudioChannelPairsWithoutPCM or CNTV2Card::InputAudioChannelPairHasPCM.

Note
Dolby AC-3, for example, per SMPTE ST-337, is transported as non-PCM data in the SDI AES stream. The AC-3 data is located in the PCM audio sample words of a channel pair — see Audio Data Formats . The formatting of the AC-3 data into the channel pairs is quite flexible, but usually a channel pair (e.g. 5&6) is considered a single AC-3 stream. The specification allows AC-3 data to be carried in 16, 20 or 24 bits of the PCM sample. This flexibility requires the application to know how the source has formatted the data into the AES samples.

Newer AJA hardware firmware implements an adjustable input delay that can be applied while samples are being written into the Audio Input Buffer. Call NTV2DeviceCanDoAudioDelay to determine if this feature is available. Call CNTV2Card::GetAudioInputDelay to obtain the current delay value. Call CNTV2Card::SetAudioInputDelay to change it.

Audio input clocking for the running Audio System is ordinarily obtained from the input signal being used (SDI, HDMI, Analog, etc.). AJA’s older devices, however, derived the audio input clock from the Device Reference by default (see NTV2ReferenceSource) and had to be explicitly configured to use the input signal by passing NTV2_EMBEDDED_AUDIO_CLOCK_VIDEO_INPUT to CNTV2Card::SetEmbeddedAudioClock. If this wasn’t done, and the board reference was NTV2_REFERENCE_FREERUN or some other timebase that differed from the input video signal, the audio would eventually drift from the video. (See also NTV2DeviceCanChangeEmbeddedAudioClock.)

Audio Playout

If the device supports SDI playout, each Audio System has an output embedder that generates audio packets (per SMPTE 299M for HD and SMPTE 272M for SD) and inserts them into the HANC area of the outgoing SDI data stream.

  • Audio channels 1 & 2 are transmitted on Embedded Group 1, channels 1 & 2.
  • Audio channels 3 & 4 are transmitted on Embedded Group 1, channels 3 & 4.
  • Audio channels 5 & 6 are transmitted on Embedded Group 2, channels 1 & 2.
  • Audio channels 7 & 8 are transmitted on Embedded Group 2, channels 3 & 4.
  • In 16-channel mode (see CNTV2Card::GetNumberAudioChannels), the remaining 8 channels are distributed in Embedded Groups 3 and 4 in a similar fashion.

There is currently no provision for enabling or disabling specific audio groups.

The SDI output embedder always inserts audio packets unless it’s been disabled (see CNTV2Card::SetAudioOutputEmbedderState).

Call CNTV2Card::IsAudioOutputRunning to determine if the playout side of the Audio System is running or not. Call CNTV2Card::StartAudioOutput to start the playout side of the Audio System running. Call CNTV2Card::StopAudioOutput to stop the playout side of the Audio System running.

When the Audio System is stopped, the output embedder will either embed silence (zeroes) into the data stream, or, if NTV2AudioLoopBack mode is enabled, it will embed audio samples obtained (through a FIFO) from its input de-embedder (see CNTV2Card::SetAudioLoopBack).

When the Audio System is running, each 24-bit audio sample is copied from the most-significant 3 bytes of each 32-bit longword in the device audio buffer (the least-significant byte is ignored). Note, however, for SD, only the most-significant 20 bits are used (since the embedder does not create extended audio packets).

During playout, the output embedder pulls audio samples from the Audio Output Buffer in device memory at the address specified by the Audio System’s Audio Output Last Address register (i.e., the Play Head or “read head”). On older, non-stacked-audio devices, this is done in 128-byte chunks. On newer, stacked-audio devices, it’s done in 512-byte chunks.

Call CNTV2Card::ReadAudioLastOut to get the current Play Head position. Audio data continues to be read from the Output Buffer until the end is reached, whereupon the Play Head wraps back to the start of the buffer, where reading continues.

Startup Delay: Ordinarily, when playout starts, the Audio System immediately starts pulling samples from the Audio Output Buffer, encoding them into audio packets and embedding those first several packets into the current outgoing video frame, often mid-frame, preceded by a number of packets containing silence. This makes it difficult for applications to precisely determine the location of frame breaks in the Audio Output Buffer. Starting in SDK 15.6, and using newer AJA hardware and firmware (see CNTV2Card::CanDoAudioWaitForVBI), CNTV2Card::StartAudioOutput has an optional “waitForVBI” parameter that if set True, causes the firmware to delay starting Audio Playout until the next output VBI, so that the first samples from the Audio Output Buffer end up in the first audio packets in the next outgoing video frame.

Output Delay: Newer AJA hardware firmware implements an adjustable Output Delay that can be applied while samples are being read from the Audio Output Buffer. Call NTV2DeviceCanDoAudioDelay to determine if this feature is available. Call CNTV2Card::GetAudioOutputDelay to obtain the current delay value. Call CNTV2Card::SetAudioOutputDelay to change it.

Erase Mode: The playout engine has an optional Erase Mode, in which it will automatically clear (zero) the Output Buffer memory immediately behind the Play Head as it runs. If the host application fails to transfer new samples into the Audio Output Buffer, the buffer will eventually contain all zeroes, and the output embedder will thereafter only transmit silence. Use the CNTV2Card::SetAudioOutputEraseMode function to configure this feature.

DMA Transfer: Audio data can be transferred from the host to the device audio buffer via DMA by calling CNTV2Card::DMAWriteAudio. If the playout engine’s hardware Play Head catches up to, or passes, the buffer region being written by CNTV2Card::DMAWriteAudio, then audio/video synchronization has been lost. Care must be taken to ensure that enough samples are always written well ahead of the Play Head.

There is no provision for changing the Play Head position while Audio System playback is running … except perhaps to reset playback to the start of the audio buffer (by calling both CNTV2Card::StopAudioOutput and then CNTV2Card::StartAudioOutput). Of course, applications have full control over the number of samples written, and where they get written into the Audio Output Buffer. Applications are free to drop samples or add silence as needed, while always ensuring these transfers stay ahead of the Play Head.

If AutoCirculate Playout is being used, AutoCirculate completely and automatically runs the Audio System. When CNTV2Card::AutoCirculateInitForOutput is called with a valid NTV2AudioSystem, and then CNTV2Card::AutoCirculateStart is called, AutoCirculate starts the Audio System. Youʼll need to transfer the correct number of audio samples via AUTOCIRCULATE_TRANSFER::SetAudioBuffer or AUTOCIRCULATE_TRANSFER::acAudioBuffer before calling CNTV2Card::AutoCirculateTransfer. See Correlating Audio Samples to Video Frames (below) on how to calculate the correct number of audio samples for the current outgoing frame.

SDI Output: SDI output embedders can ordinarily be driven by any Audio System.

HDMI Output: The HDMI standard supports a minimum of 2 audio channels or a maximum of 8. If the NTV2 device has an HDMI output (see NTV2DeviceGetNumHDMIVideoOutputs ), it can be configured to transmit audio from any Audio System:

AES/EBU Output: For devices that support AES/EBU output through a breakout box or cable (see NTV2DeviceCanDoBreakoutBox and NTV2DeviceGetNumAESAudioOutputChannels functions), the output BNCs will automatically carry the same per-audio-channel samples being played/embedded from Audio Sytem 1 (NTV2_AUDIOSYSTEM_1). This can be changed to use a different set of 4 audio channels, even from a different Audio System (if available).

Analog Output: For devices that support analog audio output through a breakout box or cable (see NTV2DeviceCanDoBreakoutBox and NTV2DeviceGetNumAnalogAudioOutputChannels functions), the output XLRs follow whatʼs being carried by the AES/EBU Outputs (above).

Monitor Output

For devices that support analog audio monitoring through two RCA jacks on a breakout box (see NTV2DeviceHasAudioMonitorRCAJacks and NTV2DeviceCanDoBreakoutBox) and/or a headphone jack (see NTV2DeviceHasHeadphoneJack), by default, the monitor output will carry audio channels 1 & 2 (NTV2_AudioChannel1_2) from Audio Sytem 1 (NTV2_AUDIOSYSTEM_1).

Non-PCM Data:

Downstream equipment can be told that the outgoing audio is not carrying PCM data, by setting the non-PCM indicator in the AES header. Older AJA devices can only do this on an audio-system-wide basis — i.e., all outgoing audio groups are marked PCM or non-PCM. Use the simpler form of the CNTV2Card::SetAudioPCMControl function for these devices.

Newer AJA devices can mark individual audio channel pairs as non-PCM (the NTV2DeviceCanDoPCMControl function returns true for devices that support this capability). Use one of the overloaded versions of CNTV2Card::SetAudioPCMControl that accepts either a single NTV2AudioChannelPair or an NTV2AudioChannelPairs set.

AES Sync-Mode Bit:

By default, the embedder clears the Sync Mode bit in the AES header in the Audio Control Packets, which tells downstream equipment that the outgoing audio is asynchronous, even though overall, the correct total number of audio samples over a span of several frames always get transmitted. This is particularly relevant for 29.97/59.94 frame rates, in which the number of 48 kHz audio samples varies with each frame … yet is constant/fixed over a 5-frame sequence.

If downstream equipment expects synchronous audio, and is alarming about the asynchronous audio, the output embedder can be told to set the Sync Mode bit, but note that this is “fibbing”:

Note
When the embedder is configured to “fib” — i.e. set the Sync Mode bit in the AES header in the Audio Control Packet — audio and video are synchronized in time, but the resulting audio doesn’t exactly follow the definition of “synchronized” in SMPTE 299 § 7.2.1.3, because the embedder doesn’t set the Frame Sequence Number in the AES header. SMPTE 299, however, stipulates that receivers should correctly receive audio even from equipment that doesn’t fully conform to § 7.2.1.3.

The “NTV2Watcher” tool has a “Tone Generator” Tool that can be used to fill any Audio System’s output buffer, either statically (one-time data fill) or dynamically (continuously).

Correlating Audio Samples to Video Frames

Because AJA devices use fixed audio sample rates (i.e. 48000 samples per second), some video frame rates will necessarily result in some frames having more audio samples than others. For example, the NTSC frame rate is exactly 30000/1001 frames per second — so by converting frames to samples, the expected number of audio samples at any given frame time can be calculated. This is what the GetAudioSamplesPerFrame utility function is for:

// Print the audio sample count cadence for NTSC 2997...
for (ULWord frame(0); frame < 60; )
{
std::cout << DEC(::GetAudioSamplesPerFrame(NTV2_FRAMERATE_2997, NTV2_AUDIO_48K, frame));
if (++frame < 60)
std::cout << ", ";
if (!(frame % 5))
std::cout << std::endl;
}
  • Capture
    • Without AutoCirculate — the number of audio samples to associate with the current frame is provided by the hardware’s Record Head. Just compare its new position with its old position from the previous frame.
    • With AutoCirculate — Use the AUTOCIRCULATE_TRANSFER::GetCapturedAudioByteCount function.
  • Playout
    • Without AutoCirculate — GetAudioSamplesPerFrame will return the recommended number of samples to write for the current frame. It’s important to transfer samples ahead of the Play Head (yet not so far or so many as to overrun it).
    • With AutoCirculate — Use GetAudioSamplesPerFrame to calculate the number of audio samples to write for the current frame. Transferring more or fewer samples than this number may impel AutoCirculate to reset the audio.

Multi-Link Audio (32, 48, 64 Audio Channels)

By default, per SMPTE standard, up to 16 independent audio channels are supported by a single 3G SDI signal (except for 2K and 4K formats, which only support up to 8 channels, as previously noted, due to reduced HANC space).

SDK 16.2 introduced the capability of adding an additional bank of 16 audio channels with each additional SDI link of multi-link video input or output:

  • For dual-link 3G, 6G or 12G configurations, up to 32 audio channels are supported.
  • For quad-link 3G, 6G or 12G (UHD2/8K) configurations, 32, 48 or 64 audio channels are supported.
Note
This feature requires newer firmware and driver version 16.2 or later.

Essentially, it gangs together 2 to 4 Audio Systems, and operates the higher-numbered ones as “slaves” by the lowest-numbered one – i.e. the “master” – to record (or play) samples through them all simultaneously.

Each controlled Audio System uses its same 4MB of device memory for buffering audio samples. The driver automatically handles redirecting each link’s samples during the DMA (CNTV2Card::AutoCirculateTransfer).

Note
This capability currently only works with AutoCirculate channels NTV2_CHANNEL1 or NTV2_CHANNEL3.

To enable and use this feature:

“Hidden” Audio Systems

Modern AJA devices intended for “retail” markets, particularly newer KONA Boards and Io (Thunderbolt) Devices, may have firmware that implements additional “hidden” Audio Systems that aren’t reported by the NTV2DeviceGetNumAudioSystems function:

These additional Audio Systems help support AJA’s “retail” software (i.e. Adobe, Avid, Apple, Telestream, etc. plug-ins, AJA ControlRoom, etc).

The Host Audio System is used to continuously deliver…

  • SDI/HDMI/AES audio from the AJA KONA/Io device as input to the host computer’s primary audio system. For example, this would enable an audio capture program running on the host (e.g. Audacity) to capture audio from an SDI input signal on the KONA/Io device.
  • Host audio output from the host OS’s primary system audio to the KONA/Io device’s SDI/HDMI/AES output. For example, this would enable audio from a web browser running on the host computer to playout through a KONA/Io device’s SDI output.

The Host Audio System is started and operated by the AJA kernel driver in conjunction with the host computer system’s audio control panel. It allows host audio to operate independently of other Audio Systems on the device that may be used by AutoCirculate or other SDK client software.

Since the host audio system uses audio buffer memory in device SDRAM, it’s susceptible to Audio Buffer Corruption if an excessively large video buffer number is used by an active FrameStore.

Audio Buffer Corruption

It’s possible (and quite easy) to configure a FrameStore to write video into audio buffer memory. For example:

CNTV2Card device;
if (CNTV2DeviceScanner::GetFirstDeviceFromArgument("0", device))
{
// Assume this device has valid video signal at SDI Input 1
device.ClearRouting(); // Clear all existing connections
device.EnableChannel(NTV2_CHANNEL1); // Enable FrameStore 1
device.SetMode(NTV2_CHANNEL1, NTV2_MODE_CAPTURE); // Set FrameStore 1 to capture mode
device.SetSDITransmitEnable(NTV2_CHANNEL1, false); // Set SDI connector 1 to capture
device.Connect(NTV2_XptFrameBuffer1Input, NTV2_XptSDIIn1); // Connect SDI In 1 to FrameStore 1
// Which video frame is the first to contain audio system audio?
// You could just start incrementing frame numbers until you start getting bad audio.
// But here’s how to really do it...
NTV2FrameGeometry fg;
NTV2PixelFormat fbf;
device.GetFrameGeometry(fg, NTV2_CHANNEL1);
device.GetFrameBufferFormat(NTV2_CHANNEL1, fbf);
ULWord firstAudioFrameNum = ::NTV2DeviceGetNumberFrameBuffers(device.GetDeviceID(), fg, fbf);
if (::NTV2DeviceCanDoStackedAudio(device.GetDeviceID()))
{
ULWord chan1CtrlBits(0);
mDevice.ReadRegister(kRegCh1Control, &chan1CtrlBits);
ULWord frameSizeMB (1 << (((chan1CtrlBits & kK2RegMaskFrameSize) >> 20) + 1));
if (frameSizeMB < 8)
frameSizeMB = 8; // No 2MB mode!
const ULWord maxRamBytes(::NTV2DeviceGetActiveMemorySize(device.GetDeviceID()));
const ULWord numAudioSystems(::NTV2DeviceGetNumAudioSystems(device.GetDeviceID()));
const ULWord totalAudioBytes(numAudioSystems * 8ULL*1024ULL*1024*ULL); // 8MB per audio system
firstAudioFrameNum = (maxRamBytes - totalAudioBytes) / frameSizeMB;
}
// UH-OH: This will cause video to be written into the audio buffers...
device.SetInputFrame(NTV2_CHANNEL1, firstAudioFrameNum); // Write FrameStore 1 video into audio area
}

In the above example…

  • On “stacked audio” devices, this will write video into the last Audio System’s buffer memory.
  • On older “non-stacked audio” devices, this will write video into the first Audio System’s buffer memory.
  • To notice the corruption, the affected Audio System will need to be running (playout and/or capture).
  • It’s more likely to be noticed in audio playout, since the output audio buffer starts at the top of the frame.
  • Small frame geometries and pixel formats (e.g., 8-bit YUV 525i) are less likely to touch the audio capture buffer that starts 4MB into the frame.

It’s also possible (and quite easy) to configure a FrameStore to playout SDI/HDMI video that’s been corrupted by audio-in-the-video. This would happen if the FrameStore is set for playout and it’s using a frame buffer that’s also being used by a running Audio System.

Audio Mixer

Some newer NTV2 devices have firmware that implements a three-multichannel-input Audio Mixer.

The Audio Mixer firmware supports up to three two-channel (stereo) audio inputs:

The resulting mixed audio is inserted onto the audio channel pair selected for the mix from the Main input, and the rest of that Audio System’s channel pairs are passed through to that same Audio System’s output (unless they’ve been muted).

Any of the Audio Mixer’s inputs can be disabled (muted) or enabled (unmuted).

Each Audio Mixer input has a gain control.

Each audio channel of the Audio Mixer’s output (up to 16 channels) can be individually muted.

The Audio Mixer’s audio levels can be monitored:

Firmware

NTV2 devices have an EEPROM (non-volatile memory) that stores its FPGA programming. This flash memory is commonly divided into a minimum of two logical partitions:

  • the “main” partition — for the normal FPGA bitfile image;
  • the “failsafe” boot — for a fallback FPGA bitfile image.

Some AJA devices — like the KONA IP — have, in addition to the normal FPGA hardware, a microprocessor, which requires an additional, separate firmware bitfile that bootstraps and operates it. This extra firmware is bundled into a “package” that is also stored in (and loaded from) a separate partition in the EEPROM.

Traditionally, the FPGA is only loaded from flash memory upon power-up. The “failsafe” bitfile loads if…

  • the board’s “failsafe” button is held down while power is applied to the board;
  • the “main” FPGA bitfile image was invalid or otherwise failed to load.

All NTV2 devices have two on-board LEDs that indicate readiness:

  1. Power — If the board has power, this will indicate Green; otherwise it won’t be lit.
  2. FPGA Load State:
    • Green — Normal firmware bitfile loaded successfully.
    • Amber — Fail-safe firmware bitfile loaded.
    • Red — FPGA not programmed; firmware load failed.

When operating normally, both LEDs will be Green.

Note
On the Io and T-Tap products, the LEDs are hidden inside the chassis and can’t be seen.

Loading Firmware

Loading the FPGA from EEPROM after power-up takes a finite amount of time. If this exceeds the amount of time allotted by the BIOS for PCIe devices to become ready, the AJA device won’t be detected by the BIOS, and thus won’t be probed by — or matched to — any device drivers.

  • On Windows PCs, this is shown as an “Unknown device” in the Windows Device Manager.
  • On Linux PCs, the ‘lspci’ command can help diagnose these issues. For example, here’s what ‘lspci’ should normally show when looking for devices with AJA’s PCIe vendor ID of 0xF1D0 (e.g. for a Corvid88):
    $ lspci -d f1d0:
    03:00.0 Multimedia video controller: AJA Video Device eb0d
    $ lspci -n -d f1d0:
    03:00.0 0400: f1d0:eb0d
    $ lspci -nn -d f1d0:
    03:00.0 Multimedia video controller [0400]: AJA Video Device [f1d0:eb0d]

Disable Fast-Boot Option:
On PCs running Windows or Linux, be sure to disable all fast-boot options in the BIOS.

Disable Power-Saving Modes:
AJA’s NTV2 devices do not support PCIe power management.

  • Be sure to disable any and all Energy-Saving features in the OS, particularly PCIe “Link State Power Management” (LSPM).
  • Windows — This is in “Advanced Power Settings” ==≻ “Power Options” ==≻ “PCI Express” ==≻ “Link State Power Management” ==≻ Off.
  • Linux — Use the lspci command:
    $ sudo lspci -vvv -d f1d0:
    … and confirm that “LnkCtl: ASPM Disabled” is shown for each AJA device.
  • On some motherboards, power management is controlled by the BIOS, in which case, try disabling ASPM under the BIOS’ power options.

If, even after disabling “fast-boot”, the AJA device fails to show up, …

  • Try “warm-booting” the PC. If the device is recognized after a warm-boot, then it’s likely a firmware load-time issue.
  • Try installing the AJA board into a different PCIe slot on the motherboard. Some manufacturers employ chips that perform intermediate buffering on certain specific PCIe slots that can sometimes cause detection issues. Also beware that some manufacturers use a custom BIOS that has options for configuring PCIe slots, so be sure to check those BIOS settings and adjust them if needed.
  • If the device still fails to show up, please contact AJA Support.

“Warm Boot” Reload
Some newer AJA devices are capable of reloading the FPGA upon a PCIe Reset — aka a “warm boot”.

  • To test if the device can do a “warm boot” FPGA reload, call CNTV2Card::CanWarmBootFPGA.
  • Note that AJA devices with Thunderbolt ports (e.g. Io4K Plus ), or AJA boards installed on Thunderbolt PCIe card-cages receive a PCIe Reset when the Thunderbolt cable is unplugged and subsequently reconnected.

“Flashing” Firmware

AJA provides two ways to “flash” — i.e. update — new firmware into the device’s EEPROM storage:

  1. Using ‘ntv2firmwareinstaller’ Command-Line Utility command-line utility.
  2. Using the AJA ControlPanel, which is part of the “retail” software that can be downloaded from https://www.aja.com/.

Once the new firmware has been written into the device EEPROM storage, it won’t “run” until the device FPGA gets reloaded (see Loading Firmware above).

Determining Firmware Version

Note
The currently-running firmware could be different from the currently-installed firmware that’s stored in the EEPROM’s main partition. This can happen if the device wasn’t power-cycled after a firmware update installation, or if the device was booted using its “failsafe” firmware.

There are three ways to determine what firmware is installed, and/or which firmware is running on an AJA device:

  • ‘ntv2firmwareinstaller’ Command-Line Utility command line utility, using its –info option;
  • the “Info” or “Firmware” panels of the AJA ControlPanel application (in AJA’s “retail” software);
  • programmatically using certain SDK API calls (described below).

Newer AJA devices (starting with the Corvid 88) report their currently-running firmware date in register 88, which is made available as numeric date components or a std::string by calling CNTV2Card::GetRunningFirmwareDate.

Older AJA devices prior to the introduction of the Corvid 88 have no way of reporting their currently-running firmware date — they can only report the running firmware’s revision number (which was stored in a portion of register 48 and made available by the CNTV2Card::GetRunningFirmwareRevision function. To correlate the revision number to a date, it must be looked up at https://github.com/aja-video/ntv2-firmware (not very convenient).

Determining Firmware Features

NTV2, being an old and rather crude architecture, traditionally had no automatically-enforced linkage between the firmware and the SDK — i.e. the SDK was neither generated from the firmware, nor was the firmware generated from the SDK. Thus, the SDK could not simply “ask the board” to find out how many of a particular widget a device’s running firmware implements, or if a new widget or feature is present (by simply reading registers). Unfortunately, this put the burden of feature inquiry entirely into software, and onto the authors of NTV2 client applications.

The old Device Features API functions covered 95% of all hardware and firmware feature variations on NTV2 devices, but they couldn’t answer a simple question like:

  • The Io4K Plus and Avid DNxIV have identical firmware, but only the Avid device has an XLR microphone input on its front panel.
    Q: How do you determine if the microphone connector is present (i.e. that it’s an Avid DNxIV)?
    A:You must ask the device itself:

See Device Features for more information.

In future SDKs and NTV2 hardware products, AJA will be producing some parts of both the SDK and device firmware from a description of the hardware that’s specified using a high-level hardware description language (HIDL). The SDK will be able to compute (and therefore “know”) the feature set for any given firmware revision for a device based on its accompanying HIDL description.

Fast Bitfile Switching

New 8K and 12-bit workflows have made it extremely difficult to simultaneously fit FrameStores, CSCs, LUTs, and Mixers into even the much larger modern FPGAs. This has made it necessary to enable the ability to rapidly switch between different workflow-based bitfiles.

There’s a new API in the CNTV2Card class that adds support for this capability:

These new API calls make use of a new CNTV2BitfileManager singleton class that caches and manages the available bitfiles for various AJA devices. It can be used if finer control is needed over the basic functionality in CNTV2Card.

NTV2_FBF_ARGB
@ NTV2_FBF_ARGB
See 8-Bit ARGB, RGBA, ABGR Formats.
Definition: ntv2enums.h:212
NTV2_CHANNEL2
@ NTV2_CHANNEL2
Specifies channel or Frame Store 2 (or the 2nd item).
Definition: ntv2enums.h:1308
NTV2DeviceGetNumberFrameBuffers
ULWord NTV2DeviceGetNumberFrameBuffers(NTV2DeviceID id, NTV2FrameGeometry fg, NTV2FrameBufferFormat fbf)
Definition: ntv2devicefeatures.cpp:493
NTV2_FRAMERATE_2997
@ NTV2_FRAMERATE_2997
Fractional rate of 30,000 frames per 1,001 seconds.
Definition: ntv2enums.h:403
NTV2_AUDIO_48K
@ NTV2_AUDIO_48K
Definition: ntv2enums.h:1875
NTV2DeviceGetActiveMemorySize
ULWord NTV2DeviceGetActiveMemorySize(const NTV2DeviceID inDeviceID)
Definition: ntv2devicefeatures.hpp:8262
NTV2DeviceCanDoMultiLinkAudio
bool NTV2DeviceCanDoMultiLinkAudio(const NTV2DeviceID inDeviceID)
Definition: ntv2devicefeatures.hpp:4155
CNTV2DeviceScanner::GetFirstDeviceFromArgument
static bool GetFirstDeviceFromArgument(const std::string &inArgument, CNTV2Card &outDevice)
Rescans the host, and returns an open CNTV2Card instance for the AJA device that matches a command li...
Definition: ntv2devicescanner.cpp:366
kDeviceCanDoPlayback
@ kDeviceCanDoPlayback
Definition: ntv2devicefeatures.h:74
CNTV2Card::ClearRouting
virtual bool ClearRouting(void)
Removes all existing signal path connections between any and all widgets on the AJA device.
Definition: ntv2regroute.cpp:278
CNTV2Card::AutoCirculateInitForInput
virtual bool AutoCirculateInitForInput(const NTV2Channel inChannel, const UWord inFrameCount=7, const NTV2AudioSystem inAudioSystem=NTV2_AUDIOSYSTEM_INVALID, const ULWord inOptionFlags=0, const UByte inNumChannels=1, const UWord inStartFrameNumber=0, const UWord inEndFrameNumber=0)
Prepares for subsequent AutoCirculate ingest, designating a contiguous block of frame buffers on the ...
Definition: ntv2autocirculate.cpp:221
CNTV2Card::SetOutputFrame
virtual bool SetOutputFrame(const NTV2Channel inChannel, const ULWord inValue)
Sets the output frame index number for the given FrameStore. This identifies which frame in device SD...
Definition: ntv2register.cpp:2191
NTV2FrameBufferFormat
NTV2FrameBufferFormat
Identifies a particular video frame buffer format. See Device Frame Buffer Formats for details.
Definition: ntv2enums.h:207
NTV2_CHANNEL1
@ NTV2_CHANNEL1
Specifies channel or Frame Store 1 (or the first item).
Definition: ntv2enums.h:1307
CNTV2Card::SetSDITransmitEnable
virtual bool SetSDITransmitEnable(const NTV2Channel inChannel, const bool inEnable)
Sets the specified bidirectional SDI connector to act as an input or an output.
Definition: ntv2register.cpp:3796
CNTV2Card::GetFrameBufferFormat
virtual bool GetFrameBufferFormat(NTV2Channel inChannel, NTV2FrameBufferFormat &outValue)
Returns the current frame buffer format for the given FrameStore on the AJA device.
Definition: ntv2register.cpp:1875
AUTOCIRCULATE_WITH_MULTILINK_AUDIO1
#define AUTOCIRCULATE_WITH_MULTILINK_AUDIO1
Use this to AutoCirculate with base audiosystem controlling base AudioSystem + 1.
Definition: ntv2publicinterface.h:5531
CNTV2DriverInterface::IsSupported
virtual bool IsSupported(const NTV2BoolParamID inParamID)
Definition: ntv2driverinterface.h:422
CNTV2Card::features
virtual class DeviceCapabilities & features(void)
Definition: ntv2card.h:141
NTV2_XptFrameBuffer1Input
@ NTV2_XptFrameBuffer1Input
Definition: ntv2enums.h:2693
ULWordSet
std::set< ULWord > ULWordSet
A collection of unique ULWord (uint32_t) values.
Definition: ntv2publicinterface.h:54
ULWord
uint32_t ULWord
Definition: ajatypes.h:253
CNTV2Card::SetMode
virtual bool SetMode(const NTV2Channel inChannel, const NTV2Mode inNewValue, const bool inIsRetail=(!(0)))
Determines if a given FrameStore on the AJA device will be used to capture or playout video.
Definition: ntv2register.cpp:1607
NTV2_CHANNEL3
@ NTV2_CHANNEL3
Specifies channel or Frame Store 3 (or the 3rd item).
Definition: ntv2enums.h:1309
NTV2_REFERENCE_FREERUN
@ NTV2_REFERENCE_FREERUN
Specifies the device's internal clock.
Definition: ntv2enums.h:1404
CNTV2Card
I interrogate and control an AJA video/audio capture/playout device.
Definition: ntv2card.h:28
CNTV2DriverInterface::GetNumSupported
virtual ULWord GetNumSupported(const NTV2NumericParamID inParamID)
Definition: ntv2driverinterface.h:433
NTV2DeviceGetNumAudioSystems
UWord NTV2DeviceGetNumAudioSystems(const NTV2DeviceID inDeviceID)
Definition: ntv2devicefeatures.hpp:9864
NTV2_XptSDIIn2
@ NTV2_XptSDIIn2
Definition: ntv2enums.h:2476
CNTV2Card::GetFrameGeometry
virtual bool GetFrameGeometry(NTV2FrameGeometry &outValue, NTV2Channel inChannel=NTV2_CHANNEL1)
Definition: ntv2register.cpp:970
CNTV2Card::Connect
virtual bool Connect(const NTV2InputCrosspointID inInputXpt, const NTV2OutputCrosspointID inOutputXpt, const bool inValidate=(0))
Connects the given widget signal input (sink) to the given widget signal output (source).
Definition: ntv2regroute.cpp:87
DEC
#define DEC(__x__)
Definition: ntv2publicinterface.h:5605
NTV2_XptFrameBuffer2Input
@ NTV2_XptFrameBuffer2Input
Definition: ntv2enums.h:2695
kDeviceGetNumHDMIVideoOutputs
@ kDeviceGetNumHDMIVideoOutputs
The number of HDMI video outputs on the device.
Definition: ntv2devicefeatures.h:199
AUTOCIRCULATE_WITH_MULTILINK_AUDIO2
#define AUTOCIRCULATE_WITH_MULTILINK_AUDIO2
Use this to AutoCirculate with base audiosystem controlling base AudioSystem + 2.
Definition: ntv2publicinterface.h:5532
NTV2_MODE_CAPTURE
@ NTV2_MODE_CAPTURE
Capture (input) mode, which writes into device SDRAM.
Definition: ntv2enums.h:1202
NTV2_XptFrameBuffer2YUV
@ NTV2_XptFrameBuffer2YUV
Definition: ntv2enums.h:2492
NTV2_XptSDIIn1
@ NTV2_XptSDIIn1
Definition: ntv2enums.h:2475
GetAudioSamplesPerFrame
ULWord GetAudioSamplesPerFrame(const NTV2FrameRate inFrameRate, const NTV2AudioRate inAudioRate, ULWord inCadenceFrame=0, bool inIsSMPTE372Enabled=false)
Returns the number of audio samples for a given video frame rate, audio sample rate,...
Definition: ntv2utils.cpp:2789
NTV2DeviceCanDoStackedAudio
bool NTV2DeviceCanDoStackedAudio(const NTV2DeviceID inDeviceID)
Definition: ntv2devicefeatures.hpp:5196
NTV2FrameGeometry
NTV2FrameGeometry
Identifies a particular video frame geometry.
Definition: ntv2enums.h:336
CNTV2DriverInterface::GetDeviceID
virtual NTV2DeviceID GetDeviceID(void)
Definition: ntv2driverinterface.cpp:381
kK2RegMaskFrameSize
@ kK2RegMaskFrameSize
Definition: ntv2publicinterface.h:1244
kRegCh1Control
@ kRegCh1Control
Definition: ntv2publicinterface.h:103
CNTV2Card::SetInputFrame
virtual bool SetInputFrame(const NTV2Channel inChannel, const ULWord inValue)
Sets the input frame index number for the given FrameStore. This identifies which frame in device SDR...
Definition: ntv2register.cpp:2209
CNTV2Card::AutoCirculateStart
virtual bool AutoCirculateStart(const NTV2Channel inChannel, const ULWord64 inStartTime=0)
Starts AutoCirculating the specified channel that was previously initialized by CNTV2Card::AutoCircul...
Definition: ntv2autocirculate.cpp:503
CNTV2Card::SetReference
virtual bool SetReference(const NTV2ReferenceSource inRefSource, const bool inKeepFramePulseSelect=(0))
Sets the device's clock reference source. See Video Output Clocking & Synchronization for more inform...
Definition: ntv2register.cpp:1484
DeviceCapabilities::CanDoPixelFormat
bool CanDoPixelFormat(const NTV2PixelFormat inPF)
Definition: ntv2devicecapabilities.h:227
CNTV2Card::EnableChannel
virtual bool EnableChannel(const NTV2Channel inChannel)
Enables the given FrameStore.
Definition: ntv2register.cpp:2097
NTV2_MODE_DISPLAY
@ NTV2_MODE_DISPLAY
Playout (output) mode, which reads from device SDRAM.
Definition: ntv2enums.h:1200
CNTV2DriverInterface::GetSupportedItems
virtual ULWordSet GetSupportedItems(const NTV2EnumsID inEnumsID)
Definition: ntv2driverinterface.cpp:1382
NTV2_XptSDIOut3Input
@ NTV2_XptSDIOut3Input
Definition: ntv2enums.h:2741
kNTV2EnumsID_PixelFormat
@ kNTV2EnumsID_PixelFormat
Identifies the NTV2PixelFormat enumerated type.
Definition: ntv2devicefeatures.h:235
NTV2_AUDIOSYSTEM_INVALID
@ NTV2_AUDIOSYSTEM_INVALID
Definition: ntv2enums.h:3826