Github – IXLab / Vidformer

A research project that provides infrastructure for videos-native interfaces and accelerates the rush of viewing the computer. Developed by OSU interactive data systems.

Vidformer Efficiently changes videos, which enforces faster annotation, editing, and video data processing – without having to focus on performance.

It uses a declaration of specification format to represent changes. It makes:

• Transparent Optimization: Vidformer optimizes imposing declaration details such as a relational database that optimizes questions with questions.

• Lazy / intimidated killings: Video results can be obtained demand, allowing for practical playing video results.

Vidformer built open technologies you can use:

• OPENCV: art cv2-Compates interface ensures your (and LLMS) can use previous knowledge and code.
• Management: management-Conview of annotators makes models of viewing computer models with no reason.
• Ffmpeg: Constructed of both libraries, codecs, and formats running the world.
• Jupyter: Look at the transformed videos immediately instantly in your notebook.
• Http live streaming (HLS): Serve the changed videos on a network directly to any media player.
• Apache Adidenal: Access to videos of origin anywhere where they are stored.

The easiest way to start is using Vidformer’s cv2 frontend, allowing most of the scripts to open Python OpenCV to replace import cv2 OTHERS import vidformer.cv2 as cv2:

import vidformer.cv2 as cv2

cap = cv2.VideoCapture("my_input.mp4")
fps = cap.get(cv2.CAP_PROP_FPS)
width = int(cap.get(cv2.CAP_PROP_FRAME_WIDTH))
height = int(cap.get(cv2.CAP_PROP_FRAME_HEIGHT))

out = cv2.VideoWriter("my_output.mp4", cv2.VideoWriter_fourcc(*"mp4v"),
                        fps, (width, height))
while True:
    ret, frame = cap.read()
    if not ret:
      break

    cv2.putText(frame, "Hello, World!", (100, 100), cv2.FONT_HERSHEY_SIMPLEX,
                1, (255, 0, 0), 1)
    out.write(frame)

cap.release()
out.release()

You can find the details of this Starting Guide.

File Layout:

Vidformer components detailed HERE.

❌ Vidformer not:

• A typical video editor (such as premiere pro or last cut)
• A video database / VDBMS
• A natural questionnaire in the language question for video
• A library of sight inner (such as OPENCV)
• A model of computer content AI (such as clip or yolo)

However, the vidformer is strongly complemented by each of these. If you work with any of the late four, the vidformer can be for you.

LIBLE: The vidformer is open source under Apache-2.0. Contributions are welcomed.

Creative: Vidformer supports US National Science Foundation under Awards # 2118240 and # 1910356.