The server implements an interface to upload, generate, and edit videos with:
Custom vj:// URI scheme for accessing individual videos and projects
Each project resource has a name, description
Search results are returned with metadata about what is in the video, and when, allowing for edit generation directly
Prompts
Coming soon.
Tools
The server implements a few tools:
add-video: Add a video from a URL
search-videos: Search videos using embeddings
generate-edit-from-videos
generate-edit-from-single-video
Using Tools in Practice
In order to use the tools, you'll need to sign up for Video Jungle and add your API key.
add-video
Here's an example prompt to invoke the add-video tool:
This will download a video from a URL, add it to your library, and analyze it for retrieval later. Analysis is multi-modal, so both audio and visual components can be queried against.
search-videos
Once you've got a video downloaded and analyzed, you can then do queries on it using the search-videos tool:
Search results contain relevant metadata for generating a video edit according to details discovered in the initial analysis.
search-local-videos
You must set the environment variable LOAD_PHOTOS_DB=1 in order to use this tool, as it will make Claude prompt to access your files on your local machine.
Once that's done, you can search through your Photos app for videos that exist on your phone, using Apple's tags.
In my case, when I search for "Skateboard", I get 1903 video files.
generate-edit-from-videos
Finally, you can use these search results to generate an edit:
(Currently), the video edits tool relies on the context within the current chat.
generate-edit-from-single-video
Finally, you can cut down an edit from a single, existing video:
The server implements an interface to upload, generate, and edit videos with:
Custom vj:// URI scheme for accessing individual videos and projects
Each project resource has a name, description
Search results are returned with metadata about what is in the video, and when, allowing for edit generation directly
Prompts
Coming soon.
Tools
The server implements a few tools:
add-video: Add a video from a URL
search-videos: Search videos using embeddings
generate-edit-from-videos
generate-edit-from-single-video
Using Tools in Practice
In order to use the tools, you'll need to sign up for Video Jungle and add your API key.
add-video
Here's an example prompt to invoke the add-video tool:
This will download a video from a URL, add it to your library, and analyze it for retrieval later. Analysis is multi-modal, so both audio and visual components can be queried against.
search-videos
Once you've got a video downloaded and analyzed, you can then do queries on it using the search-videos tool:
Search results contain relevant metadata for generating a video edit according to details discovered in the initial analysis.
search-local-videos
You must set the environment variable LOAD_PHOTOS_DB=1 in order to use this tool, as it will make Claude prompt to access your files on your local machine.
Once that's done, you can search through your Photos app for videos that exist on your phone, using Apple's tags.
In my case, when I search for "Skateboard", I get 1903 video files.
generate-edit-from-videos
Finally, you can use these search results to generate an edit:
(Currently), the video edits tool relies on the context within the current chat.
generate-edit-from-single-video
Finally, you can cut down an edit from a single, existing video: