Architecture for delivery of video content responsive to remote interaction

A server system for communicating video frames across a network, the system comprising:nan image management engine adapted to capture a succession of user interfaces provided in an application on the server, compare each capture in the succession of captures to a prior capture and identify captures that differ from prior captures, convert identified captures into corresponding video frames and resize the video frames at a variable rate, the conversion based on one or more feedback parameters and video conversion techniques, the resizing based on one or more feedback parameters and image resizing techniques;a video encoder engine adapted to encode the video frames for transmission across the network, the encoding based on one or more feedback parameters and including video compression techniques;a first command process engine adapted to receive user input; anda processor for executing the engines.

A computer-implemented method for communicating video frames across a network, the method comprising:nreceiving a succession of captures of a user interface of a program;comparing each capture in the succession of captures to a prior capture;identifying captures that differ from prior captures;converting the identified captures of the user interface of the program into corresponding video frames at a variable rate, the conversion based on one or more feedback parameters and video conversion techniques;resizing the video frames, the resizing based on one or more feedback parameters and image resizing techniques;encoding the video frames, the encoding based on one or more feedback parameters and including video compression techniques;receiving a signal corresponding to a user request; andcommunicating the user input to the program.

A server system for communicating video frames across a network, the system comprising:na plurality of image management engines adapted to capture a succession of a plurality of user interfaces provided in a plurality of applications on the plurality of image management engines, compare each capture in the succession of captures to a prior capture, identify captures that differ from prior captures, and convert identified captures into corresponding video frames at a variable rate;a plurality of video encoder engines adapted to encode the video frames for transmission across the network, the encoding based on one or more feedback parameters and including video compression techniques;a command process engine operatively coupled to the plurality of programs and adapted to receive user input from a second device and communicate the user input to the corresponding program associated with the user input;an audio encoder engine operatively coupled to the plurality of programs and adapted to encode a plurality of audio streams corresponding to the plurality of programs;an audio interceptor engine operatively coupled to the plurality of programs and the audio encoder engine, and adapted to redirect the plurality of audio streams to the audio encoder engine, wherein the plurality of audio streams are each associated with one of a plurality of process identifiers corresponding to the plurality of programs, and the audio encoder engine is adapted to route the plurality of audio streams based on the associated process identifiers; anda processor for executing the engines.

A computer-implemented method for communicating video frames across a network, the method comprising:nreceiving a succession of captures of program with user interfaces;comparing each capture in the succession of captures to a prior capture;identifying captures that differ from prior captures;converting the identified captures of the plurality of programs that differ from prior captures into corresponding video frames at a variable rate;encoding the video frames, for transmission across a network to a corresponding plurality of second devices, the encoding based on one or more feedback parameters and including video compression techniques;receiving user input from the plurality of second devices;communicating the user input to the corresponding program associated with the user input;intercepting a plurality of audio streams corresponding to the plurality of programs;associating each of the plurality of audio streams with one of a plurality of process identifiers corresponding to the plurality of programs;encoding the plurality of audio streams; androuting the plurality of audio streams based on the associated process identifiers.

A system for receiving video frames from across a network, the system comprising:na video decoder engine adapted to decode a succession of encoded video frames of a user interface of a program transmitted across the network, the video frames encoded at a variable rate from captures of a user interface of a program based on one or more feedback parameters and video compression techniques, the captures of the user interface selected for encoding based on identification of difference between successive capturesa command process engine adapted to communicate user input of the system to the program; anda processor for executing the engines.